00000800:00000200:0.1F:1716999540.514910:0:3215:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800a640d6c0] -> 12345-192.168.203.103@tcp (2) 00000800:00000200:1.1F:1716999540.515394:0:3206:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800a640d6c0] -> 12345-192.168.203.103@tcp (2) 00000800:00000200:1.1:1716999540.515402:0:3206:0:(socklnd.c:186:ksocknal_destroy_peer()) peer_ni 12345-192.168.203.103@tcp ffff8800a8975180 deleted 00000800:00000010:1.1:1716999540.515404:0:3206:0:(socklnd.c:195:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at ffff8800a8975180. 00000800:00000200:1.1:1716999540.515407:0:3206:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:1.1:1716999540.515413:0:3206:0:(socklnd_cb.c:746:ksocknal_queue_tx_locked()) Sending to 12345-192.168.203.103@tcp ip 192.168.203.103:1023 00000800:00000200:1.1:1716999540.515416:0:3206:0:(socklnd_cb.c:765:ksocknal_queue_tx_locked()) Packet ffff8800b4999a00 type 2, nob 96 niov 1 nkiov 0 00000800:00000200:1.1:1716999540.515761:0:3205:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:1.1:1716999540.515965:0:3207:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800a640d6c0] -> 12345-192.168.203.103@tcp (4) 00000800:00000200:1.1:1716999540.515968:0:3207:0:(socklnd.c:186:ksocknal_destroy_peer()) peer_ni 12345-192.168.203.103@tcp ffff8800a8975180 deleted 00000800:00000010:1.1:1716999540.515969:0:3207:0:(socklnd.c:195:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at ffff8800a8975180. 00000800:00000200:1.1:1716999540.515971:0:3207:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 3, ksnr_connected a ksnr_max_conns 1 00000800:00000200:1.1:1716999540.516019:0:3205:0:(socklnd.c:409:ksocknal_incr_conn_count()) Add conn type 2, ksnr_connected e ksnr_max_conns 1 00010000:00000010:3.1F:1716999540.606868:0:11:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff8800b4999500. 00010000:00000010:3.1:1716999540.606901:0:11:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 552 at ffff8800a8900480. 00010000:00000010:1.1:1716999540.955997:0:27:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff88009c2c8900. 00010000:00000010:1.1:1716999540.956012:0:27:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 552 at ffff88012fef0240. 00010000:00000010:2.1F:1716999540.962989:0:34:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 552 at ffff8800a64686c0. 00010000:00000010:2.1:1716999540.963001:0:34:0:(ldlm_resource.c:1478:__ldlm_resource_free()) slab-freed '(res)': 240 at ffff8800a585e900. 00010000:00000010:2.1:1716999540.963004:0:34:0:(ldlm_lock.c:196:lock_handle_free()) slab-freed 'lock': 552 at ffff8800a695c900. 00010000:00010000:3.0:1716999785.427355:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc2e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427391:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc2dff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427396:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc2dff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427400:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc2dff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427404:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.427407:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc2dff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427411:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc2dff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427419:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999785.427421:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.427423:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc2dff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427427:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc2dff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427434:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc2e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427437:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc2e06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427441:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc2e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427447:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.427449:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc2e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427452:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc2e06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427456:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe0adadf (ffff880088977600) 00010000:00010000:3.0:1716999785.427458:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.427460:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc2e06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427464:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc2e06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.427488:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc2df8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64cea expref: 565 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.427493:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc2df8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64cea expref: 565 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.427501:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96640, rc 0) 00000100:00100000:3.0:1716999785.427528:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480615936:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 262us (1030us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999785.427533:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44858 00000100:00100000:3.0:1716999785.428730:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44860 00000100:00100000:3.0:1716999785.428738:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+564:11521:x1800404480616128:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.428752:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xbe3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999785.428807:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xbe3:0x0]: rc = -2 00000100:00100000:3.0:1716999785.428846:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+564:11521:x1800404480616128:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 109us (220us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999785.428851:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44860 00000100:00100000:3.0:1716999785.429747:0:10150:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10150:1800404483005120:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1716999785.429776:0:10150:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999785.429801:0:10150:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008eaabf00 going to sleep for 11 seconds 00000100:00100000:3.0:1716999785.432147:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480616192 00000100:00100000:3.0:1716999785.432152:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480616192 00000100:00100000:3.0:1716999785.432172:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480616256 00000100:00100000:3.0:1716999785.432174:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480616256 00000100:00100000:3.0:1716999785.432186:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44861 00000100:00100000:3.0:1716999785.432191:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+567:11419:x1800404480616192:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999785.432201:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999785.432213:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc2e30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64cf8 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.432234:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc2e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64cf8 expref: 568 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.432243:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc2e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64cf8 expref: 568 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.432249:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999785.432251:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.432254:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c958c0, rc 0) 00000100:00100000:3.0:1716999785.432280:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+568:11419:x1800404480616192:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 88us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.432288:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44861 00000100:00100000:3.0:1716999785.432301:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44862 00000100:00100000:3.0:1716999785.432304:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+567:11521:x1800404480616256:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.432316:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.432386:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+567:11521:x1800404480616256:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 80us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.432392:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44862 00000100:00100000:3.0:1716999785.432797:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480616320 00000100:00100000:3.0:1716999785.432800:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480616320 00000100:00100000:3.0:1716999785.432817:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9833 00000100:00100000:3.0:1716999785.432820:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+67:1959:x1800404480616320:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999785.432826:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999785.432845:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc2e37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64cff expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999785.432858:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x5f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999785.432869:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999785.432871:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999785.432876:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc2e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64cff expref: 68 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999785.432900:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc2e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64cff expref: 68 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999785.432908:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96880, rc 0) 00000100:00100000:3.0:1716999785.432930:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+68:1959:x1800404480616320:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 109us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.432935:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9833 00000100:00100000:3.0:1716999785.434749:0:10150:0:(client.c:2952:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970121 gen 2 00000004:00080000:3.0:1716999785.434754:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012baf8a80, transno 4294970090 00000004:00080000:3.0:1716999785.434771:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012baf9180, transno 4294970091 00000004:00080000:3.0:1716999785.434773:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012baf8000, transno 4294970092 00000004:00080000:3.0:1716999785.434775:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012baf8380, transno 4294970093 00000004:00080000:3.0:1716999785.434776:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012baf8e00, transno 4294970094 00000004:00080000:3.0:1716999785.434778:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012baf9500, transno 4294970095 00000004:00080000:3.0:1716999785.434779:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012baf9880, transno 4294970096 00000004:00080000:3.0:1716999785.434781:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012baf8700, transno 4294970097 00000004:00080000:3.0:1716999785.434782:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099581180, transno 4294970098 00000004:00080000:3.0:1716999785.434784:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099580e00, transno 4294970099 00000004:00080000:3.0:1716999785.434786:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e443100, transno 4294970100 00000004:00080000:3.0:1716999785.434787:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e440000, transno 4294970101 00000004:00080000:3.0:1716999785.434789:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099444000, transno 4294970102 00000004:00080000:3.0:1716999785.434791:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e442d80, transno 4294970103 00000004:00080000:3.0:1716999785.434792:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ffb1880, transno 4294970104 00000004:00080000:3.0:1716999785.434794:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131c45f80, transno 4294970105 00000004:00080000:3.0:1716999785.434796:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131c45880, transno 4294970106 00000004:00080000:3.0:1716999785.434797:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131c45c00, transno 4294970107 00000004:00080000:3.0:1716999785.434799:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131c46300, transno 4294970108 00000004:00080000:3.0:1716999785.434800:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb8b100, transno 4294970109 00000004:00080000:3.0:1716999785.434802:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091107800, transno 4294970110 00000004:00080000:3.0:1716999785.434804:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ffb1f80, transno 4294970111 00000004:00080000:3.0:1716999785.434805:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131caa680, transno 4294970112 00000004:00080000:3.0:1716999785.434807:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131cab100, transno 4294970113 00000004:00080000:3.0:1716999785.434809:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ca9500, transno 4294970114 00000004:00080000:3.0:1716999785.434811:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb8a300, transno 4294970115 00000004:00080000:3.0:1716999785.434813:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131caad80, transno 4294970116 00000004:00080000:3.0:1716999785.434814:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ffb1500, transno 4294970117 00000004:00080000:3.0:1716999785.434817:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880090681180, transno 4294970118 00000004:00080000:3.0:1716999785.434819:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb89500, transno 4294970119 00000004:00080000:3.0:1716999785.434820:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ca8380, transno 4294970120 00000004:00080000:3.0:1716999785.434822:0:10150:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb89180, transno 4294970121 00000100:00100000:3.0:1716999785.434827:0:10150:0:(client.c:2996:ptlrpc_free_committed()) @@@ stopping search req@ffff88009c2c7480 x1800404483005120/t4294970135(4294970135) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1716999801 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 00000100:00100000:3.0:1716999785.434851:0:10150:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009c2c7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10150:1800404483005120:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1716999785.434861:0:10150:0:(osp_precreate.c:724:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x5f2:0x0]-[0x280000400:0x621:0x0] 00000100:00100000:3.0:1716999785.436154:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480616448 00000100:00100000:3.0:1716999785.436158:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480616448 00000100:00100000:3.0:1716999785.436174:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480616576 00000100:00100000:3.0:1716999785.436176:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480616576 00000100:00100000:3.0:1716999785.436266:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8960 00000100:00100000:3.0:1716999785.436272:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+567:11419:x1800404480616448:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999785.437763:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480616640 00000100:00100000:3.0:1716999785.437766:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480616640 00000100:00100000:3.0:1716999785.437786:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44864 00000100:00100000:3.0:1716999785.437790:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+570:11521:x1800404480616640:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.437805:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xbe4:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999785.437863:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xbe4:0x0]: rc = -2 00000100:00100000:3.0:1716999785.437910:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+570:11521:x1800404480616640:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (227us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999785.437916:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44864 00000100:00100000:3.0:1716999785.440425:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480616768 00000100:00100000:3.0:1716999785.440431:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480616768 00000100:00100000:3.0:1716999785.440451:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480616832 00000100:00100000:3.0:1716999785.440453:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480616832 00000100:00100000:3.0:1716999785.440465:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44865 00000100:00100000:3.0:1716999785.440471:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480616768:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999785.440510:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999785.440527:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc2e22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc1b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64cf1 expref: 569 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.440541:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1b:0x0].0x0 (ffff8800990ead00) 00010000:00010000:3.0:1716999785.440549:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999785.440568:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc2e3e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.440578:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc2e3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.440585:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc2e3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.440594:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc2e45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe0adadf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.440599:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc2e45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.440603:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc2e45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.440676:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc2e4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc1b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.440682:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc2e4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.440688:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc2e4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:3.0:1716999785.441115:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1469, 64 off102272 00000040:00080000:3.0:1716999785.441133:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11306, 184 off2021920 00010000:00010000:3.0:1716999785.441183:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc2e68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc1b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441190:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc2e68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441196:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc2e68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441201:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc2e68 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441205:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc2e68 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441209:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc2e68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441214:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc2e68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441218:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999785.441220:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc2e68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441224:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc2e68 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441230:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1b:0x0].0x0 (ffff880088977000) 00010000:00010000:3.0:1716999785.441232:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999785.441235:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc2e68 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441239:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc2e68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc1b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441255:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc2e4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441259:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc2e4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441263:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc2e4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441266:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.441269:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc2e4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441272:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc2e4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441277:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1b:0x0].0x0 (ffff880088977000) 00010000:00010000:3.0:1716999785.441279:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999785.441281:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc2e4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441285:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc2e4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc1b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441315:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc2e3e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441319:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc2e3e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441324:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc2e3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441327:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.441329:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc2e3e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441333:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc2e3e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441337:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999785.441339:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.441341:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc2e3e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.441345:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc2e3e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999785.441350:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df3800 reply state ffff880136336000 transno 4294985742 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc2e45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999785.441355:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999785.441380:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480616768:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 909us (1112us total) trans 4294985742 rc 0/0 00000100:00100000:3.0:1716999785.441386:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44865 00000100:00100000:3.0:1716999785.443611:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480616960 00000100:00100000:3.0:1716999785.443616:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480616960 00000100:00100000:3.0:1716999785.443646:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44868 00000100:00100000:3.0:1716999785.443652:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+568:11521:x1800404480616960:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.443670:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.443749:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+568:11521:x1800404480616960:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 97us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.443755:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44868 00000100:00100000:3.0:1716999785.443764:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480617024 00000100:00100000:3.0:1716999785.443765:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480617024 00000100:00100000:3.0:1716999785.443774:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44869 00000100:00100000:3.0:1716999785.443778:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480617024:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999785.443795:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999785.443808:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc2e6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64d0d expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.444125:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc2e92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444132:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc2e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444137:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc2e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444146:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc2e99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444150:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444155:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444195:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc2ea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444201:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc2ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444206:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc2ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:3.0:1716999785.444220:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc19:0x0]: returning size 83190 00000004:00200000:3.0:1716999785.444223:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999785.444236:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc2ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc19:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444241:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc2ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444246:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc2e92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444250:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc2e92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444254:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc2e92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444258:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.444260:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc2e92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444264:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc2e92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444270:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999785.444271:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.444273:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc2e92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444277:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc2e92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444284:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444288:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc2e99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444292:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc2e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444295:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.444297:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc2e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444301:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc2e99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444306:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xa4b2186b (ffff880088977800) 00010000:00010000:3.0:1716999785.444308:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.444310:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc2e99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444314:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc2e99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999785.444330:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc2e6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d0d expref: 569 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.444338:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc2ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc19:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d0d expref: 568 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.444342:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc19:0x0].0x0 (ffff88009208b000) 00010000:00010000:3.0:1716999785.444344:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999785.444345:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94900, rc 0) 00000100:00100000:3.0:1716999785.444364:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+568:11420:x1800404480617024:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 585us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.444368:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44869 00000100:00100000:3.0:1716999785.446291:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480617216 00000100:00100000:3.0:1716999785.446297:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480617216 00000100:00100000:3.0:1716999785.446327:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44870 00000100:00100000:3.0:1716999785.446332:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+568:11521:x1800404480617216:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.446349:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xbe5:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999785.446396:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xbe5:0x0]: rc = -2 00000100:00100000:3.0:1716999785.446431:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+568:11521:x1800404480617216:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (554us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999785.446437:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44870 00000100:00100000:3.0:1716999785.452344:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8963 00000100:00100000:3.0:1716999785.452348:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ffb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+572:11420:x1800404480617728:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999785.455724:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ffb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480617728:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3374us (3466us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.455734:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8963 00000100:00100000:3.0:1716999785.464859:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483005184 00000100:00100000:3.0:1716999785.464863:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483005184 00000100:00100000:3.0:1716999785.464913:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9834 00000100:00100000:3.0:1716999785.464917:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8677:x1800404483005184:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1716999785.464944:0:8341:0:(ofd_dev.c:1660:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 1538 00000100:00100000:3.0:1716999785.471211:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8677:x1800404483005184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6288us (6492us total) trans 4294970098 rc 0/0 00000100:00100000:3.0:1716999785.471224:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9834 00000100:00100000:3.0:1716999785.471595:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480618880 00000100:00100000:3.0:1716999785.471599:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480618880 00000100:00100000:3.0:1716999785.471618:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9835 00000100:00100000:3.0:1716999785.471622:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+69:1959:x1800404480618880:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999785.471630:0:8341:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999785.471644:0:8341:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc2f79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64d5a expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999785.471660:0:8341:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999785.471670:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999785.471672:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999785.471677:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc2f79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d5a expref: 70 pid: 8341 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999785.471688:0:8341:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc2f79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d5a expref: 70 pid: 8341 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999785.471696:0:8341:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c958c0, rc 0) 00000100:00100000:3.0:1716999785.471714:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+70:1959:x1800404480618880:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.471719:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9835 00000100:00100000:3.0:1716999785.471731:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480618944 00000100:00100000:3.0:1716999785.471865:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480618944 00000100:00100000:3.0:1716999785.471920:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8964 00000100:00100000:3.0:1716999785.471925:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eea8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11420:x1800404480618944:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999785.473664:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480619072 00000100:00100000:3.0:1716999785.473669:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480619072 00000100:00100000:3.0:1716999785.473689:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9836 00000100:00100000:3.0:1716999785.473695:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+70:11419:x1800404480619072:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999785.473705:0:8341:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999785.473717:0:8341:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c95200/0x6d188eabd8dc2f80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64d61 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.473735:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc2f79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d5a expref: 71 pid: 8341 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999785.473741:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999785.473743:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999785.473745:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c95200/0x6d188eabd8dc2f80 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d61 expref: 71 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.473769:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc2f79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d5a expref: 71 pid: 8341 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999785.473779:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc2f79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d5a expref: 71 pid: 8341 timeout: 404 lvb_type: 1 00000100:00100000:3.0:1716999785.473790:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2c4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483005248:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999785.473823:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008eaab180 going to sleep for 11 seconds 00000100:00100000:3.0:1716999785.475340:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.477338:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.477396:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.483540:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44896 00000100:00100000:3.0:1716999785.483545:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+575:11521:x1800404480619712:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000100:00100000:3.0:1716999785.483579:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.483591:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480619840 00000100:00100000:3.0:1716999785.483594:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480619840 00000100:00100000:3.0:1716999785.483609:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44897 00000100:00100000:3.0:1716999785.483612:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480619840:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999785.483619:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999785.483626:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc2faa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64d76 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.483669:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c946c0/0x6d188eabd8dc2fb8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.483674:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c946c0/0x6d188eabd8dc2fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc1c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.483679:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c946c0/0x6d188eabd8dc2fb8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc1c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00200000:3.0:1716999785.483686:0:16641:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc1c:0x0]: returning size 85026 00010000:00010000:3.0:1716999785.483755:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc2faa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d76 expref: 580 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.484057:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c946c0/0x6d188eabd8dc2fb8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc1c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d76 expref: 577 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.484063:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1c:0x0].0x0 (ffff8800990eac00) 00010000:00010000:3.0:1716999785.484065:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1716999785.484067:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c946c0, rc 0) 00000100:00100000:3.0:1716999785.484095:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480619840:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 481us (514us total) trans 4294985749 rc 0/0 00000100:00100000:3.0:1716999785.484100:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44897 00000004:00000080:3.0:1716999785.484269:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.484349:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+576:11521:x1800404480619712:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 802us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.484355:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44896 00000100:00100000:3.0:1716999785.485897:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480620032 00000100:00100000:3.0:1716999785.485901:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480620032 00000100:00100000:3.0:1716999785.485922:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44899 00000100:00100000:3.0:1716999785.485926:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+577:11521:x1800404480620032:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.485951:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.486024:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+577:11521:x1800404480620032:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 97us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.486030:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44899 00000100:00100000:3.0:1716999785.491862:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.495456:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.495504:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.495518:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480620672 00000100:00100000:3.0:1716999785.495522:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480620672 00000100:00100000:3.0:1716999785.495541:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44905 00000100:00100000:3.0:1716999785.495547:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+578:11521:x1800404480620672:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.495562:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.495640:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+578:11521:x1800404480620672:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 93us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.495649:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44905 00000100:00100000:3.0:1716999785.498533:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480620736 00000100:00100000:3.0:1716999785.498539:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480620736 00000100:00100000:3.0:1716999785.498563:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44906 00000100:00100000:3.0:1716999785.498569:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+578:11521:x1800404480620736:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.498589:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.498671:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+578:11521:x1800404480620736:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.498677:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44906 00000100:00100000:3.0:1716999785.503599:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.507071:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.513690:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.513746:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.513764:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480621248 00000100:00100000:3.0:1716999785.513769:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480621248 00000100:00100000:3.0:1716999785.514155:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44911 00000100:00100000:3.0:1716999785.514162:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+582:11521:x1800404480621248:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.514179:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.514264:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+582:11521:x1800404480621248:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.514270:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44911 00000100:00100000:3.0:1716999785.518040:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.518061:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480621376 00000100:00100000:3.0:1716999785.518066:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480621376 00000100:00100000:3.0:1716999785.518510:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44912 00000100:00100000:3.0:1716999785.518517:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+582:11521:x1800404480621376:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.518541:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xbef:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999785.518605:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xbef:0x0]: rc = -2 00000100:00100000:3.0:1716999785.518638:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+582:11521:x1800404480621376:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 121us (602us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999785.518644:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44912 00000001:00080000:3.0:1716999785.523586:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985743 is committed 00000001:00080000:3.0:1716999785.523603:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985745 is committed 00000001:00080000:3.0:1716999785.523614:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985750 is committed 00000100:00100000:3.0:1716999785.525721:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44914 00000100:00100000:3.0:1716999785.525726:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11420:x1800404480621504:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:3.0:1716999785.525782:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11420:x1800404480621504:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 55us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.525788:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44914 00000100:00100000:3.0:1716999785.526078:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.573595:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.573653:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480622592 00000100:00100000:3.0:1716999785.573658:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480622592 00000100:00100000:3.0:1716999785.573686:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44929 00000100:00100000:3.0:1716999785.573691:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480622592:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.573711:0:16641:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.574035:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480622592:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 343us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.574042:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44929 00000100:00100000:3.0:1716999785.593710:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.599159:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.601946:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.602025:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.635650:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.638997:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480624192 00000100:00100000:3.0:1716999785.639004:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480624192 00000100:00100000:3.0:1716999785.639030:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44950 00000100:00100000:3.0:1716999785.639035:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480624192:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.639066:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.639158:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480624192:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 122us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.639187:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44950 00000001:00080000:3.0:1716999785.640844:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970137 is committed 00000100:00100000:3.0:1716999785.641164:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480624256 00000100:00100000:3.0:1716999785.641168:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480624256 00000100:00100000:3.0:1716999785.641193:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44951 00000100:00100000:3.0:1716999785.641198:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480624256:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.641213:0:16641:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.641269:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480624256:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 70us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.641274:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44951 00000100:00100000:3.0:1716999785.646153:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480624320 00000100:00100000:3.0:1716999785.646156:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480624320 00000100:00100000:3.0:1716999785.646178:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44952 00000100:00100000:3.0:1716999785.646183:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480624320:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.646203:0:16641:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xbfc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999785.646263:0:16641:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xbfc:0x0]: rc = -2 00000100:00100000:3.0:1716999785.646296:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480624320:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 112us (194us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999785.646301:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44952 00000100:00100000:3.0:1716999785.648060:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480624512 00000100:00100000:3.0:1716999785.648065:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480624512 00000100:00100000:3.0:1716999785.648095:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44953 00000100:00100000:3.0:1716999785.648101:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a68f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480624512:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.648116:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.648194:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a68f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480624512:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 93us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.648200:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44953 00000100:00100000:3.0:1716999785.651392:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480624576 00000100:00100000:3.0:1716999785.651399:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480624576 00000100:00100000:3.0:1716999785.651425:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44954 00000100:00100000:3.0:1716999785.651431:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a68f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480624576:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.651458:0:16641:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.651547:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a68f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480624576:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 116us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.651554:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44954 00000100:00100000:3.0:1716999785.659517:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480624832 00000100:00100000:3.0:1716999785.659522:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480624832 00000100:00100000:3.0:1716999785.659545:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44956 00000100:00100000:3.0:1716999785.659550:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a68f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480624832:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.659567:0:16641:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.659657:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a68f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480624832:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.659666:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44956 00000100:00100000:3.0:1716999785.669776:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.684583:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480625216 00000100:00100000:3.0:1716999785.684589:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480625216 00000100:00100000:3.0:1716999785.684615:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44962 00000100:00100000:3.0:1716999785.684620:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480625216:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.684642:0:16641:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.684737:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480625216:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.684743:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44962 00000100:00100000:3.0:1716999785.688046:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480625280 00000100:00100000:3.0:1716999785.688053:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480625280 00000100:00100000:3.0:1716999785.688088:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44963 00000100:00100000:3.0:1716999785.688096:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480625280:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.688119:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.688292:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480625280:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 196us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.688298:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44963 00000100:00100000:3.0:1716999785.692781:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.699563:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.705741:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.716940:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.724152:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480626048 00000100:00100000:3.0:1716999785.724160:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480626048 00002000:00100000:3.0:1716999785.724193:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x5f2:0x0] (0->4095) req@ffff8800a6049180 x1800404480626048/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:691/0 lens 4584/0 e 0 to 0 dl 1716999796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999785.724208:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6049180 with x1800404480626048 ext(0->4095) 00002000:00010000:3.0:1716999785.724213:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6049180 00000100:00100000:3.0:1716999785.724228:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1415 00000100:00100000:3.0:1716999785.724235:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6049180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+68:1959:x1800404480626048:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:3.0:1716999785.724547:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6049180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+70:1959:x1800404480626048:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 310us (1809us total) trans 4294970102 rc 0/0 00000100:00100000:3.0:1716999785.724553:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1415 00002000:00100000:3.0:1716999785.724560:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x5f2:0x0] (0->4095) req@ffff8800a6049180 x1800404480626048/t4294970102(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:691/0 lens 4584/448 e 0 to 0 dl 1716999796 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999785.724566:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a6049180 with x1800404480626048 ext(0->4095) 00002000:00010000:3.0:1716999785.724569:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a6049180 00000100:00100000:3.0:1716999785.726499:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.729664:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.730448:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.730464:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480626240 00000100:00100000:3.0:1716999785.730467:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480626240 00000100:00100000:3.0:1716999785.730485:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44974 00000100:00100000:3.0:1716999785.730490:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626240:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.730514:0:16641:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.730615:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626240:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 123us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.730621:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44974 00000100:00100000:3.0:1716999785.735821:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.735865:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480626304 00000100:00100000:3.0:1716999785.735872:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480626304 00000100:00100000:3.0:1716999785.735915:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44975 00000100:00100000:3.0:1716999785.735921:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626304:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.735942:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.736039:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626304:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.736046:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44975 00000100:00100000:3.0:1716999785.742845:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.742959:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480626432 00000100:00100000:3.0:1716999785.742966:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480626432 00000100:00100000:3.0:1716999785.742995:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44977 00000100:00100000:3.0:1716999785.743001:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626432:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.743024:0:16641:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.743114:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626432:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 112us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.743119:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44977 00000100:00100000:3.0:1716999785.748709:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480626496 00000100:00100000:3.0:1716999785.748717:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480626496 00000100:00100000:3.0:1716999785.748762:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44978 00000100:00100000:3.0:1716999785.748768:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626496:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.748791:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.749062:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626496:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 292us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.749069:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44978 00000100:00100000:3.0:1716999785.754898:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.754920:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480626624 00000100:00100000:3.0:1716999785.754927:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480626624 00000100:00100000:3.0:1716999785.754953:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44980 00000100:00100000:3.0:1716999785.754959:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626624:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.755009:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.755113:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626624:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 153us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.755119:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44980 00000100:00100000:3.0:1716999785.757246:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.757263:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480626688 00000100:00100000:3.0:1716999785.757268:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480626688 00000100:00100000:3.0:1716999785.757301:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44981 00000100:00100000:3.0:1716999785.757306:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626688:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.757429:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.757508:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626688:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 201us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.757514:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44981 00000100:00100000:3.0:1716999785.760447:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.768034:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.768054:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480626880 00000100:00100000:3.0:1716999785.768060:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480626880 00000100:00100000:3.0:1716999785.768083:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44984 00000100:00100000:3.0:1716999785.768089:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626880:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.768107:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999785.768184:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626880:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 94us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.768189:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44984 00000100:00100000:3.0:1716999785.771216:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480626944 00000100:00100000:3.0:1716999785.771222:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480626944 00000100:00100000:3.0:1716999785.771244:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44985 00000100:00100000:3.0:1716999785.771249:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626944:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999785.771267:0:16641:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc07:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999785.771321:0:16641:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc07:0x0]: rc = -2 00000100:00100000:3.0:1716999785.771339:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+553:11521:x1800404480626944:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 90us (897us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999785.771344:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44985 00000100:00100000:3.0:1716999785.777784:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.777810:0:8347:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480627072 00000100:00100000:3.0:1716999785.777817:0:8347:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480627072 00002000:00100000:3.0:1716999785.777860:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5f3:0x0] (0->4095) req@ffff88008af53100 x1800404480627072/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:691/0 lens 4584/0 e 0 to 0 dl 1716999796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999785.777870:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008af53100 with x1800404480627072 ext(0->4095) 00002000:00010000:3.0:1716999785.777875:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008af53100 00000100:00100000:3.0:1716999785.777912:0:8347:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1416 00000100:00100000:3.0:1716999785.777918:0:8347:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+67:1959:x1800404480627072:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:3.0:1716999785.778373:0:8347:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+69:1959:x1800404480627072:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 454us (592us total) trans 4294970140 rc 0/0 00000100:00100000:3.0:1716999785.778380:0:8347:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1416 00002000:00100000:3.0:1716999785.778385:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5f3:0x0] (0->4095) req@ffff88008af53100 x1800404480627072/t4294970140(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:691/0 lens 4584/448 e 0 to 0 dl 1716999796 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999785.778393:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008af53100 with x1800404480627072 ext(0->4095) 00002000:00010000:3.0:1716999785.778396:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008af53100 00000100:00100000:3.0:1716999785.784749:0:8347:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480627328 00000100:00100000:3.0:1716999785.784754:0:8347:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480627328 00002000:00100000:3.0:1716999785.784772:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5f2:0x0] (0->4095) req@ffff8800a68f4e00 x1800404480627328/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:691/0 lens 4584/0 e 0 to 0 dl 1716999796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999785.784781:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a68f4e00 with x1800404480627328 ext(0->4095) 00002000:00010000:3.0:1716999785.784785:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a68f4e00 00000100:00100000:3.0:1716999785.784796:0:8347:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1417 00000100:00100000:3.0:1716999785.784801:0:8347:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+68:1956:x1800404480627328:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:3.0:1716999785.785199:0:8347:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a68f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+70:1956:x1800404480627328:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 397us (485us total) trans 4294970103 rc 0/0 00000100:00100000:3.0:1716999785.785205:0:8347:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1417 00002000:00100000:3.0:1716999785.785213:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5f2:0x0] (0->4095) req@ffff8800a68f4e00 x1800404480627328/t4294970103(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:691/0 lens 4584/448 e 0 to 0 dl 1716999796 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999785.785220:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a68f4e00 with x1800404480627328 ext(0->4095) 00002000:00010000:3.0:1716999785.785223:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a68f4e00 00000100:00100000:3.0:1716999785.787585:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.787790:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.839991:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480627968 00000100:00100000:3.0:1716999785.840000:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480627968 00000100:00100000:3.0:1716999785.840036:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9849 00000100:00100000:3.0:1716999785.840043:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a604b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+67:1958:x1800404480627968:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:3.0:1716999785.840229:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5f3:0x0] updating lvb size from disk: 0 -> 85026 00002000:00010000:3.0:1716999785.840232:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5f3:0x0] updating lvb mtime from disk: 0 -> 1716999774 00002000:00010000:3.0:1716999785.840234:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5f3:0x0] updating lvb atime from disk: 0 -> 1716999776 00002000:00010000:3.0:1716999785.840236:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5f3:0x0] updating lvb ctime from disk: 0 -> 1716999786 00002000:00010000:3.0:1716999785.840238:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5f3:0x0] updating lvb blocks from disk: 1 -> 259 00000100:00100000:3.0:1716999785.840284:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a604b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+68:1958:x1800404480627968:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 240us (1782us total) trans 4294970141 rc 0/0 00000100:00100000:3.0:1716999785.840290:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9849 00000100:00100000:3.0:1716999785.844273:0:8347:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480628160 00000100:00100000:3.0:1716999785.844280:0:8347:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480628160 00002000:00100000:3.0:1716999785.844311:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5f3:0x0] (0->4095) req@ffff8800a604b800 x1800404480628160/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:691/0 lens 4584/0 e 0 to 0 dl 1716999796 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999785.844320:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a604b800 with x1800404480628160 ext(0->4095) 00002000:00010000:3.0:1716999785.844324:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a604b800 00000100:00100000:3.0:1716999785.848407:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44997 00000100:00100000:3.0:1716999785.848415:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a604bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+555:11420:x1800404480628224:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:3.0:1716999785.848508:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a604bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+554:11420:x1800404480628224:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.848514:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44997 00000100:00100000:3.0:1716999785.852392:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480628480 00000100:00100000:3.0:1716999785.852397:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480628480 00000100:00100000:3.0:1716999785.852858:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 44999 00000100:00100000:3.0:1716999785.852863:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+554:11419:x1800404480628480:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999785.852876:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999785.852905:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc3028 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64da0 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.852938:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc3028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64da0 expref: 555 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.852947:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc3028 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc1c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64da0 expref: 555 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.852958:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1c:0x0].0x0 (ffff8800990eac00) 00010000:00010000:3.0:1716999785.852960:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1716999785.852962:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c958c0, rc 0) 00000100:00100000:3.0:1716999785.852996:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+555:11419:x1800404480628480:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 133us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.853001:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 44999 00000100:00100000:3.0:1716999785.857717:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480628672 00000100:00100000:3.0:1716999785.857725:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480628672 00000100:00100000:3.0:1716999785.857754:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45000 00000100:00100000:3.0:1716999785.857760:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11419:x1800404480628672:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:3.0:1716999785.857799:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc302f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999785.857810:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc302f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999785.857819:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc302f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999785.857847:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc302f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999785.857852:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc302f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999785.857858:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc302f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999785.857862:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.857866:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc302f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999785.857871:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc302f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999785.857894:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1c:0x0].0x0 (ffff8800990eac00) 00010000:00010000:3.0:1716999785.857897:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999785.857900:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc302f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999785.857904:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc302f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999785.857960:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11419:x1800404480628672:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 200us (293us total) trans 0 rc -22/-22 00000100:00100000:3.0:1716999785.857966:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45000 00000100:00100000:3.0:1716999785.937267:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480629440 00000100:00100000:3.0:1716999785.937272:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480629440 00000100:00100000:3.0:1716999785.937290:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45006 00000100:00100000:3.0:1716999785.937295:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480629440:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:3.0:1716999785.937316:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc307c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.937324:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc307c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.937330:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc307c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.937341:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc307c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.937349:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc307c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.937354:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc307c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.937358:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.937360:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc307c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.937365:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc307c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.937372:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1d:0x0].0x0 (ffff8800923b8000) 00010000:00010000:3.0:1716999785.937374:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999785.937376:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc307c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.937380:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc307c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999785.937406:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480629440:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 110us (295us total) trans 0 rc -22/-22 00000100:00100000:3.0:1716999785.937411:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45006 00000100:00100000:3.0:1716999785.939252:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.939322:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.942331:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.942716:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.947817:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480629952 00000100:00100000:3.0:1716999785.947821:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480629952 00000100:00100000:3.0:1716999785.947850:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8967 00000100:00100000:3.0:1716999785.947855:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+561:11420:x1800404480629952:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999785.948190:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11313, 168 off2023240 00000001:00080000:3.0:1716999785.948195:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985758 00000100:00100000:3.0:1716999785.948241:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+562:11420:x1800404480629952:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 385us (633us total) trans 4294985759 rc 0/0 00000100:00100000:3.0:1716999785.948247:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8967 00000020:00080000:3.0:1716999785.948250:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999785.952215:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45012 00000100:00100000:3.0:1716999785.952221:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480630144:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999785.952238:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999785.952253:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc30de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64dca expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.952286:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc30e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952296:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc30e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952303:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc30e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952313:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc30ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952318:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc30ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952323:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc30ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952416:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3101 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952423:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952429:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00200000:3.0:1716999785.952449:0:16641:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc18:0x0]: returning size 83190 00000004:00200000:3.0:1716999785.952453:0:16641:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999785.952464:0:16641:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc18:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952471:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952477:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc30e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952481:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc30e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952487:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc30e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952491:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.952494:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc30e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952500:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc30e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952506:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999785.952509:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.952512:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc30e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952516:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc30e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952524:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc30ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952528:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc30ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952533:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc30ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952537:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.952539:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc30ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952543:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc30ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952548:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe0adadf (ffff88009208b500) 00010000:00010000:3.0:1716999785.952550:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.952552:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc30ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952556:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc30ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe0adadf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.952577:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc30de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64dca expref: 562 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.952589:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc18:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64dca expref: 561 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.952594:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc18:0x0].0x0 (ffff8800900d1c00) 00010000:00010000:3.0:1716999785.952596:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999785.952598:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94900, rc 0) 00000100:00100000:3.0:1716999785.952641:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+561:11419:x1800404480630144:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 419us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.952647:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45012 00000100:00100000:3.0:1716999785.956300:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480630272 00000100:00100000:3.0:1716999785.956404:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480630272 00000100:00100000:3.0:1716999785.956429:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8968 00000100:00100000:3.0:1716999785.956435:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+561:11419:x1800404480630272:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999785.956734:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11315, 168 off2023592 00000001:00080000:3.0:1716999785.956739:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985761 00000100:00100000:3.0:1716999785.956798:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480630272:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 362us (562us total) trans 4294985762 rc 0/0 00000100:00100000:3.0:1716999785.956804:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8968 00000020:00080000:3.0:1716999785.956808:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999785.966054:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480630720 00000100:00100000:3.0:1716999785.966061:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480630720 00000100:00100000:3.0:1716999785.966088:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45017 00000100:00100000:3.0:1716999785.966094:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+562:11419:x1800404480630720:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999785.966107:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999785.966144:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3163 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64de6 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.966169:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64de6 expref: 563 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.966179:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3163 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64de6 expref: 563 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.966186:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999785.966188:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.966191:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94b40, rc 0) 00000100:00100000:3.0:1716999785.966285:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480630720:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 190us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.966290:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45017 00000100:00100000:3.0:1716999785.968082:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480630848 00000100:00100000:3.0:1716999785.968088:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480630848 00000100:00100000:3.0:1716999785.968123:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45018 00000100:00100000:3.0:1716999785.968129:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+563:11420:x1800404480630848:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999785.968159:0:16641:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999785.968174:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8db42de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6055b expref: 563 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.968186:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d9:0x0].0x0 (ffff8800b431dd00) 00010000:00010000:3.0:1716999785.968189:0:16641:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999785.968227:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc316a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.968236:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc316a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.968246:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc316a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00010000:3.0:1716999785.968484:0:16641:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012ea9e680 reply state ffff8800943be000 transno 4294985764 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc316a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:3.0:1716999785.968490:0:16641:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999785.968547:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+564:11420:x1800404480630848:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 417us (514us total) trans 4294985764 rc 0/0 00000100:00100000:3.0:1716999785.968553:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45018 00000100:00100000:3.0:1716999785.969976:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480630912 00000100:00100000:3.0:1716999785.969981:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480630912 00000100:00100000:3.0:1716999785.970004:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9855 00000100:00100000:3.0:1716999785.970009:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+69:1959:x1800404480630912:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:3.0:1716999785.970135:0:8341:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x357:0x0] updating lvb size from disk: 260096 -> 260096 00002000:00010000:3.0:1716999785.970138:0:8341:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x357:0x0] updating lvb mtime from disk: 1716999761 -> 1716999749 00002000:00010000:3.0:1716999785.970140:0:8341:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x357:0x0] updating lvb atime from disk: 1716999753 -> 1716999776 00002000:00010000:3.0:1716999785.970142:0:8341:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x357:0x0] updating lvb ctime from disk: 1716999773 -> 1716999786 00002000:00010000:3.0:1716999785.970144:0:8341:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x357:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1716999785.970168:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+70:1959:x1800404480630912:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 159us (238us total) trans 4294970107 rc 0/0 00000100:00100000:3.0:1716999785.970174:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9855 00000100:00100000:3.0:1716999785.972444:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480631040 00000100:00100000:3.0:1716999785.972449:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480631040 00000100:00100000:3.0:1716999785.972486:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45019 00000100:00100000:3.0:1716999785.972492:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+564:11420:x1800404480631040:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999785.972507:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999785.972519:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3171 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64ded expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.972558:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3178 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972568:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972576:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972585:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc317f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972590:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc317f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972595:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc317f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972724:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3186 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972732:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972738:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00200000:3.0:1716999785.972759:0:16641:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6d9:0x0]: returning size 260096 00000004:00200000:3.0:1716999785.972762:0:16641:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999785.972773:0:16641:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d9:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972781:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3186 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972787:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3178 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972792:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3178 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972797:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3178 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972802:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.972804:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3178 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972809:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3178 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972817:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999785.972819:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.972822:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3178 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972843:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3178 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972852:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc317f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972856:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc317f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972860:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc317f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972865:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.972867:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc317f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972871:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc317f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972877:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xe4a56594 (ffff88009208b500) 00010000:00010000:3.0:1716999785.972896:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.972898:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc317f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972903:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc317f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.972923:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3171 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ded expref: 565 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.972933:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3186 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ded expref: 564 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.972938:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d9:0x0].0x0 (ffff8800b431dd00) 00010000:00010000:3.0:1716999785.972940:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999785.972942:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96400, rc 0) 00000100:00100000:3.0:1716999785.972959:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+564:11420:x1800404480631040:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 467us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999785.972964:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45019 00000100:00100000:3.0:1716999785.977495:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480631168 00000100:00100000:3.0:1716999785.977502:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480631168 00000100:00100000:3.0:1716999785.977542:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45020 00000100:00100000:3.0:1716999785.977548:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+564:11420:x1800404480631168:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999785.977585:0:16641:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999785.977604:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3186 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ded expref: 564 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.977616:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d9:0x0].0x0 (ffff8800b431dd00) 00010000:00010000:3.0:1716999785.977619:0:16641:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999785.977646:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc318d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.977657:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc318d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.977664:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc318d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00010000:3.0:1716999785.978183:0:16641:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800995a0000 reply state ffff8800943b8000 transno 4294985765 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc318d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:3.0:1716999785.978189:0:16641:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999785.978315:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480631168:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 765us (868us total) trans 4294985765 rc 0/0 00000100:00100000:3.0:1716999785.978321:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45020 00000100:00100000:3.0:1716999785.979425:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480631296 00000100:00100000:3.0:1716999785.979431:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480631296 00000100:00100000:3.0:1716999785.979450:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45021 00000100:00100000:3.0:1716999785.979455:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480631296:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999785.979476:0:16641:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999785.979487:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9d40/0x6d188eabd8db42a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6054d expref: 564 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.979495:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d8:0x0].0x0 (ffff8800b431d100) 00010000:00010000:3.0:1716999785.979497:0:16641:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999785.979520:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3194 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.979526:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.979532:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00010000:3.0:1716999785.979680:0:16641:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800995a0a80 reply state ffff8800943b9000 transno 4294985766 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:3.0:1716999785.979685:0:16641:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999785.979716:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+565:11419:x1800404480631296:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 261us (470us total) trans 4294985766 rc 0/0 00000100:00100000:3.0:1716999785.979721:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45021 00000100:00100000:3.0:1716999785.981044:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480631360 00000100:00100000:3.0:1716999785.981048:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480631360 00000100:00100000:3.0:1716999785.981078:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9856 00000100:00100000:3.0:1716999785.981083:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+70:1958:x1800404480631360:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:3.0:1716999785.981194:0:8341:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x357:0x0] updating lvb size from disk: 260096 -> 260096 00002000:00010000:3.0:1716999785.981196:0:8341:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x357:0x0] updating lvb mtime from disk: 1716999749 -> 1716999774 00002000:00010000:3.0:1716999785.981198:0:8341:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x357:0x0] updating lvb atime from disk: 1716999776 -> 1716999766 00002000:00010000:3.0:1716999785.981200:0:8341:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x357:0x0] updating lvb ctime from disk: 1716999786 -> 1716999786 00002000:00010000:3.0:1716999785.981202:0:8341:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x357:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1716999785.981222:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+71:1958:x1800404480631360:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 138us (245us total) trans 4294970108 rc 0/0 00000100:00100000:3.0:1716999785.981228:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9856 00000100:00100000:3.0:1716999785.982753:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480631552 00000100:00100000:3.0:1716999785.982758:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480631552 00000100:00100000:3.0:1716999785.982776:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480631616 00000100:00100000:3.0:1716999785.982778:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480631616 00000100:00100000:3.0:1716999785.982789:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45022 00000100:00100000:3.0:1716999785.982793:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480631552:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:3.0:1716999785.982838:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc319b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.982849:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc319b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.982857:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc319b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.982872:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc319b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.982877:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc319b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.983087:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc319b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.983092:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.983095:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc319b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.983101:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc319b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.983112:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d9:0x0].0x0 (ffff8800b431dd00) 00010000:00010000:3.0:1716999785.983114:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999785.983116:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc319b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.983121:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc319b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000100:00100000:3.0:1716999785.983197:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+566:11420:x1800404480631552:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 402us (535us total) trans 0 rc -22/-22 00000100:00100000:3.0:1716999785.983203:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45022 00010000:00010000:1.0:1716999785.987505:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc31da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987516:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d8:0x0].0x0 (ffff8800b431d100) 00010000:00010000:1.0:1716999785.987518:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999785.987521:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc31da lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987525:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc31da lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987551:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc31e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987559:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc31e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987564:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc31e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987573:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc31ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987578:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc31ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987583:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc31ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987618:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc31e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987623:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc31e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987628:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc31e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987635:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999785.987637:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc31e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987642:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc31e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987648:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999785.987650:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999785.987652:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc31e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987657:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc31e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987664:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc31ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987668:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc31ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987672:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc31ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987676:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999785.987678:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc31ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987682:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc31ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987688:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff8800a5c6e500) 00010000:00010000:1.0:1716999785.987690:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999785.987692:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc31ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987696:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc31ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.987725:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc31e1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e02 expref: 567 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999785.987731:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc31e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e02 expref: 567 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999785.987738:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132640, rc 0) 00000100:00100000:1.0:1716999785.987766:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+566:11420:x1800404480631872:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 317us (591us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999785.987771:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45026 00000100:00100000:1.0:1716999785.987896:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480631936 00000100:00100000:1.0:1716999785.987899:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480631936 00000100:00100000:1.0:1716999785.987918:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9858 00000100:00100000:1.0:1716999785.987922:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+69:1957:x1800404480631936:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:1.0:1716999785.988018:0:15837:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb size from disk: 260096 -> 260096 00002000:00010000:1.0:1716999785.988021:0:15837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb mtime from disk: 1716999749 -> 1716999774 00002000:00010000:1.0:1716999785.988023:0:15837:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb atime from disk: 1716999776 -> 1716999766 00002000:00010000:1.0:1716999785.988025:0:15837:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb ctime from disk: 1716999786 -> 1716999786 00002000:00010000:1.0:1716999785.988026:0:15837:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x356:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1716999785.988046:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+70:1957:x1800404480631936:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 123us (219us total) trans 4294970145 rc 0/0 00000100:00100000:1.0:1716999785.988054:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9858 00000100:00100000:3.0:1716999785.989510:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480632000 00000100:00100000:3.0:1716999785.989515:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480632000 00000100:00100000:3.0:1716999785.989535:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480632128 00000100:00100000:3.0:1716999785.989537:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480632128 00000100:00100000:1.0:1716999785.989541:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45027 00000100:00100000:1.0:1716999785.989547:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480632000:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:3.0:1716999785.989551:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45028 00000100:00100000:3.0:1716999785.989556:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+567:11419:x1800404480632128:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:1.0:1716999785.989558:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999785.989569:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc31f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e09 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.989580:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc31fd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.989588:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc31fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.989595:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc31fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999785.989596:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3204 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989602:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3204 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999785.989607:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc31fd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999785.989609:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3204 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999785.989612:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc31fd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999785.989617:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc320b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999785.989620:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc31fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999785.989621:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc320b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999785.989624:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.989626:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc31fd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999785.989626:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc320b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999785.989631:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc31fd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.989637:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d8:0x0].0x0 (ffff8800b431d100) 00010000:00010000:3.0:1716999785.989639:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999785.989641:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc31fd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999785.989645:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc31fd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999785.989667:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3204 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989672:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3204 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989676:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3204 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989681:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999785.989683:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3204 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989688:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3204 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989694:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999785.989696:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999785.989699:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3204 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989703:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3204 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989760:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc320b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989765:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc320b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989769:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc320b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989773:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999785.989775:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc320b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989779:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc320b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989784:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff8800a5c6ea00) 00010000:00010000:1.0:1716999785.989786:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999785.989789:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc320b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989793:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc320b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.989818:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc31f6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e09 expref: 568 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999785.989839:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc31f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e09 expref: 568 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999785.989847:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130d80, rc 0) 00000100:00100000:1.0:1716999785.989876:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480632000:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 329us (466us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999785.989901:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45027 00000100:00100000:3.0:1716999785.989972:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+566:11419:x1800404480632128:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 414us (497us total) trans 0 rc -22/-22 00000100:00100000:3.0:1716999785.989978:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45028 00000100:00100000:1.0:1716999785.992649:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480632256 00000100:00100000:1.0:1716999785.992656:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480632256 00000100:00100000:1.0:1716999785.992677:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480632320 00000100:00100000:1.0:1716999785.992679:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480632320 00000100:00100000:1.0:1716999785.992692:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45029 00000100:00100000:1.0:1716999785.992698:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480632256:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999785.992710:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999785.992713:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999785.992730:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc3147 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64dd8 expref: 567 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999785.992744:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999785.992747:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999785.992756:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3212 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e10 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999785.992852:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3227 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.992859:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3227 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.992865:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3227 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.992874:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc3235 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.992895:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc3235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.992901:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc3235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:1.0:1716999785.993331:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f3:0x0], index 0: 0 00000040:00080000:1.0:1716999785.993384:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11317, 184 off2023960 00010000:00010000:1.0:1716999785.993453:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc3243 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.993460:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc3243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.993466:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc3243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.993482:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3227 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.993487:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3227 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.993491:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3227 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.993495:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999785.993498:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3227 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.993502:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3227 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.993508:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999785.993510:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999785.993513:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3227 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999785.993517:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3227 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999785.993524:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880090681c00 reply state ffff8800a6cdf000 transno 4294985768 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc3235 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999785.993529:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999785.993547:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3212 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e10 expref: 569 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999785.993558:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc3243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc1e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e10 expref: 568 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999785.993563:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1e:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:1.0:1716999785.993566:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999785.993568:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132880, rc 0) 00000100:00100000:1.0:1716999785.993603:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480632256:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 905us (1153us total) trans 4294985768 rc 0/0 00000100:00100000:1.0:1716999785.993608:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45029 00000100:00100000:1.0:1716999785.995630:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480632384 00000100:00100000:1.0:1716999785.995636:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480632384 00000100:00100000:1.0:1716999785.995676:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480632448 00000100:00100000:1.0:1716999785.995678:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480632448 00000100:00100000:1.0:1716999785.995693:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9859 00000100:00100000:1.0:1716999785.995698:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+71:1959:x1800404480632448:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999785.995708:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1716999785.995709:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45031 00000100:00100000:3.0:1716999785.995715:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480632384:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999785.995720:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc3251 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e25 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.995727:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1716999785.995737:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1716999785.995748:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999785.995749:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999785.995755:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc3251 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e25 expref: 72 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999785.995765:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc3251 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e25 expref: 72 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999785.995772:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130b40, rc 0) 00010000:00010000:3.0:1716999785.995790:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3258 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e1e expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999785.995796:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480632448:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 99us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999785.995801:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9859 00010000:00010000:3.0:1716999785.995824:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc325f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995847:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc325f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995853:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc325f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995863:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3266 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995868:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995873:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995941:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc325f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995947:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc325f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995951:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc325f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995955:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.995957:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc325f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995962:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc325f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995968:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999785.995970:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.995974:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc325f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995978:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc325f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995986:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3266 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995990:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3266 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995995:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.995998:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.996000:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3266 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.996004:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3266 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.996009:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009208b800) 00010000:00010000:3.0:1716999785.996011:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.996013:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3266 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.996017:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3266 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.996040:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3258 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e1e expref: 569 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.996047:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3258 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e1e expref: 569 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.996053:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96400, rc 0) 00000100:00100000:3.0:1716999785.996073:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+568:11419:x1800404480632384:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 357us (489us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999785.996078:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45031 00000100:00100000:1.0:1716999785.998103:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999785.998583:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480632640 00000100:00100000:3.0:1716999785.998587:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480632640 00000100:00100000:3.0:1716999785.998723:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45032 00000100:00100000:3.0:1716999785.998729:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480632640:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999785.998738:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999785.998749:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc326d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e2c expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.998781:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3274 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.998790:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.998797:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.998806:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc327b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.998811:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc327b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.998816:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc327b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.998867:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3274 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.998873:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3274 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999085:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999091:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.999094:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3274 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999100:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3274 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999109:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999785.999111:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.999114:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3274 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999119:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3274 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999127:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc327b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999132:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc327b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999136:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc327b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999143:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999785.999145:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc327b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999150:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc327b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999155:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009208b000) 00010000:00010000:3.0:1716999785.999157:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999785.999158:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc327b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999162:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc327b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999785.999191:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc326d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e2c expref: 571 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.999197:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc326d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e2c expref: 571 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999785.999204:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95f80, rc 0) 00000100:00100000:3.0:1716999785.999285:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480632640:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 556us (1182us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999785.999291:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45032 00000100:00100000:3.0:1716999786.000378:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480632768 00000100:00100000:3.0:1716999786.000382:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480632768 00000100:00100000:3.0:1716999786.000792:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45033 00000100:00100000:3.0:1716999786.000798:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480632768:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999786.000835:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999786.000847:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc3243 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc1e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e10 expref: 570 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.000859:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1e:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:3.0:1716999786.000865:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999786.000900:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3282 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.000909:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3282 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.000914:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3282 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.000922:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3289 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.000927:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3289 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.000931:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3289 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.000988:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3290 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.000993:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3290 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.000997:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3290 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999786.001350:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1468, 64 off102208 00000100:00100000:1.0:1716999786.001355:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000040:00080000:3.0:1716999786.001367:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11319, 184 off2024312 00010000:00010000:3.0:1716999786.001413:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3297 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001418:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3297 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001423:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3297 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001428:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3297 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001432:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3297 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001435:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3297 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001439:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3297 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001442:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999786.001445:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3297 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001449:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3297 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001454:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1e:0x0].0x0 (ffff88009208ba00) 00010000:00010000:3.0:1716999786.001456:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999786.001458:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3297 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001461:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3297 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc1e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001476:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3290 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001480:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3290 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001483:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3290 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001487:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.001488:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3290 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001492:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3290 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001496:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1e:0x0].0x0 (ffff88009208ba00) 00010000:00010000:3.0:1716999786.001497:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999786.001499:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3290 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001502:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3290 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001531:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3282 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001535:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3282 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001539:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3282 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001542:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.001544:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3282 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001547:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3282 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001552:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999786.001554:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.001556:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3282 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.001559:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3282 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999786.001565:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880090682d80 reply state ffff88012e8a7000 transno 4294985771 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3289 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999786.001570:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999786.001601:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+572:11420:x1800404480632768:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 803us (1350us total) trans 4294985771 rc 0/0 00000100:00100000:3.0:1716999786.001606:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45033 00000100:00100000:1.0:1716999786.004495:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999786.004650:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918e8000/0x6d188eabd8dc32d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e41 expref: 71 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999786.004663:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8000, rc 0) 00000100:00100000:2.0:1716999786.004680:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+71:1959:x1800404480633024:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 90us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.004685:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9860 00000100:00080000:1.0:1716999786.004778:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1716999756 00000100:00100000:2.0:1716999786.005627:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480633088 00000100:00100000:2.0:1716999786.005631:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480633088 00000100:00100000:2.0:1716999786.005660:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45036 00000100:00100000:2.0:1716999786.005665:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11420:x1800404480633088:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.005675:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.005683:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc32dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e48 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.005699:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc32dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e48 expref: 572 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.005708:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc32dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e48 expref: 572 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.005714:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999786.005716:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.005718:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8fc0, rc 0) 00000100:00100000:2.0:1716999786.005750:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+572:11420:x1800404480633088:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 84us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.005755:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45036 00000100:00100000:3.0:1716999786.007236:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480633216 00000100:00100000:3.0:1716999786.007242:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480633216 00000100:00100000:3.0:1716999786.007277:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8972 00000100:00100000:3.0:1716999786.007282:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+572:11419:x1800404480633216:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999786.007753:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11321, 168 off2024664 00000001:00080000:3.0:1716999786.007759:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985773 00000100:00100000:3.0:1716999786.007843:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480633216:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 559us (859us total) trans 4294985774 rc 0/0 00000100:00100000:3.0:1716999786.007850:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8972 00000020:00080000:3.0:1716999786.007854:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999786.010212:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.010336:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480633280 00000100:00100000:3.0:1716999786.010342:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480633280 00000100:00100000:3.0:1716999786.010374:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8973 00000100:00100000:3.0:1716999786.010379:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11420:x1800404480633280:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999786.012869:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480633408 00000100:00100000:2.0:1716999786.012875:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480633408 00000100:00100000:2.0:1716999786.013941:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45037 00000100:00100000:2.0:1716999786.013948:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480633408:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999786.013986:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999786.014004:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc32b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc1f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e33 expref: 575 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.014020:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1f:0x0].0x0 (ffff880135ac4300) 00010000:00010000:2.0:1716999786.014027:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999786.014048:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc32e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014058:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc32e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014065:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc32e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014075:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc32eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014080:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc32eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014085:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc32eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014165:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc32f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc1f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014170:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc32f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014178:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc32f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:2.0:1716999786.014534:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1471, 64 off102400 00000040:00080000:2.0:1716999786.014551:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11322, 184 off2024848 00010000:00010000:2.0:1716999786.014597:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc32f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc1f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014603:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc32f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014609:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc32f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014614:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc32f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014619:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc32f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014624:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc32f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014628:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc32f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014633:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9b00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999786.014636:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc32f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014641:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc32f9 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014647:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1f:0x0].0x0 (ffff88009330d200) 00010000:00010000:2.0:1716999786.014650:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999786.014652:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc32f9 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014656:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc32f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc1f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014673:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc32f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014677:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc32f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014681:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc32f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014684:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.014686:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc32f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014689:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc32f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014694:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1f:0x0].0x0 (ffff88009330d200) 00010000:00010000:2.0:1716999786.014696:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999786.014698:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc32f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014701:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc32f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc1f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014734:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc32e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014739:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc32e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014743:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc32e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014746:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.014748:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc32e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014752:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc32e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014757:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.014759:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.014761:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc32e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.014764:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc32e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999786.014770:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880129f4a680 reply state ffff88008b77b000 transno 4294985775 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc32eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999786.014775:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999786.014855:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+576:11420:x1800404480633280:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4473us (4645us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.014863:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8973 00000100:00100000:2.0:1716999786.017960:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480633408:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 4004us (5195us total) trans 4294985775 rc 0/0 00000100:00100000:2.0:1716999786.017967:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45037 00000100:00100000:2.0:1716999786.018309:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.018486:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480633472 00000100:00100000:3.0:1716999786.018492:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480633472 00000100:00100000:3.0:1716999786.018518:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45038 00000100:00100000:3.0:1716999786.018523:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480633472:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.018535:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.018547:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3300 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e4f expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.018586:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc3307 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.018594:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc3307 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.018608:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc3307 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.018616:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc330e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.018624:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc330e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.018629:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc330e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.018865:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc3307 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.018871:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc3307 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.018875:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc3307 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019215:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.019218:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc3307 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019223:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc3307 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019231:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999786.019233:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.019236:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc3307 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019240:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc3307 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019250:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc330e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019254:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc330e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019258:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc330e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019265:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.019267:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc330e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019271:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc330e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019275:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009208b300) 00010000:00010000:3.0:1716999786.019277:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.019278:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc330e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019282:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc330e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019315:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3300 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e4f expref: 575 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999786.019316:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999786.019321:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3300 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e4f expref: 575 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.019326:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96640, rc 0) 00000100:00100000:3.0:1716999786.019370:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480633472:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 845us (1062us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.019375:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45038 00000100:00100000:3.0:1716999786.019387:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480633600 00000100:00100000:3.0:1716999786.019390:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480633600 00000100:00100000:3.0:1716999786.019412:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45039 00000100:00100000:3.0:1716999786.019416:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11420:x1800404480633600:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.019426:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.019432:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3315 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e56 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.019580:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc331c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019588:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc331c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019594:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc331c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019602:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019607:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019612:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019639:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc331c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019643:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc331c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019647:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc331c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019650:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.019652:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc331c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019657:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc331c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019663:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999786.019665:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.019667:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc331c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019671:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc331c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019678:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019682:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3323 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019686:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019689:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.019691:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019695:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3323 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.019700:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff88009208b500) 00010000:00010000:3.0:1716999786.019702:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.020009:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3323 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.020017:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3323 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.020038:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3315 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e56 expref: 575 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.020044:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3315 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e56 expref: 575 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.020049:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94fc0, rc 0) 00000100:00100000:3.0:1716999786.020079:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11420:x1800404480633600:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 661us (764us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.020084:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45039 00000100:00100000:1.0:1716999786.021390:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.021434:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480633728 00000100:00100000:3.0:1716999786.021440:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480633728 00000100:00100000:3.0:1716999786.021461:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45040 00000100:00100000:3.0:1716999786.021466:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11420:x1800404480633728:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.021476:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.021486:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc332a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e64 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.021516:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3331 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021524:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3331 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021531:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3331 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021539:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3338 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021544:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021549:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021592:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3331 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021597:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3331 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021602:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3331 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021606:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.021608:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3331 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021613:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3331 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021620:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999786.021622:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.021625:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3331 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021628:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3331 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021636:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3338 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021641:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3338 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021645:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021649:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.021651:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3338 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021655:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3338 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021660:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff88009208b900) 00010000:00010000:3.0:1716999786.021661:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.021663:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3338 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021666:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3338 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.021690:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc332a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e64 expref: 575 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.021696:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc332a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e64 expref: 575 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.021701:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95680, rc 0) 00000100:00100000:3.0:1716999786.021737:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11420:x1800404480633728:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 269us (349us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.021742:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45040 00000100:00100000:2.0:1716999786.021866:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.021916:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480633664 00000100:00100000:3.0:1716999786.021920:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480633664 00000100:00100000:3.0:1716999786.021943:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45041 00000100:00100000:3.0:1716999786.021947:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480633664:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.021953:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.021960:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc333f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e5d expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.021973:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc333f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e5d expref: 575 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.021980:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc333f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e5d expref: 575 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.021986:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999786.021988:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.021990:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c961c0, rc 0) 00000100:00100000:3.0:1716999786.022016:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480633664:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 68us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.022021:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45041 00000100:00100000:2.0:1716999786.023703:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480633856 00000100:00100000:2.0:1716999786.023707:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480633856 00000100:00100000:2.0:1716999786.023725:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45042 00000100:00100000:2.0:1716999786.023728:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+575:11420:x1800404480633856:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.023736:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.023738:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1716999786.023750:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc32dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e48 expref: 575 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.023762:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999786.023764:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999786.023769:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3346 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e6b expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999786.023787:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480633920 00000100:00100000:3.0:1716999786.023791:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480633920 00000100:00100000:3.0:1716999786.023814:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8974 00000100:00100000:3.0:1716999786.023818:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480633920:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:2.0:1716999786.023873:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc334d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.023898:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc334d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.023905:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc334d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.023913:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3354 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.023919:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.023924:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:2.0:1716999786.024297:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f4:0x0], index 0: 0 00000040:00080000:2.0:1716999786.024346:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11323, 184 off2025032 00010000:00010000:2.0:1716999786.024414:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc335b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.024421:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc335b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.024425:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc335b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.024440:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc334d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.024445:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc334d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.024449:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc334d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.024454:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.024457:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc334d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.024462:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc334d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.024469:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999786.024471:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.024473:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc334d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.024478:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc334d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999786.024485:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880129f48380 reply state ffff88008b77c000 transno 4294985776 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999786.024493:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999786.024508:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3346 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e6b expref: 579 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.024516:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc335b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e6b expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.024521:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:2.0:1716999786.024522:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999786.024524:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8b40, rc 0) 00000100:00100000:2.0:1716999786.024559:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480633856:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 829us (898us total) trans 4294985776 rc 0/0 00000100:00100000:2.0:1716999786.024564:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45042 00010000:00010000:2.0:1716999786.027298:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3354 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.027309:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3354 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.027315:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3354 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.027321:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.027324:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3354 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.027330:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3354 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.027342:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff88009330d100) 00010000:00010000:2.0:1716999786.027345:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.027348:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3354 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.027353:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3354 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999786.028196:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.028365:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480633984 00000100:00100000:3.0:1716999786.028371:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480633984 00000100:00080000:1.0:1716999786.028435:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1716999756 00000100:00100000:2.0:1716999786.028474:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480633920:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4653us (4776us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.028483:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8974 00000100:00100000:3.0:1716999786.028953:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9861 00000100:00100000:3.0:1716999786.028959:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480633984:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.028972:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.028988:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3369 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e72 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999786.029007:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999786.029019:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.029021:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.029026:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3369 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e72 expref: 73 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.029038:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3369 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e72 expref: 73 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.029047:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97cc0, rc 0) 00000100:00100000:3.0:1716999786.029067:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480633984:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 109us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.029072:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9861 00000100:00100000:1.0:1716999786.032048:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.032135:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.032319:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480634112 00000100:00100000:2.0:1716999786.032323:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480634112 00000100:00100000:2.0:1716999786.032349:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45043 00000100:00100000:2.0:1716999786.032353:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480634112:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.032363:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.032373:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc3377 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e79 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.032740:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc337e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032751:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc337e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032760:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc337e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032775:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032781:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032793:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032839:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc337e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032844:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc337e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032850:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc337e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032854:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.032857:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc337e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032862:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc337e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032871:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.032874:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.032877:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc337e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032908:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc337e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032916:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032920:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3385 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032924:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032929:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.032931:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032935:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3385 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032941:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009330db00) 00010000:00010000:2.0:1716999786.032942:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.032944:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3385 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032948:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3385 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.032968:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc3377 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e79 expref: 577 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.032973:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc3377 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e79 expref: 577 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.032979:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8fc0, rc 0) 00000100:00100000:2.0:1716999786.033011:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480634112:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 657us (969us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999786.033017:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45043 00000100:00100000:2.0:1716999786.037304:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480634304 00000100:00100000:1.0:1716999786.037310:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480634240 00000100:00100000:2.0:1716999786.037312:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480634304 00000100:00100000:1.0:1716999786.037313:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480634240 00010000:00010000:1.0:1716999786.037336:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3369 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e72 expref: 74 pid: 17864 timeout: 405 lvb_type: 1 00000100:00100000:2.0:1716999786.037359:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45044 00000100:00100000:2.0:1716999786.037366:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480634304:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.037379:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.037393:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc338c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e87 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.037440:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3393 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037450:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037459:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037468:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc339a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037473:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc339a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037478:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc339a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037532:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3393 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037537:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3393 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037542:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999786.037673:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4488 00000100:00100000:1.0:1716999786.037677:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480634240:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999786.037687:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999786.037704:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3369 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e72 expref: 74 pid: 17864 timeout: 405 lvb_type: 1 00010000:00010000:1.0:1716999786.037714:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3369 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e72 expref: 74 pid: 17864 timeout: 405 lvb_type: 1 00010000:00010000:2.0:1716999786.037715:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.037719:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3393 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037724:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3393 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.037727:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3369 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e72 expref: 74 pid: 17864 timeout: 405 lvb_type: 1 00010000:00010000:2.0:1716999786.037731:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.037734:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.037737:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3393 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037740:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3393 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037747:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc339a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037752:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc339a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037756:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc339a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.037756:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.037757:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999786.037760:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eba80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.037761:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc339a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.037762:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc3370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e80 expref: 73 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.037766:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc339a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.037769:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc3370 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e80 expref: 73 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.037771:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009330d700) 00010000:00010000:2.0:1716999786.037773:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.037775:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc339a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.037778:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc339a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.037796:0:15839:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc3370 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e80 expref: 73 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999786.037806:0:15839:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131c47800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:15839:1800404483005568:192.168.203.3@tcp:105: 00010000:00010000:2.0:1716999786.037808:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc338c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e87 expref: 577 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.037813:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc338c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e87 expref: 577 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.037819:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8480, rc 0) 00000100:00100000:2.0:1716999786.037866:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480634304:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 500us (670us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999786.037872:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45044 00000100:00100000:1.0:1716999786.037934:0:15839:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012bf5d840 going to sleep for 11 seconds 00000100:00100000:2.0:1716999786.040636:0:15839:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131c47800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:15839:1800404483005568:192.168.203.3@tcp:105: 00010000:00010000:2.0:1716999786.040652:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999786.040682:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480634240:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3003us (3433us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.040691:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4488 00000100:00100000:3.0:1716999786.040860:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480634432 00000100:00100000:3.0:1716999786.040866:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480634432 00000100:00100000:3.0:1716999786.040921:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45045 00000100:00100000:3.0:1716999786.040926:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480634432:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.040940:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.040942:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1716999786.040960:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc333f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e5d expref: 576 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.040974:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999786.040977:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999786.040987:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc33a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e8e expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.041081:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc33a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.041090:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc33a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.041097:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc33a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.041106:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc33af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.041111:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc33af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.041115:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc33af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:3.0:1716999786.041521:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f5:0x0], index 1: 0 00000040:00080000:3.0:1716999786.041577:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11324, 184 off2025216 00010000:00010000:3.0:1716999786.041659:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc33b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.041665:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc33b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.041678:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc33b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.041699:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc33a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.041704:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc33a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999786.042152:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.042214:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480634560 00000100:00100000:2.0:1716999786.042218:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480634560 00000100:00100000:2.0:1716999786.042250:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8975 00000100:00100000:2.0:1716999786.042255:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+578:11420:x1800404480634560:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:3.0:1716999786.042331:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc33a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.042336:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c973c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.042339:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc33a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.042345:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc33a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.042353:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999786.042356:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.042359:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc33a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.042363:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc33a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999786.042373:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880129f4a300 reply state ffff88012e8a3000 transno 4294985777 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc33af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999786.042379:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999786.042399:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc33a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e8e expref: 580 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.042410:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc33b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e8e expref: 579 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.042415:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff88009208be00) 00010000:00010000:3.0:1716999786.042417:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999786.042418:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96d00, rc 0) 00000100:00100000:3.0:1716999786.042455:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+580:11419:x1800404480634432:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1527us (1915us total) trans 4294985777 rc 0/0 00000100:00100000:3.0:1716999786.042460:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45045 00000040:00080000:2.0:1716999786.042488:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11325, 168 off2025384 00000001:00080000:2.0:1716999786.042493:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985778 00000100:00100000:2.0:1716999786.042544:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+580:11420:x1800404480634560:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 288us (392us total) trans 4294985779 rc 0/0 00000100:00100000:2.0:1716999786.042550:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8975 00000020:00080000:2.0:1716999786.042553:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999786.046595:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480634752 00000100:00100000:1.0:1716999786.046603:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480634752 00000100:00100000:1.0:1716999786.046653:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9863 00000100:00100000:1.0:1716999786.046660:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+71:1958:x1800404480634752:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:3.0:1716999786.046783:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480634688 00000100:00100000:3.0:1716999786.046787:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480634688 00000100:00100000:3.0:1716999786.046817:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45046 00000100:00100000:3.0:1716999786.046822:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480634688:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.046844:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.046859:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc33c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e95 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.047171:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc33cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.047182:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc33cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc20:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.047191:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc33cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc20:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:3.0:1716999786.047199:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc20:0x0]: returning size 74402 00010000:00010000:1.0:1716999786.047248:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.047261:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc33d9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64e9c expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1716999786.047277:0:15837:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x5f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999786.047285:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc33c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e95 expref: 582 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.047287:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.047288:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.047294:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc33d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e9c expref: 72 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.047296:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc33cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc20:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e95 expref: 581 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.047302:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:1.0:1716999786.047304:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc33d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e9c expref: 72 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.047305:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1716999786.047307:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97cc0, rc 0) 00010000:00010000:1.0:1716999786.047312:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132880, rc 0) 00000100:00100000:3.0:1716999786.047351:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+581:11420:x1800404480634688:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 528us (1642us total) trans 4294985780 rc 0/0 00000100:00100000:1.0:1716999786.047351:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+72:1958:x1800404480634752:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 692us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.047357:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9863 00000100:00100000:3.0:1716999786.047581:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45046 00000100:00100000:1.0:1716999786.051446:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480634816 00000100:00100000:1.0:1716999786.051454:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480634816 00000100:00100000:1.0:1716999786.051502:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9864 00000100:00100000:1.0:1716999786.051509:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+72:11419:x1800404480634816:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.051523:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.051537:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64ea3 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.051561:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc33d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e9c expref: 73 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999786.051569:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.051570:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.051573:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ea3 expref: 73 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.051596:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc33d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e9c expref: 73 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999786.051611:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc33d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e9c expref: 73 pid: 15837 timeout: 405 lvb_type: 1 00000100:00100000:1.0:1716999786.051621:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131c47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15837:1800404483005632:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999786.051682:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012bf5d180 going to sleep for 11 seconds 00000100:00100000:3.0:1716999786.052618:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480634880 00000100:00100000:3.0:1716999786.052622:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480634880 00002000:00100000:3.0:1716999786.052648:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x5f4:0x0] (0->74401) req@ffff880129f4aa00 x1800404480634880/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 488/0 e 0 to 0 dl 1716999797 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999786.052656:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f4aa00 with x1800404480634880 ext(0->74401) 00002000:00010000:3.0:1716999786.052660:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f4aa00 00000100:00100000:3.0:1716999786.052673:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1420 00000100:00100000:3.0:1716999786.052678:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480634880:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:1.0:1716999786.053951:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131c47b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15837:1800404483005632:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999786.053975:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ea3 expref: 73 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999786.053989:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999786.053991:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131200, rc 0) 00000100:00100000:1.0:1716999786.054018:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+73:11419:x1800404480634816:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2509us (3890us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.054025:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9864 00000100:00100000:3.0:1716999786.054037:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480634944 00000100:00100000:3.0:1716999786.054041:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480634944 00010000:00010000:3.0:1716999786.054055:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc33d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e9c expref: 73 pid: 15837 timeout: 405 lvb_type: 1 00000100:00100000:3.0:1716999786.054107:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4489 00000100:00100000:3.0:1716999786.054113:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480634944:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999786.054122:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999786.054137:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc33d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e9c expref: 73 pid: 15837 timeout: 405 lvb_type: 1 00010000:00010000:3.0:1716999786.054146:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc33d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e9c expref: 73 pid: 15837 timeout: 405 lvb_type: 1 00010000:00010000:3.0:1716999786.054163:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc33d9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e9c expref: 73 pid: 15837 timeout: 405 lvb_type: 1 00010000:00010000:3.0:1716999786.054173:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.054174:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.054179:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ea3 expref: 72 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.054186:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ea3 expref: 72 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.054209:0:15839:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ea3 expref: 72 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999786.054218:0:15839:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008af52680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483005696:192.168.203.3@tcp:105: 00000100:00100000:3.0:1716999786.054389:0:15839:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093549240 going to sleep for 11 seconds 00000100:00100000:2.0:1716999786.056111:0:15839:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008af52680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483005696:192.168.203.3@tcp:105: 00010000:00010000:2.0:1716999786.056128:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999786.056162:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480634944:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2048us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.056170:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4489 00000100:00100000:3.0:1716999786.057199:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+75:1959:x1800404480634880:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 4518us (4654us total) trans 4294970109 rc 0/0 00000100:00100000:3.0:1716999786.057208:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1420 00002000:00100000:3.0:1716999786.057217:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x5f4:0x0] (0->74401) req@ffff880129f4aa00 x1800404480634880/t4294970109(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 488/448 e 0 to 0 dl 1716999797 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999786.057226:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f4aa00 with x1800404480634880 ext(0->74401) 00002000:00010000:3.0:1716999786.057230:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f4aa00 00000100:00100000:2.0:1716999786.057515:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480635072 00000100:00100000:2.0:1716999786.057521:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480635072 00000100:00100000:2.0:1716999786.057543:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8976 00000100:00100000:2.0:1716999786.057549:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+581:11419:x1800404480635072:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999786.058028:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11326, 168 off2025552 00000001:00080000:2.0:1716999786.058034:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985781 00000100:00100000:2.0:1716999786.058625:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+583:11419:x1800404480635072:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1073us (1148us total) trans 4294985782 rc 0/0 00000100:00100000:2.0:1716999786.058631:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8976 00000020:00080000:2.0:1716999786.058635:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999786.061760:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.061816:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480635136 00000100:00100000:3.0:1716999786.061824:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480635136 00000100:00100000:2.0:1716999786.061851:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.061959:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480635264 00000100:00100000:3.0:1716999786.061962:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480635264 00000100:00100000:1.0:1716999786.061967:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45047 00000100:00100000:1.0:1716999786.061974:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+584:11420:x1800404480635136:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:3.0:1716999786.061987:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45048 00000100:00100000:3.0:1716999786.061991:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+584:11419:x1800404480635264:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.061998:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.062012:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc33e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64eaa expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.062074:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc33ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.062085:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc33ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc21:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.062094:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc33ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc21:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:3.0:1716999786.062102:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc21:0x0]: returning size 74402 00010000:00010000:3.0:1716999786.062496:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95680/0x6d188eabd8dc33e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64eaa expref: 587 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.062511:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc33ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc21:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64eaa expref: 586 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.062517:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff88009208be00) 00010000:00010000:3.0:1716999786.062519:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1716999786.062521:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96f40, rc 0) 00000100:00100000:3.0:1716999786.062556:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+586:11419:x1800404480635264:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 564us (706us total) trans 4294985783 rc 0/0 00000100:00100000:3.0:1716999786.062562:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45048 00000100:00100000:1.0:1716999786.066506:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.066614:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480635328 00000100:00100000:2.0:1716999786.066621:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480635328 00002000:00100000:2.0:1716999786.066649:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5f5:0x0] (0->74401) req@ffff880131c47b80 x1800404480635328/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 488/0 e 0 to 0 dl 1716999797 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.066659:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880131c47b80 with x1800404480635328 ext(0->74401) 00002000:00010000:2.0:1716999786.066663:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131c47b80 00000100:00100000:2.0:1716999786.066677:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1421 00000100:00100000:2.0:1716999786.066682:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480635328:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:2.0:1716999786.070679:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480635328:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 3989us (4170us total) trans 4294970146 rc 0/0 00000100:00100000:2.0:1716999786.070690:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1421 00002000:00100000:2.0:1716999786.070700:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5f5:0x0] (0->74401) req@ffff880131c47b80 x1800404480635328/t4294970146(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 488/448 e 0 to 0 dl 1716999797 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.070709:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880131c47b80 with x1800404480635328 ext(0->74401) 00002000:00010000:2.0:1716999786.070714:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131c47b80 00000100:00100000:2.0:1716999786.072429:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.072483:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480635392 00000100:00100000:3.0:1716999786.072490:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480635392 00000100:00100000:3.0:1716999786.072517:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45049 00000100:00100000:3.0:1716999786.072523:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+586:11419:x1800404480635392:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:3.0:1716999786.072596:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+586:11419:x1800404480635392:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 72us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.072602:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45049 00000100:00100000:1.0:1716999786.077027:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.077158:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480635456 00000100:00100000:2.0:1716999786.077166:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480635456 00000100:00100000:2.0:1716999786.077308:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9865 00000100:00100000:2.0:1716999786.077316:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+74:1958:x1800404480635456:12345-192.168.203.3@tcp:16:dbench.0 00000001:00080000:3.0:1716999786.113727:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985772 is committed 00000004:00080000:3.0:1716999786.113745:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 135 committed 00000004:00080000:3.0:1716999786.113754:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 130 committed 00000001:00080000:3.0:1716999786.113764:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985782 is committed 00000100:00100000:3.0:1716999786.113957:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008af50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483005952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999786.113993:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999786.114010:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1716999786.114014:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008af50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483005760:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999786.114028:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999786.114036:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008af52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483006016:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999786.114046:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999786.114062:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483005952 00000100:00100000:3.0:1716999786.114067:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483005952 00000100:00100000:3.0:1716999786.114089:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483005760 00000100:00100000:3.0:1716999786.114091:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483005760 00000100:00100000:3.0:1716999786.114101:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483006016 00000100:00100000:3.0:1716999786.114102:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483006016 00000100:00100000:3.0:1716999786.114112:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9866 00000100:00100000:3.0:1716999786.114116:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:3217:x1800404483005952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999786.114134:0:17864:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1519 count 1 00010000:00010000:3.0:1716999786.114150:0:17864:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090c95d40/0x6d188eabd8dc33fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.114163:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc246d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64b77 expref: 74 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.114170:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999786.114172:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999786.114174:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c95d40/0x6d188eabd8dc33fc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.114193:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc246d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64b77 expref: 74 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.114202:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc246d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64b77 expref: 74 pid: 19196 timeout: 405 lvb_type: 0 00000100:00100000:3.0:1716999786.114212:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009155bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483006144:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999786.114232:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800935490c0 going to sleep for 11 seconds 00000100:00100000:3.0:1716999786.114245:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9867 00000100:00100000:3.0:1716999786.114248:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3217:x1800404483005760:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999786.114258:0:8341:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1518 count 1 00010000:00010000:3.0:1716999786.114268:0:8341:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3403 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.114276:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc23c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64b3f expref: 74 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.114281:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999786.114283:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999786.114285:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3403 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.114302:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc23c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64b3f expref: 74 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.114309:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc23c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64b3f expref: 74 pid: 19196 timeout: 405 lvb_type: 0 00000100:00100000:3.0:1716999786.114317:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091558a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483006208:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999786.114330:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093549cc0 going to sleep for 11 seconds 00000100:00080000:3.0:1716999786.114337:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1716999756 00000100:00080000:3.0:1716999786.114339:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1716999756 00000100:00100000:3.0:1716999786.114348:0:17860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9868 00000100:00100000:3.0:1716999786.114351:0:17860:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3217:x1800404483006016:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999786.114359:0:17860:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1522 count 1 00010000:00010000:3.0:1716999786.114367:0:17860:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880090c97180/0x6d188eabd8dc340a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.114375:0:17860:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc2e37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64cff expref: 74 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.114381:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.114382:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.114384:0:17860:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c97180/0x6d188eabd8dc340a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.114396:0:17860:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc2e37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64cff expref: 74 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.114407:0:17860:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc2e37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64cff expref: 74 pid: 17864 timeout: 405 lvb_type: 1 00000100:00100000:3.0:1716999786.114415:0:17860:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009155aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:17860:1800404483006272:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999786.114429:0:17860:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093549900 going to sleep for 11 seconds 00000100:00100000:2.0:1716999786.114596:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008af52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483005824:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999786.114615:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999786.114624:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008af52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483006080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999786.114635:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999786.114644:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1716999786.114648:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008af51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483005888:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999786.114659:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999786.116949:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480635520 00000100:00100000:3.0:1716999786.116954:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480635520 00000100:00100000:3.0:1716999786.116976:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9872 00000100:00100000:3.0:1716999786.116981:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:107d663a-2216-406b-94c6-b2fcb1558728+75:1958:x1800404480635520:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:3.0:1716999786.117195:0:17860:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009155aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:17860:1800404483006272:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999786.117210:0:17860:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090c97180/0x6d188eabd8dc340a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999786.117226:0:8341:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091558a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483006208:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999786.117236:0:8341:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3403 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999786.117624:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009155bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483006144:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999786.117636:0:17864:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880090c95d40/0x6d188eabd8dc33fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999786.119040:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.119417:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.121445:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000004:00080000:3.0:1716999786.129622:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008af51500/2, rc 0, transno 2814 00000100:00100000:3.0:1716999786.129638:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008af51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483005888:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1716999786.129733:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008af52a00/2, rc 0, transno 2816 00000100:00100000:3.0:1716999786.129737:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008af52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483005824:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1716999786.129744:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008af52680/2, rc 0, transno 2851 00000100:00100000:3.0:1716999786.129749:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008af52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483006080:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1716999786.154693:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970145 is committed 00000001:00080000:3.0:1716999786.154710:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970146 is committed 00000100:00100000:2.0:1716999786.154812:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+66:1958:x1800404480635456:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 77492us (77788us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.154820:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9865 00000100:00100000:3.0:1716999786.171588:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:107d663a-2216-406b-94c6-b2fcb1558728+72:1958:x1800404480635520:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 54597us (54676us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.171598:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9872 00000001:00080000:3.0:1716999786.171622:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970106 is committed 00000001:00080000:3.0:1716999786.171632:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970109 is committed 00010000:00010000:2.0:1716999786.171932:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3426 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.171944:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3426 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.171949:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3426 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.171953:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.171957:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3426 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.171963:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3426 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.171975:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff88009208be00) 00010000:00010000:2.0:1716999786.171978:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.171981:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3426 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.171985:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3426 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.172140:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc342d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64eb1 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.172180:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc342d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64eb1 expref: 554 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.172189:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc342d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc21:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64eb1 expref: 554 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.172201:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff88009208be00) 00010000:00010000:1.0:1716999786.172204:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1716999786.172205:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133a80, rc 0) 00000100:00100000:1.0:1716999786.172239:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+554:11419:x1800404480636096:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 374us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.172244:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45051 00000100:00100000:1.0:1716999786.178005:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480636224 00000100:00100000:1.0:1716999786.178012:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480636224 00000100:00100000:1.0:1716999786.178056:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45052 00000100:00100000:1.0:1716999786.178063:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+554:11420:x1800404480636224:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999786.178100:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999786.178119:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc335b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e6b expref: 554 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.178132:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:1.0:1716999786.178135:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.178171:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3434 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.178180:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.178187:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999786.179756:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008c705500 reply state ffff8800911cd000 transno 4294985785 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3434 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999786.179769:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999786.179854:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11420:x1800404480636224:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1789us (1910us total) trans 4294985785 rc 0/0 00000100:00100000:1.0:1716999786.179861:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45052 00000100:00100000:3.0:1716999786.179952:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.181319:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.181357:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480636352 00000100:00100000:1.0:1716999786.181361:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480636352 00000100:00100000:1.0:1716999786.181391:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45053 00000100:00100000:1.0:1716999786.181396:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11420:x1800404480636352:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.181408:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.181419:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc343b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc20:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64eb8 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.181683:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc343b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc20:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64eb8 expref: 556 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.181694:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc343b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc20:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64eb8 expref: 556 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.181705:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:1.0:1716999786.181707:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1716999786.181709:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132d00, rc 0) 00000100:00100000:1.0:1716999786.181740:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11420:x1800404480636352:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 343us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.181745:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45053 00000100:00100000:1.0:1716999786.183720:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.183805:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480636480 00000100:00100000:2.0:1716999786.183813:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480636480 00000100:00100000:2.0:1716999786.183863:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45054 00000100:00100000:2.0:1716999786.183869:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11419:x1800404480636480:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:2.0:1716999786.184167:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3442 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.184179:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.184192:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.184211:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.184217:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3442 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.184222:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3442 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.184226:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.184229:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3442 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.184234:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3442 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.184242:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff88009208be00) 00010000:00010000:2.0:1716999786.184244:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1716999786.184247:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3442 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.184250:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3442 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999786.184294:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11419:x1800404480636480:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 425us (579us total) trans 0 rc -22/-22 00000100:00100000:2.0:1716999786.184300:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45054 00000100:00100000:3.0:1716999786.185421:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.186180:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480636544 00000100:00100000:3.0:1716999786.186187:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480636544 00000100:00100000:3.0:1716999786.186220:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9874 00000100:00100000:3.0:1716999786.186225:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+67:1959:x1800404480636544:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:3.0:1716999786.186395:0:15837:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5f4:0x0] updating lvb size from disk: 0 -> 74402 00002000:00010000:3.0:1716999786.186399:0:15837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5f4:0x0] updating lvb mtime from disk: 0 -> 1716999774 00002000:00010000:3.0:1716999786.186400:0:15837:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5f4:0x0] updating lvb atime from disk: 0 -> 1716999776 00002000:00010000:3.0:1716999786.186402:0:15837:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5f4:0x0] updating lvb ctime from disk: 0 -> 1716999786 00002000:00010000:3.0:1716999786.186403:0:15837:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5f4:0x0] updating lvb blocks from disk: 1 -> 259 00000100:00100000:3.0:1716999786.186436:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+68:1959:x1800404480636544:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 211us (1016us total) trans 4294970113 rc 0/0 00000100:00100000:3.0:1716999786.186443:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9874 00000100:00100000:2.0:1716999786.190726:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480636608 00000100:00100000:2.0:1716999786.190737:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480636608 00002000:00100000:2.0:1716999786.190773:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5f5:0x0] (0->4095) req@ffff88008c706680 x1800404480636608/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 4584/0 e 0 to 0 dl 1716999797 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.190782:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c706680 with x1800404480636608 ext(0->4095) 00002000:00010000:2.0:1716999786.190787:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c706680 00000100:00100000:2.0:1716999786.190817:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1422 00000100:00100000:2.0:1716999786.190823:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+67:1958:x1800404480636608:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:2.0:1716999786.191161:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+69:1958:x1800404480636608:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 335us (2724us total) trans 4294970151 rc 0/0 00000100:00100000:2.0:1716999786.191168:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1422 00002000:00100000:2.0:1716999786.191174:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5f5:0x0] (0->4095) req@ffff88008c706680 x1800404480636608/t4294970151(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 4584/448 e 0 to 0 dl 1716999797 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.191180:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c706680 with x1800404480636608 ext(0->4095) 00002000:00010000:2.0:1716999786.191182:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c706680 00000100:00100000:1.0:1716999786.192479:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.192613:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480636736 00000100:00100000:2.0:1716999786.192619:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480636736 00000100:00100000:2.0:1716999786.192647:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45055 00000100:00100000:2.0:1716999786.192651:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11420:x1800404480636736:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:2.0:1716999786.192683:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3449 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.192694:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.192702:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.192717:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3449 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.192723:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3449 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.192728:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3449 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.192733:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.192736:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3449 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.192742:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3449 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.192750:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:2.0:1716999786.192752:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1716999786.192755:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3449 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.192759:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3449 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999786.192796:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11420:x1800404480636736:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 143us (319us total) trans 0 rc -22/-22 00000100:00100000:2.0:1716999786.192801:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45055 00000100:00100000:3.0:1716999786.196515:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.196656:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480636800 00000100:00100000:2.0:1716999786.196663:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480636800 00002000:00100000:2.0:1716999786.196691:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x5f4:0x0] (0->4095) req@ffff88009155ad80 x1800404480636800/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 4584/0 e 0 to 0 dl 1716999797 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.196700:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009155ad80 with x1800404480636800 ext(0->4095) 00002000:00010000:2.0:1716999786.196705:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009155ad80 00000100:00100000:2.0:1716999786.196732:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1423 00000100:00100000:2.0:1716999786.196737:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+68:1957:x1800404480636800:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:2.0:1716999786.197115:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+70:1957:x1800404480636800:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 376us (605us total) trans 4294970114 rc 0/0 00000100:00100000:2.0:1716999786.197122:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1423 00002000:00100000:2.0:1716999786.197127:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x5f4:0x0] (0->4095) req@ffff88009155ad80 x1800404480636800/t4294970114(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 4584/448 e 0 to 0 dl 1716999797 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.197133:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009155ad80 with x1800404480636800 ext(0->4095) 00002000:00010000:2.0:1716999786.197136:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009155ad80 00000100:00100000:1.0:1716999786.198033:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.201350:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480636864 00000100:00100000:3.0:1716999786.201360:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480636864 00000100:00100000:3.0:1716999786.201401:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45056 00000100:00100000:3.0:1716999786.201408:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11419:x1800404480636864:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:3.0:1716999786.201497:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11419:x1800404480636864:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 89us (3466us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.201503:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45056 00000100:00100000:1.0:1716999786.201764:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.206232:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.206273:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.207323:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9875 00000100:00100000:1.0:1716999786.207330:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+69:1959:x1800404480636992:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:2.0:1716999786.207370:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9876 00000100:00100000:2.0:1716999786.207376:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b87e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+70:1959:x1800404480637056:12345-192.168.203.3@tcp:16:dbench.0 00000001:00080000:3.0:1716999786.278365:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970150 is committed 00000001:00080000:3.0:1716999786.278376:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970149 is committed 00000001:00080000:3.0:1716999786.278384:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970151 is committed 00000100:00100000:1.0:1716999786.278844:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+66:1959:x1800404480636992:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 71508us (72612us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.278855:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9875 00000100:00100000:1.0:1716999786.281915:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.282165:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480637120 00000100:00100000:2.0:1716999786.282173:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480637120 00000100:00100000:2.0:1716999786.282203:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45058 00000100:00100000:2.0:1716999786.282560:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11419:x1800404480637120:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.282575:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.282589:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3450 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64ebf expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.282631:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3457 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282641:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3457 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282649:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3457 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282662:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc345e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282667:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc345e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282672:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc345e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282757:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3465 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282764:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282770:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:2.0:1716999786.282791:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc21:0x0]: returning size 74402 00000004:00200000:2.0:1716999786.282795:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999786.282807:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282814:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282819:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3457 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282836:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3457 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282841:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3457 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282848:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ead00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.282852:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3457 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282857:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3457 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282866:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.282869:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.282872:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3457 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282876:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3457 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282903:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc345e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282907:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc345e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282911:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc345e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282914:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.282916:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc345e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282921:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc345e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282926:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009330d700) 00010000:00010000:2.0:1716999786.282928:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.282930:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc345e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282933:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc345e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.282954:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3450 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ebf expref: 557 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.282964:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ebf expref: 556 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.282969:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff88009208be00) 00010000:00010000:2.0:1716999786.282971:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999786.282973:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e98c0, rc 0) 00000100:00100000:2.0:1716999786.283012:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+556:11419:x1800404480637120:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 454us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.283019:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45058 00000100:00100000:1.0:1716999786.290722:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.294216:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.294281:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480637312 00000100:00100000:1.0:1716999786.294287:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480637312 00000100:00100000:1.0:1716999786.294322:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9877 00000100:00100000:1.0:1716999786.294327:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+66:1959:x1800404480637312:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:1.0:1716999786.294507:0:19195:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5f5:0x0] updating lvb size from disk: 74402 -> 74402 00002000:00010000:1.0:1716999786.294838:0:19195:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5f5:0x0] updating lvb mtime from disk: 1716999774 -> 1716999774 00002000:00010000:1.0:1716999786.294840:0:19195:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5f5:0x0] updating lvb atime from disk: 1716999776 -> 1716999776 00002000:00010000:1.0:1716999786.294842:0:19195:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5f5:0x0] updating lvb ctime from disk: 1716999786 -> 1716999786 00002000:00010000:1.0:1716999786.294843:0:19195:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5f5:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:1.0:1716999786.295047:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+67:1959:x1800404480637312:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 718us (845us total) trans 4294970152 rc 0/0 00000100:00100000:1.0:1716999786.295054:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9877 00000100:00100000:1.0:1716999786.297727:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.297750:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480637440 00000100:00100000:1.0:1716999786.297755:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480637440 00000100:00100000:1.0:1716999786.297780:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45060 00000100:00100000:1.0:1716999786.297786:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+556:11419:x1800404480637440:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:1.0:1716999786.297839:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3473 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.297852:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.297965:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.297982:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3473 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.297988:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3473 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.297993:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3473 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.297998:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.298001:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3473 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.298006:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3473 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.298014:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff88009208be00) 00010000:00010000:1.0:1716999786.298017:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1716999786.298020:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3473 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.298024:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3473 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000100:00100000:1.0:1716999786.298572:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+556:11419:x1800404480637440:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 784us (848us total) trans 0 rc -22/-22 00000100:00100000:1.0:1716999786.298580:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45060 00000100:00100000:3.0:1716999786.300259:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b87e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+67:1959:x1800404480637056:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 92881us (93983us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.300267:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9876 00000100:00100000:1.0:1716999786.300494:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480637504 00000100:00100000:1.0:1716999786.300500:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480637504 00000100:00100000:1.0:1716999786.300522:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45061 00000100:00100000:1.0:1716999786.300526:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+556:11419:x1800404480637504:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.300536:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.300549:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc347a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64ec6 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.300587:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3481 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300597:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3481 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300604:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3481 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300614:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3488 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300619:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300624:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300681:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3481 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300686:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3481 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300690:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3481 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300695:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.300698:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3481 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300703:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3481 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300711:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.300713:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.300716:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3481 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300720:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3481 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300728:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3488 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300732:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3488 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300736:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3488 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300739:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.300742:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3488 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300745:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3488 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300750:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01f5e8 (ffff88012bf53600) 00010000:00010000:1.0:1716999786.300752:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.300754:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3488 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300757:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3488 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.300788:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc347a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ec6 expref: 557 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.300794:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc347a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ec6 expref: 557 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.300801:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130fc0, rc 0) 00000100:00100000:1.0:1716999786.300821:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+556:11419:x1800404480637504:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 294us (717us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999786.300839:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45061 00000100:00100000:1.0:1716999786.303956:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480637568 00000100:00100000:1.0:1716999786.303962:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480637568 00000100:00100000:2.0:1716999786.304650:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480637632 00000100:00100000:2.0:1716999786.304655:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480637632 00000100:00100000:1.0:1716999786.304658:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45062 00000100:00100000:1.0:1716999786.304665:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+557:11420:x1800404480637568:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:2.0:1716999786.304679:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45063 00010000:00010000:1.0:1716999786.304681:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1716999786.304683:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+557:11419:x1800404480637632:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.304690:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.304696:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc348f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64ecd expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.304698:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3496 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64ed4 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.304720:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ed4 expref: 559 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.304734:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3496 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ed4 expref: 559 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.304736:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc349d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.304740:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.304742:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.304744:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc349d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.304745:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9440, rc 0) 00010000:00010000:1.0:1716999786.304754:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc349d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304763:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc34a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304768:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc34a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304773:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc34a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:2.0:1716999786.304776:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480637632:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 92us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.304781:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45063 00010000:00010000:1.0:1716999786.304898:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc34ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304905:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc34ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304910:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc34ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00200000:1.0:1716999786.304932:0:16641:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc20:0x0]: returning size 74402 00000004:00200000:1.0:1716999786.304935:0:16641:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999786.304946:0:16641:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc34ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304952:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc34ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304958:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc349d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304962:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc349d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304970:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc349d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304975:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.304977:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc349d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304984:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc349d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304991:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.304992:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.304995:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc349d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.304999:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc349d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.305009:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc34a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.305014:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc34a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.305018:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc34a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.305021:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.305023:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc34a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.305027:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc34a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.305033:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff88012bf53800) 00010000:00010000:1.0:1716999786.305035:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.305036:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc34a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.305040:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc34a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.305058:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc348f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ecd expref: 559 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.305066:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc34ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ecd expref: 558 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.305071:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:1.0:1716999786.305073:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999786.305075:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132f40, rc 0) 00000100:00100000:1.0:1716999786.305108:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480637568:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 443us (2282us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.305113:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45062 00000100:00100000:3.0:1716999786.308861:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480637824 00000100:00100000:3.0:1716999786.308868:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480637824 00000100:00100000:3.0:1716999786.308933:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45064 00000100:00100000:3.0:1716999786.308940:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480637824:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999786.308975:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1716999786.308987:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480637696 00000100:00100000:2.0:1716999786.308991:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480637696 00010000:00010000:3.0:1716999786.308993:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc34ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ecd expref: 558 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.309025:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:3.0:1716999786.309029:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999786.309056:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc34b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.309066:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc34b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.309073:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc34b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999786.309361:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008c705c00 reply state ffff880090b13000 transno 4294985787 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc34b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999786.309367:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999786.309434:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+560:11420:x1800404480637824:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 494us (638us total) trans 4294985787 rc 0/0 00000100:00100000:3.0:1716999786.309440:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45064 00000100:00100000:3.0:1716999786.310956:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480637888 00000100:00100000:3.0:1716999786.310965:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480637888 00010000:00010000:2.0:1716999786.310975:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc34b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.310982:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc34b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.310987:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc34b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.310992:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96400 already unused, calling callback (ffffffffa1389790) 00000100:00100000:3.0:1716999786.310994:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9878 00010000:00010000:2.0:1716999786.310995:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc34b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999786.311000:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+67:1956:x1800404480637888:12345-192.168.203.3@tcp:2:dbench.0 00010000:00010000:2.0:1716999786.311000:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc34b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.311008:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:2.0:1716999786.311010:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.311013:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc34b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.311017:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc34b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00002000:00010000:3.0:1716999786.311157:0:15837:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5f4:0x0] updating lvb size from disk: 74402 -> 74402 00002000:00010000:3.0:1716999786.311160:0:15837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5f4:0x0] updating lvb mtime from disk: 1716999774 -> 1716999774 00002000:00010000:3.0:1716999786.311162:0:15837:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5f4:0x0] updating lvb atime from disk: 1716999776 -> 1716999776 00002000:00010000:3.0:1716999786.311164:0:15837:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5f4:0x0] updating lvb ctime from disk: 1716999786 -> 1716999786 00002000:00010000:3.0:1716999786.311166:0:15837:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5f4:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:3.0:1716999786.311190:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+68:1956:x1800404480637888:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 189us (286us total) trans 4294970115 rc 0/0 00000100:00100000:3.0:1716999786.311197:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9878 00000100:00100000:1.0:1716999786.311409:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+558:11419:x1800404480637696:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2300us (2665us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.311416:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8977 00000100:00100000:3.0:1716999786.314480:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.314531:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.314703:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480638016 00000100:00100000:1.0:1716999786.314711:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480638016 00000100:00100000:1.0:1716999786.314752:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480638144 00000100:00100000:1.0:1716999786.314755:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480638144 00000100:00100000:1.0:1716999786.314769:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45065 00000100:00100000:1.0:1716999786.314775:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480638016:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.314794:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.314796:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999786.314815:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc3496 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ed4 expref: 559 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.314840:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.314844:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.314853:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc34b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64edb expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.314982:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc34c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.314992:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc34c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.315000:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc34c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.315008:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc34c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.315013:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc34c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.315018:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc34c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:1.0:1716999786.315489:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f5:0x0], index 0: 0 00000040:00080000:1.0:1716999786.315584:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11327, 184 off2025736 00010000:00010000:1.0:1716999786.315667:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc34ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.315677:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc34ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.315682:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc34ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.315702:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc34c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.315707:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc34c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.315712:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc34c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.315716:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.315719:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc34c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999786.315723:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45066 00010000:00010000:1.0:1716999786.315724:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc34c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999786.315729:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+560:11420:x1800404480638144:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:2.0:1716999786.315754:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc34dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.315761:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc34dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.315767:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc34dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.315779:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc34dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.315784:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc34dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.315788:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc34dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.315792:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.315794:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc34dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.315799:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc34dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.315805:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:2.0:1716999786.315807:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1716999786.315810:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc34dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.315814:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc34dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000100:00100000:2.0:1716999786.315867:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+560:11420:x1800404480638144:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 137us (1335us total) trans 0 rc -22/-22 00000100:00100000:2.0:1716999786.315873:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45066 00010000:00010000:1.0:1716999786.316609:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.316613:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.316617:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc34c0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.316622:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc34c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999786.316633:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880091559c00 reply state ffff8800926f0000 transno 4294985788 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc34c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999786.316640:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999786.317412:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.317454:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480638208 00000100:00100000:3.0:1716999786.317460:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480638208 00000100:00100000:3.0:1716999786.317487:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45067 00000100:00100000:3.0:1716999786.317492:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+560:11420:x1800404480638208:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.317502:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.317512:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc34e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64ee2 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.317541:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc34ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317550:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc34ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317556:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc34ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317565:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc34f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317569:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc34f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317573:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc34f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317616:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc34ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317624:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc34ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317628:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc34ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317632:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.317634:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc34ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317638:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc34ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317645:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999786.317646:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.317649:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc34ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317652:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc34ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317660:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc34f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317663:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc34f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317667:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc34f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317670:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.317672:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc34f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317679:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc34f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317683:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01f5e8 (ffff88009208bc00) 00010000:00010000:3.0:1716999786.317685:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.317687:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc34f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317692:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc34f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.317718:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc34e3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ee2 expref: 561 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.317724:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc34e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ee2 expref: 561 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.317732:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96640, rc 0) 00000100:00100000:3.0:1716999786.317770:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+560:11420:x1800404480638208:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 277us (359us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.317776:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45067 00010000:00010000:1.0:1716999786.318224:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc34b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64edb expref: 560 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.318238:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc34ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc22:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64edb expref: 559 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.318243:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc22:0x0].0x0 (ffff88012bf53700) 00010000:00010000:1.0:1716999786.318245:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999786.318247:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131440, rc 0) 00000100:00100000:1.0:1716999786.319479:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+560:11419:x1800404480638016:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 4701us (5003us total) trans 4294985788 rc 0/0 00000100:00100000:1.0:1716999786.319486:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45065 00000100:00100000:2.0:1716999786.320449:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.320669:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480638272 00000100:00100000:1.0:1716999786.320675:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480638272 00000100:00100000:1.0:1716999786.320708:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45068 00000100:00100000:1.0:1716999786.320714:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+560:11420:x1800404480638272:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.320727:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.320739:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc34f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64ee9 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.320762:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc34f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ee9 expref: 561 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.320772:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc34f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ee9 expref: 561 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.320783:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.320785:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.320788:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132f40, rc 0) 00000100:00100000:1.0:1716999786.320822:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+561:11420:x1800404480638272:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 107us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.320838:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45068 00010000:00010000:2.0:1716999786.322020:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc34c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.322028:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc34c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.322302:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc34c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.322307:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.322310:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc34c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.322316:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc34c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.322326:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01f5e8 (ffff88012bf53000) 00010000:00010000:2.0:1716999786.322329:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.322331:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc34c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.322335:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc34c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999786.322601:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.323102:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.325166:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.325364:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480638528 00000100:00100000:2.0:1716999786.325369:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480638528 00000100:00100000:2.0:1716999786.330541:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.330588:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480638656 00000100:00100000:3.0:1716999786.330595:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480638656 00000100:00100000:3.0:1716999786.330642:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45069 00000100:00100000:3.0:1716999786.330648:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+562:11420:x1800404480638656:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.330665:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.330668:0:16641:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1716999786.330689:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc34f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ee9 expref: 562 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.330716:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999786.330720:0:16641:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999786.330731:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3506 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64ef7 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.330850:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc350d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.330861:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc350d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.330868:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc350d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:1.0:1716999786.331148:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999786.332763:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3514 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.332773:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.332780:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00080000:3.0:1716999786.333163:0:16641:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f6:0x0], index 1: 0 00000040:00080000:3.0:1716999786.333234:0:16641:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11330, 184 off2026272 00010000:00010000:3.0:1716999786.333314:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3537 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.333320:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.333326:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3537 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.333354:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc350d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.333360:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc350d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.333364:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc350d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.333368:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.333370:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc350d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.333376:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc350d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.333383:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999786.333386:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.333388:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc350d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.333392:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc350d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000004:00010000:3.0:1716999786.333401:0:16641:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012ea9ea00 reply state ffff880090b11000 transno 4294985792 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3514 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:3.0:1716999786.333406:0:16641:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999786.333427:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3506 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ef7 expref: 565 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.333438:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3537 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc23:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ef7 expref: 564 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.333444:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc23:0x0].0x0 (ffff88009208b300) 00010000:00010000:3.0:1716999786.333446:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999786.333447:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94b40, rc 0) 00000100:00100000:3.0:1716999786.333492:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480638656:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2842us (2957us total) trans 4294985792 rc 0/0 00000100:00100000:3.0:1716999786.333498:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45069 00010000:00010000:3.0:1716999786.333534:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc3522 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.333540:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc3522 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.333545:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc3522 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.333548:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.333550:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc3522 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.333554:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc3522 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.333561:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01f5e8 (ffff8800a5c6e400) 00010000:00010000:3.0:1716999786.333563:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.333565:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc3522 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.333569:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc3522 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999786.334989:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.335035:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480638848 00000100:00100000:3.0:1716999786.335042:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480638848 00000100:00100000:3.0:1716999786.335077:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45071 00000100:00100000:3.0:1716999786.335082:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480638848:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.335095:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.335106:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3545 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64efe expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.335138:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc354c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335147:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc354c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335153:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc354c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335161:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3553 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335166:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335170:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335236:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc355a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335242:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc355a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335250:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc355a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00200000:3.0:1716999786.335265:0:16641:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc21:0x0]: returning size 74402 00000004:00200000:3.0:1716999786.335268:0:16641:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999786.335276:0:16641:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc355a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335282:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc355a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335287:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc354c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335290:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc354c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335294:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc354c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335298:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.335300:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc354c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335304:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc354c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335309:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999786.335311:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.335313:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc354c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335317:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc354c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335325:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3553 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335329:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3553 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335333:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335337:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.335339:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3553 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335343:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3553 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335348:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009208bf00) 00010000:00010000:3.0:1716999786.335350:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.335352:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3553 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335356:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3553 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.335372:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3545 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64efe expref: 565 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.335380:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc355a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64efe expref: 564 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.335385:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff88009208be00) 00010000:00010000:3.0:1716999786.335387:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999786.335389:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96640, rc 0) 00000100:00100000:3.0:1716999786.335426:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480638848:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 343us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.335432:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45071 00000100:00100000:1.0:1716999786.336050:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.336111:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480638912 00000100:00100000:3.0:1716999786.336116:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480638912 00000100:00100000:3.0:1716999786.336135:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9880 00000100:00100000:3.0:1716999786.336139:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+67:1958:x1800404480638912:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.336147:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.336158:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090c95f80/0x6d188eabd8dc3561 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f05 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999786.336174:0:15837:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x5f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999786.336185:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.336186:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.336191:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c95f80/0x6d188eabd8dc3561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f05 expref: 68 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.336201:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090c95f80/0x6d188eabd8dc3561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f05 expref: 68 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.336209:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95f80, rc 0) 00000100:00100000:3.0:1716999786.336239:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+68:1958:x1800404480638912:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 98us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.336245:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9880 00000100:00100000:2.0:1716999786.338227:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.338328:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480638976 00000100:00100000:3.0:1716999786.338334:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480638976 00000100:00100000:3.0:1716999786.338368:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45072 00000100:00100000:3.0:1716999786.338375:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480638976:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.338390:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.338402:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3568 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f0c expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.338438:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc356f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338447:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc356f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338454:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc356f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338464:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc3576 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338468:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc3576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338472:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc3576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338525:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc356f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338531:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc356f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338536:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc356f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338544:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.338547:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc356f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338552:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc356f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338561:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999786.338563:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.338566:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc356f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338570:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc356f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338580:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc3576 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338585:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc3576 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338589:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc3576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338593:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.338595:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc3576 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338599:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc3576 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338605:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01f5e8 (ffff88009208b500) 00010000:00010000:3.0:1716999786.338608:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.338609:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc3576 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338613:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc3576 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.338641:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3568 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f0c expref: 565 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.338647:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3568 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f0c expref: 565 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.338654:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95440, rc 0) 00000100:00100000:3.0:1716999786.338695:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480638976:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 320us (471us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.338700:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45072 00000100:00100000:2.0:1716999786.341110:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.341185:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.342142:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480639104 00000100:00100000:3.0:1716999786.342147:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480639104 00000100:00100000:3.0:1716999786.342180:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8980 00000100:00100000:3.0:1716999786.342185:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480639104:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999786.342731:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11331, 168 off2026440 00000001:00080000:3.0:1716999786.342737:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985793 00000100:00100000:3.0:1716999786.343121:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480639104:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 934us (2014us total) trans 4294985794 rc 0/0 00000100:00100000:3.0:1716999786.343128:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8980 00000020:00080000:3.0:1716999786.343132:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999786.343135:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480639232 00000100:00100000:2.0:1716999786.343139:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480639232 00000100:00100000:3.0:1716999786.343160:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8981 00000100:00100000:3.0:1716999786.343165:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+567:11419:x1800404480639232:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999786.344870:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.345108:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480639360 00000100:00100000:1.0:1716999786.345113:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480639360 00000100:00100000:1.0:1716999786.345137:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45074 00000100:00100000:1.0:1716999786.345142:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480639360:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999786.345173:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999786.345189:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3537 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ef7 expref: 569 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.345204:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc23:0x0].0x0 (ffff88009208b300) 00010000:00010000:1.0:1716999786.345210:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.345228:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3584 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345237:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3584 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345244:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3584 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345253:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc358b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345258:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc358b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345263:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc358b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345332:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3592 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345338:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3592 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345342:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3592 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:1.0:1716999786.345739:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1472, 64 off102464 00000040:00080000:1.0:1716999786.345756:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11332, 184 off2026624 00010000:00010000:1.0:1716999786.345803:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3599 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345809:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345815:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3599 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345821:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3599 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345839:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3599 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345847:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3599 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.345852:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3599 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347241:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132f40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999786.347245:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3599 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347250:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3599 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347258:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc23:0x0].0x0 (ffff88012ecfa700) 00010000:00010000:1.0:1716999786.347260:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999786.347263:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3599 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347267:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3599 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347286:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3592 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347290:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3592 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347294:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3592 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347297:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.347299:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3592 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347305:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3592 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347309:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc23:0x0].0x0 (ffff88012ecfa700) 00010000:00010000:1.0:1716999786.347310:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999786.347312:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3592 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999786.347342:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+568:11419:x1800404480639232:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4173us (4557us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.347350:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8981 00010000:00010000:1.0:1716999786.347465:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3592 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347501:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3584 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347505:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3584 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347509:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3584 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347513:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.347515:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3584 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347519:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3584 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347525:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.347527:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.347529:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3584 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.347533:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3584 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999786.347539:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880090682a00 reply state ffff8800926f1000 transno 4294985795 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc358b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999786.347544:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999786.347586:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+568:11420:x1800404480639360:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2444us (2718us total) trans 4294985795 rc 0/0 00000100:00100000:1.0:1716999786.347591:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45074 00010000:00010000:3.0:1716999786.350165:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc358b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999786.350175:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc358b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999786.350180:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc358b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999786.350317:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.350321:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc358b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999786.350327:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc358b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999786.350338:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01f5e8 (ffff88012ecfab00) 00010000:00010000:3.0:1716999786.350340:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.350343:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc358b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999786.350347:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc358b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999786.350862:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480639488 00000100:00100000:1.0:1716999786.350869:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480639488 00000100:00100000:1.0:1716999786.350908:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480639424 00000100:00100000:1.0:1716999786.350983:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480639424 00000100:00100000:1.0:1716999786.350999:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45076 00000100:00100000:1.0:1716999786.351003:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480639424:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.351009:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.351014:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc35ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f1a expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.351034:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc35bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351039:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc35bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351044:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc35bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351051:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc35c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351055:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc35c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351060:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc35c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351089:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc35bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351093:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc35bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351097:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc35bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351100:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.351102:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc35bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351106:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc35bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351112:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.351114:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.351116:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc35bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351121:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc35bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351128:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc35c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351131:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc35c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351138:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc35c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351141:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.351143:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc35c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351146:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc35c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351151:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01f5e8 (ffff88009c872200) 00010000:00010000:1.0:1716999786.351153:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.351154:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc35c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351158:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc35c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.351181:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc35ae lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f1a expref: 570 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.351187:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc35ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f1a expref: 570 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.351193:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130480, rc 0) 00000100:00100000:1.0:1716999786.351232:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480639424:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 227us (356us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999786.351237:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45076 00000100:00100000:1.0:1716999786.352805:0:4162:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480639616 00000100:00100000:1.0:1716999786.352810:0:4162:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480639616 00000100:00100000:1.0:1716999786.352854:0:4162:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 598 00000100:00100000:1.0:1716999786.352859:0:4162:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+568:11419:x1800404480639616:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999786.352911:0:4162:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999786.352924:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc355a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64efe expref: 568 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.352937:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff88009208be00) 00010000:00010000:1.0:1716999786.352944:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc357d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f13 expref: 567 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.352952:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.352955:0:4162:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.352990:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc35d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.352998:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc35d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353004:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc35d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353011:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc35d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353016:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc35d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353021:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc35d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353032:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc35df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353038:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc35df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353041:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc35df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353091:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc35e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353095:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc35e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353098:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc35e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000040:00080000:1.0:1716999786.353352:0:4162:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11333, 224 off2026848 00000004:00010000:1.0:1716999786.353416:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880129f49500 reply state ffff8800a6702000 transno 4294985796 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc35e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:1.0:1716999786.353422:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1716999786.353424:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880129f49500 reply state ffff8800a6702000 transno 4294985796 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc35df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:1.0:1716999786.353428:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1716999786.353430:0:4162:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc35d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353435:0:4162:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc35d1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353439:0:4162:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc35d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353443:0:4162:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.353446:0:4162:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc35d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353452:0:4162:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc35d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353459:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.353461:0:4162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.353463:0:4162:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc35d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.353467:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc35d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00000004:00010000:1.0:1716999786.353473:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880129f49500 reply state ffff8800a6702000 transno 4294985796 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc35d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:1.0:1716999786.353478:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1716999786.353521:0:4162:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+568:11419:x1800404480639616:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 660us (752us total) trans 4294985796 rc 0/0 00000100:00100000:1.0:1716999786.353526:0:4162:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 598 00000100:00100000:3.0:1716999786.353646:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.354922:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.356755:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.356785:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.356941:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45080 00000100:00100000:1.0:1716999786.356946:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480639872:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.356952:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.356958:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc361e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f3d expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.356971:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc361e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f3d expref: 570 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.356978:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc361e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f3d expref: 570 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.356983:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.356985:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.356987:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132640, rc 0) 00000100:00100000:1.0:1716999786.357000:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480639872:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 54us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.357004:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45080 00000100:00100000:2.0:1716999786.358474:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.358515:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.358581:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480639936 00000100:00100000:3.0:1716999786.358582:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480640000 00000100:00100000:1.0:1716999786.358586:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480639936 00000100:00100000:3.0:1716999786.358587:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480640000 00000100:00100000:1.0:1716999786.358607:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8982 00000100:00100000:1.0:1716999786.358612:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480639936:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999786.358623:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8983 00000100:00100000:3.0:1716999786.358628:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480640000:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999786.360755:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+571:11420:x1800404480639936:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2137us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.360764:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8982 00000100:00100000:3.0:1716999786.361981:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480640000:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3348us (3462us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.361988:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8983 00000100:00100000:2.0:1716999786.362557:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480640064 00000100:00100000:2.0:1716999786.362563:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480640064 00000100:00100000:2.0:1716999786.362660:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45081 00000100:00100000:2.0:1716999786.362667:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480640064:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.362681:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.362696:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3625 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f44 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.362738:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc362c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362749:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc362c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362757:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc362c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362767:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3633 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362772:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362777:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362821:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc362c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362838:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc362c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362842:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc362c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362846:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.362849:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc362c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362854:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc362c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362862:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999786.362864:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.362867:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc362c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362871:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc362c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362900:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3633 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362904:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3633 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362908:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362911:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ead00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.362913:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3633 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362917:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3633 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362923:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01f5e8 (ffff88009330dd00) 00010000:00010000:2.0:1716999786.362925:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.362927:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3633 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362930:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3633 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.362962:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3625 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f44 expref: 570 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.362968:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3625 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f44 expref: 570 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.362974:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9680, rc 0) 00000100:00100000:2.0:1716999786.362993:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480640064:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 328us (615us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999786.362998:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45081 00000100:00100000:2.0:1716999786.364138:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480640192 00000100:00100000:2.0:1716999786.364143:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480640192 00000100:00100000:2.0:1716999786.364363:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45082 00000100:00100000:2.0:1716999786.364369:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480640192:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.364377:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.364386:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc363a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f4b expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.364439:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc3641 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364446:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc3641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364452:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc3641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364460:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3648 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364465:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364470:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364496:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc3641 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364504:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc3641 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364508:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc3641 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364512:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ebcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.364514:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc3641 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364519:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc3641 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364526:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.364529:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.364531:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc3641 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364535:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc3641 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364542:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3648 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364547:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3648 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364551:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364555:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.364557:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3648 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364565:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3648 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364571:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009330d700) 00010000:00010000:2.0:1716999786.364572:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.364574:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3648 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364579:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3648 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.364597:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc363a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f4b expref: 570 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.364603:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc363a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f4b expref: 570 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.364609:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e86c0, rc 0) 00000100:00100000:2.0:1716999786.364632:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480640192:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 263us (566us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999786.364637:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45082 00000100:00100000:3.0:1716999786.364657:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.364843:0:4162:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480640320 00000100:00100000:1.0:1716999786.364847:0:4162:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480640320 00000100:00100000:1.0:1716999786.364877:0:4162:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 599 00000100:00100000:1.0:1716999786.364914:0:4162:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480640320:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999786.364933:0:4162:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999786.364944:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc35ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f21 expref: 569 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.364953:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:1.0:1716999786.364959:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3617 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f36 expref: 568 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.364969:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.364972:0:4162:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.365002:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc364f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365008:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc364f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365013:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc364f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365022:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3656 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365027:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365032:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365046:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc365d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365050:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc365d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365055:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc365d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365124:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3664 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365130:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3664 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365136:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3664 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000040:00080000:1.0:1716999786.365460:0:4162:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11334, 224 off2027072 00000004:00010000:1.0:1716999786.365524:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009155a680 reply state ffff8800a6705000 transno 4294985797 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3664 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:1.0:1716999786.365530:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1716999786.365533:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009155a680 reply state ffff8800a6705000 transno 4294985797 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc365d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:1.0:1716999786.365537:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1716999786.365539:0:4162:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc364f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365543:0:4162:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc364f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365547:0:4162:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc364f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365551:0:4162:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.365554:0:4162:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc364f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365558:0:4162:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc364f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365565:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.365567:0:4162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.365569:0:4162:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc364f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999786.365577:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc364f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00000004:00010000:1.0:1716999786.365585:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009155a680 reply state ffff8800a6705000 transno 4294985797 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:1.0:1716999786.365589:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1716999786.365620:0:4162:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480640320:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 706us (962us total) trans 4294985797 rc 0/0 00000100:00100000:1.0:1716999786.365625:0:4162:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 599 00000100:00100000:3.0:1716999786.365902:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480640384 00000100:00100000:3.0:1716999786.365906:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480640384 00000100:00100000:2.0:1716999786.365959:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45083 00000100:00100000:2.0:1716999786.365964:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480640384:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.365970:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.365977:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc366b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f52 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.365998:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3672 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366004:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3672 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366009:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3672 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366016:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3679 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366020:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366024:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366050:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3672 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366055:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3672 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366059:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3672 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366063:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.366065:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3672 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366070:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3672 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366076:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.366078:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.366080:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3672 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366084:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3672 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366091:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366096:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3679 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366100:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366104:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.366106:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366110:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3679 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366116:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009330da00) 00010000:00010000:2.0:1716999786.366117:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.366119:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3679 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366124:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3679 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.366150:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc366b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f52 expref: 570 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.366157:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc366b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f52 expref: 570 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.366168:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eaf40, rc 0) 00000100:00100000:2.0:1716999786.366187:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480640384:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 223us (417us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999786.366193:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45083 00010000:00010000:3.0:1716999786.366862:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366868:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3656 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366872:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366875:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.366877:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366897:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3656 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366903:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff8800939c9700) 00010000:00010000:3.0:1716999786.366905:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.366907:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3656 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366911:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3656 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366928:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc365d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366932:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc365d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366936:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc365d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366939:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.366941:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc365d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366944:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc365d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366948:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01f5e8 (ffff8800939c9e00) 00010000:00010000:3.0:1716999786.366950:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.366951:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc365d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366955:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc365d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366961:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3664 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366964:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3664 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366968:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3664 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366974:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.366976:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3664 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366979:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3664 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366983:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:3.0:1716999786.366985:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999786.366986:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3664 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999786.366990:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3664 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00000100:00100000:2.0:1716999786.367962:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.367987:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.368131:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480640576 00000100:00100000:1.0:1716999786.368134:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480640576 00000100:00100000:1.0:1716999786.368159:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45085 00000100:00100000:1.0:1716999786.368163:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480640576:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.368179:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.368181:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999786.368192:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc361e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f3d expref: 570 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.368202:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.368205:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.368209:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3687 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f60 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.368273:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc369c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.368279:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc369c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.368287:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc369c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.368295:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc36a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.368299:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc36a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.368303:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc36a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:1.0:1716999786.368989:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f6:0x0], index 0: 0 00000040:00080000:1.0:1716999786.369039:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11335, 184 off2027256 00010000:00010000:1.0:1716999786.369113:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc36aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.369120:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc36aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.369126:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc36aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.369146:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc369c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.369151:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc369c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.369156:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc369c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.369160:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.369163:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc369c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.369167:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc369c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.369174:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.369176:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.369178:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc369c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.369182:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc369c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999786.369189:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a691880 reply state ffff8800a6704000 transno 4294985798 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc36a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999786.369194:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999786.369209:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3687 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f60 expref: 570 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.369216:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc36aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f60 expref: 569 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.369222:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:1.0:1716999786.369224:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999786.369225:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131440, rc 0) 00000100:00100000:1.0:1716999786.369253:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480640576:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1089us (1265us total) trans 4294985798 rc 0/0 00000100:00100000:1.0:1716999786.369258:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45085 00000100:00100000:2.0:1716999786.370723:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.370806:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.370863:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480640704 00000100:00100000:1.0:1716999786.370869:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480640640 00000100:00100000:3.0:1716999786.370870:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480640704 00000100:00100000:1.0:1716999786.370872:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480640640 00000100:00100000:3.0:1716999786.370909:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9881 00000100:00100000:1.0:1716999786.370909:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45086 00000100:00100000:3.0:1716999786.370914:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+69:1958:x1800404480640704:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:1.0:1716999786.370914:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480640640:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.370923:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.370923:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.370935:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc36b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f67 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.370936:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc36bf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f6e expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.370952:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc36b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f67 expref: 571 pid: 6823 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999786.370954:0:15837:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1716999786.370960:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc36b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f67 expref: 571 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.370962:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.370964:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.370966:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.370968:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.370969:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc36bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f6e expref: 70 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999786.370970:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130900, rc 0) 00010000:00010000:3.0:1716999786.370977:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc36bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f6e expref: 70 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.370984:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95440, rc 0) 00000100:00100000:3.0:1716999786.371008:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+70:1958:x1800404480640704:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 94us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.371013:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9881 00000100:00100000:1.0:1716999786.371037:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480640640:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 123us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.371042:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45086 00000100:00100000:3.0:1716999786.373047:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480640768 00000100:00100000:3.0:1716999786.373053:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480640768 00000100:00100000:3.0:1716999786.373076:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9882 00000100:00100000:3.0:1716999786.373082:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+70:11419:x1800404480640768:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.373092:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.373103:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc36c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f75 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.373120:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc36bf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f6e expref: 71 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.373126:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.373128:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.373131:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc36c6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f75 expref: 71 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.373154:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc36bf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f6e expref: 71 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.373164:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc36bf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f6e expref: 71 pid: 15837 timeout: 405 lvb_type: 1 00000100:00100000:3.0:1716999786.373179:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009155b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483006528:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999786.373227:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093549780 going to sleep for 11 seconds 00000100:00100000:2.0:1716999786.373363:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.373437:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480640832 00000100:00100000:3.0:1716999786.373440:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480640832 00000100:00100000:3.0:1716999786.373469:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8984 00000100:00100000:3.0:1716999786.373474:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480640832:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999786.376318:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009155b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483006528:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999786.376339:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc36c6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f75 expref: 71 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.376351:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96d00, rc 0) 00000100:00100000:2.0:1716999786.376366:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.376384:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+71:11419:x1800404480640768:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 3301us (3539us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.376391:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9882 00000100:00100000:3.0:1716999786.378314:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480640832:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4837us (4949us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.378322:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8984 00000100:00100000:1.0:1716999786.380530:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480641024 00000100:00100000:1.0:1716999786.380535:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480641024 00000100:00100000:1.0:1716999786.380620:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45087 00000100:00100000:1.0:1716999786.380624:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480641024:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.380636:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.380647:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc36cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f7c expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.380722:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc36d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380732:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc36d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380740:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc36d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380750:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc36db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380755:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc36db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380760:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc36db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999786.380789:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480641152 00000100:00100000:3.0:1716999786.380793:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480641152 00010000:00010000:1.0:1716999786.380796:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc36d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380801:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc36d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380806:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc36d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999786.380809:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8985 00010000:00010000:1.0:1716999786.380811:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa1389790) 00000100:00100000:3.0:1716999786.380813:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+572:11419:x1800404480641152:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:1.0:1716999786.380814:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc36d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380819:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc36d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380842:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.380845:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.380849:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc36d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380852:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc36d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380860:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc36db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380864:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc36db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380868:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc36db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380871:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.380873:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc36db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380876:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc36db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380899:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff88008a83f300) 00010000:00010000:1.0:1716999786.380901:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.380903:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc36db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380906:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc36db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.380936:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc36cd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f7c expref: 573 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.380942:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc36cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f7c expref: 573 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.380948:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132f40, rc 0) 00000100:00100000:1.0:1716999786.380971:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+572:11420:x1800404480641024:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 346us (477us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999786.380975:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45087 00000040:00080000:3.0:1716999786.381151:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11336, 168 off2027424 00000001:00080000:3.0:1716999786.381157:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985799 00000100:00100000:3.0:1716999786.381337:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+572:11419:x1800404480641152:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 521us (802us total) trans 4294985800 rc 0/0 00000100:00100000:3.0:1716999786.381343:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8985 00000020:00080000:3.0:1716999786.381346:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999786.382649:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480641216 00000100:00100000:1.0:1716999786.382654:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480641216 00000100:00100000:2.0:1716999786.382664:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480641344 00000100:00100000:2.0:1716999786.382667:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480641344 00000100:00100000:1.0:1716999786.382674:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45088 00000100:00100000:1.0:1716999786.382678:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+573:11420:x1800404480641216:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:2.0:1716999786.382687:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45089 00010000:00010000:1.0:1716999786.382689:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1716999786.382690:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+573:11419:x1800404480641344:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.382695:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.382698:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc36e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f83 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.382701:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc36e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f8a expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.382730:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc36f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382737:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc36f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.382739:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc36f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.382743:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc36f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.382744:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc36f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc24:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.382749:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc36f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc24:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.382751:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc36fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382755:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc36fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00000004:00200000:2.0:1716999786.382757:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc24:0x0]: returning size 74834 00010000:00010000:1.0:1716999786.382760:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc36fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382795:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc36f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382800:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc36f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382804:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc36f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382808:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.382810:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc36f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382815:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc36f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.382819:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc36e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f8a expref: 577 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.382821:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.382837:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.382840:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc36f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.382842:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc36f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc24:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f8a expref: 576 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.382844:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc36f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.382848:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:2.0:1716999786.382850:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999786.382851:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9440, rc 0) 00010000:00010000:1.0:1716999786.382851:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc36fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382855:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc36fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382858:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc36fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382865:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.382867:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc36fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382871:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc36fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382876:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff88008a83f100) 00010000:00010000:1.0:1716999786.382897:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.382900:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc36fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382904:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc36fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.382932:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc36e2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f83 expref: 576 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.382937:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc36e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f83 expref: 576 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.382943:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c1318c0, rc 0) 00000100:00100000:1.0:1716999786.383122:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+575:11420:x1800404480641216:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 442us (567us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999786.383127:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480641344:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 436us (514us total) trans 4294985801 rc 0/0 00000100:00100000:1.0:1716999786.383127:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45088 00000100:00100000:2.0:1716999786.383132:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45089 00000100:00100000:2.0:1716999786.384909:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.385458:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.388079:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.388282:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480641600 00000100:00100000:3.0:1716999786.388288:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480641600 00000100:00100000:3.0:1716999786.388321:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9883 00000100:00100000:3.0:1716999786.388327:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+68:1958:x1800404480641600:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.388336:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.388347:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc372f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64f98 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999786.388362:0:15837:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x5f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999786.388373:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.388375:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.388380:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc372f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f98 expref: 69 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.388390:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc372f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f98 expref: 69 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.388398:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96400, rc 0) 00000100:00100000:1.0:1716999786.388401:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+72:1956:x1800404480641408:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 3350us (3494us total) trans 4294970116 rc 0/0 00000100:00100000:1.0:1716999786.388409:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1424 00000100:00100000:3.0:1716999786.388410:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+69:1958:x1800404480641600:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 84us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.388414:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9883 00002000:00100000:1.0:1716999786.388416:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x5f6:0x0] (0->74833) req@ffff880099bca680 x1800404480641408/t4294970116(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 488/448 e 0 to 0 dl 1716999797 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:1.0:1716999786.388424:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bca680 with x1800404480641408 ext(0->74833) 00002000:00010000:1.0:1716999786.388428:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bca680 00000100:00100000:2.0:1716999786.389784:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.389850:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.399656:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480641920 00000100:00100000:3.0:1716999786.399664:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480641920 00000100:00100000:3.0:1716999786.399692:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8986 00000100:00100000:3.0:1716999786.399699:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+576:11420:x1800404480641920:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999786.400483:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11338, 168 off2027776 00000001:00080000:3.0:1716999786.400488:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985803 00000100:00100000:3.0:1716999786.400571:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+578:11420:x1800404480641920:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 871us (1112us total) trans 4294985804 rc 0/0 00000100:00100000:3.0:1716999786.400578:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8986 00000020:00080000:3.0:1716999786.400581:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999786.402748:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.402771:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480642048 00000100:00100000:1.0:1716999786.402777:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480642048 00000100:00100000:1.0:1716999786.402804:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45092 00000100:00100000:1.0:1716999786.402811:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bafa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+578:11420:x1800404480642048:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.402822:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.402846:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc373d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64fa6 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.403083:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3744 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.403093:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3744 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc25:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.403100:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3744 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc25:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00200000:1.0:1716999786.403107:0:16641:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc25:0x0]: returning size 74834 00010000:00010000:1.0:1716999786.403172:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc373d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fa6 expref: 581 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.403181:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3744 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc25:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fa6 expref: 580 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.403187:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:1.0:1716999786.403190:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1716999786.403193:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133600, rc 0) 00000100:00100000:1.0:1716999786.403219:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bafa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+580:11420:x1800404480642048:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 409us (477us total) trans 4294985805 rc 0/0 00000100:00100000:1.0:1716999786.403224:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45092 00000100:00100000:2.0:1716999786.406586:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.406944:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480642112 00000100:00100000:1.0:1716999786.406951:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480642112 00002000:00100000:1.0:1716999786.406988:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5f7:0x0] (0->74833) req@ffff880099bc8e00 x1800404480642112/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 488/0 e 0 to 0 dl 1716999797 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:1.0:1716999786.406997:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bc8e00 with x1800404480642112 ext(0->74833) 00002000:00010000:1.0:1716999786.407001:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bc8e00 00000100:00100000:1.0:1716999786.407018:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1425 00000100:00100000:1.0:1716999786.407024:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+69:1958:x1800404480642112:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:2.0:1716999786.410555:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+71:1958:x1800404480642112:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 3525us (3966us total) trans 4294970153 rc 0/0 00000100:00100000:2.0:1716999786.410565:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1425 00002000:00100000:2.0:1716999786.410576:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5f7:0x0] (0->74833) req@ffff880099bc8e00 x1800404480642112/t4294970153(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 488/448 e 0 to 0 dl 1716999797 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.410586:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bc8e00 with x1800404480642112 ext(0->74833) 00002000:00010000:2.0:1716999786.410590:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bc8e00 00000100:00100000:2.0:1716999786.412618:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.412775:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480642176 00000100:00100000:1.0:1716999786.412783:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480642176 00000100:00100000:1.0:1716999786.412809:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45093 00000100:00100000:1.0:1716999786.412814:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+580:11420:x1800404480642176:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:3.0:1716999786.414389:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+580:11419:x1800404480641664:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 24385us (24602us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.414396:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45091 00000001:00080000:3.0:1716999786.414416:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985802 is committed 00000100:00100000:3.0:1716999786.416392:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000001:00080000:2.0:1716999786.440411:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985805 is committed 00000100:00100000:1.0:1716999786.447223:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.447374:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480642304 00000100:00100000:2.0:1716999786.447381:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480642304 00000100:00100000:2.0:1716999786.447409:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9886 00000100:00100000:2.0:1716999786.447415:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bafb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+71:1958:x1800404480642304:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:2.0:1716999786.492924:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.502284:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.502307:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480642496 00000100:00100000:2.0:1716999786.502313:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480642496 00000100:00100000:2.0:1716999786.502340:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45095 00000100:00100000:2.0:1716999786.502346:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+556:11419:x1800404480642496:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.502364:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.502376:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc3759 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64fad expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.502416:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc3759 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fad expref: 557 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.502425:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc3759 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc24:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fad expref: 557 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.502437:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:2.0:1716999786.502438:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1716999786.502440:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea1c0, rc 0) 00000100:00100000:2.0:1716999786.502474:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11419:x1800404480642496:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 128us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.502480:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45095 00000100:00100000:3.0:1716999786.508536:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.513628:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.513836:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bafb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+71:1958:x1800404480642304:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 66418us (66617us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.513845:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9886 00000001:00080000:3.0:1716999786.513897:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970152 is committed 00000001:00080000:3.0:1716999786.513907:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970153 is committed 00000100:00100000:3.0:1716999786.521243:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.521320:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.521479:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480642880 00000100:00100000:2.0:1716999786.521486:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480642880 00002000:00100000:2.0:1716999786.521519:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x5f6:0x0] (0->4095) req@ffff880091559500 x1800404480642880/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 4584/0 e 0 to 0 dl 1716999797 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.521529:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091559500 with x1800404480642880 ext(0->4095) 00002000:00010000:2.0:1716999786.521533:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091559500 00000100:00100000:2.0:1716999786.522112:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1426 00000100:00100000:2.0:1716999786.522119:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+70:1958:x1800404480642880:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:2.0:1716999786.522415:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+72:1958:x1800404480642880:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 295us (1094us total) trans 4294970118 rc 0/0 00000100:00100000:2.0:1716999786.522421:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1426 00002000:00100000:2.0:1716999786.522427:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x5f6:0x0] (0->4095) req@ffff880091559500 x1800404480642880/t4294970118(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 4584/448 e 0 to 0 dl 1716999797 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.522434:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091559500 with x1800404480642880 ext(0->4095) 00002000:00010000:2.0:1716999786.522437:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091559500 00000100:00100000:2.0:1716999786.522455:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480642816 00000100:00100000:2.0:1716999786.522459:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480642816 00000100:00100000:2.0:1716999786.522488:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45097 00000100:00100000:2.0:1716999786.522492:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11420:x1800404480642816:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999786.523121:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999786.523140:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3721 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f91 expref: 557 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.523351:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:2.0:1716999786.523356:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999786.523393:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3767 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.523402:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.523409:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999786.523618:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009155b100 reply state ffff88009a6df000 transno 4294985807 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999786.523624:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999786.523874:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480642816:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1379us (2637us total) trans 4294985807 rc 0/0 00000100:00100000:2.0:1716999786.523894:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45097 00000100:00100000:3.0:1716999786.526101:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.526135:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.526561:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480642944 00000100:00100000:2.0:1716999786.526567:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480642944 00000100:00100000:2.0:1716999786.526588:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480643008 00000100:00100000:2.0:1716999786.526589:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480643008 00000100:00100000:2.0:1716999786.526601:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45098 00000100:00100000:2.0:1716999786.526606:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480642944:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:2.0:1716999786.526668:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480642944:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 62us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.526674:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45098 00000100:00100000:2.0:1716999786.526683:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45099 00000100:00100000:2.0:1716999786.526686:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480643008:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.526694:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.526705:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc376e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64fb4 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.526728:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc376e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fb4 expref: 559 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.526735:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc376e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fb4 expref: 559 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.526744:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:2.0:1716999786.526746:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1716999786.526748:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eaf40, rc 0) 00000100:00100000:2.0:1716999786.526759:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11420:x1800404480643008:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 71us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.526763:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45099 00000100:00100000:2.0:1716999786.527732:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480643072 00000100:00100000:2.0:1716999786.527736:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480643072 00000100:00100000:2.0:1716999786.527759:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9888 00000100:00100000:2.0:1716999786.527764:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+72:1958:x1800404480643072:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:1.0:1716999786.530070:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.534119:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480643264 00000100:00100000:2.0:1716999786.534127:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480643264 00000100:00100000:2.0:1716999786.534159:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45100 00000100:00100000:2.0:1716999786.534165:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480643264:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:2.0:1716999786.534207:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3775 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.534220:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.534228:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.534246:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3775 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.534250:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3775 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.534255:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3775 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.534260:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.534263:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3775 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.534268:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3775 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.534276:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:2.0:1716999786.534279:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1716999786.534282:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3775 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.534286:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3775 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999786.534345:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091295500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480643264:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 180us (1563us total) trans 0 rc -22/-22 00000100:00100000:2.0:1716999786.534352:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45100 00000100:00100000:1.0:1716999786.540019:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.540107:0:8347:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480643328 00000100:00100000:2.0:1716999786.540115:0:8347:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480643328 00002000:00100000:2.0:1716999786.540146:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5f7:0x0] (0->4095) req@ffff88012baf9f80 x1800404480643328/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 4584/0 e 0 to 0 dl 1716999797 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.540155:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baf9f80 with x1800404480643328 ext(0->4095) 00002000:00010000:2.0:1716999786.540160:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baf9f80 00000100:00100000:2.0:1716999786.540187:0:8347:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1427 00000100:00100000:2.0:1716999786.540194:0:8347:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+69:1959:x1800404480643328:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:2.0:1716999786.540469:0:8347:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+71:1959:x1800404480643328:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 274us (454us total) trans 4294970155 rc 0/0 00000100:00100000:2.0:1716999786.540475:0:8347:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1427 00002000:00100000:2.0:1716999786.540480:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5f7:0x0] (0->4095) req@ffff88012baf9f80 x1800404480643328/t4294970155(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 4584/448 e 0 to 0 dl 1716999797 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.540487:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012baf9f80 with x1800404480643328 ext(0->4095) 00002000:00010000:2.0:1716999786.540490:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012baf9f80 00000100:00100000:1.0:1716999786.545422:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.545992:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480643392 00000100:00100000:2.0:1716999786.546000:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480643392 00000100:00100000:2.0:1716999786.546033:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45101 00000100:00100000:2.0:1716999786.546040:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bafbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480643392:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:2.0:1716999786.546133:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bafbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480643392:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 93us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.546140:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45101 00000100:00100000:1.0:1716999786.550013:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.550251:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480643456 00000100:00100000:2.0:1716999786.550258:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480643456 00000100:00100000:2.0:1716999786.550345:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9890 00000100:00100000:2.0:1716999786.550352:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+71:1958:x1800404480643456:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:3.0:1716999786.578664:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091296d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+69:1958:x1800404480643072:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 50893us (50988us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.578674:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9888 00000100:00100000:1.0:1716999786.584777:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.589857:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.590089:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480643648 00000100:00100000:2.0:1716999786.590096:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480643648 00000100:00100000:2.0:1716999786.590126:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45103 00000100:00100000:2.0:1716999786.590133:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480643648:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999786.590168:0:16641:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999786.590187:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3791 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fbb expref: 559 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.590203:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:2.0:1716999786.590206:0:16641:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999786.590230:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3798 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.590238:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.590245:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00010000:2.0:1716999786.590472:0:16641:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bcb480 reply state ffff88013201e000 transno 4294985808 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:2.0:1716999786.590479:0:16641:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999786.590545:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+560:11419:x1800404480643648:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 411us (693us total) trans 4294985808 rc 0/0 00000100:00100000:2.0:1716999786.590551:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45103 00010000:00010000:0.0:1716999786.593816:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3798 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000100:00100000:2.0:1716999786.593982:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480643712 00000100:00100000:2.0:1716999786.593989:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480643712 00000100:00100000:2.0:1716999786.594015:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9891 00000100:00100000:2.0:1716999786.594021:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+69:1959:x1800404480643712:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:2.0:1716999786.594198:0:15837:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5f6:0x0] updating lvb size from disk: 74834 -> 74834 00002000:00010000:2.0:1716999786.594201:0:15837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5f6:0x0] updating lvb mtime from disk: 1716999774 -> 1716999775 00002000:00010000:2.0:1716999786.594203:0:15837:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5f6:0x0] updating lvb atime from disk: 1716999776 -> 1716999766 00002000:00010000:2.0:1716999786.594205:0:15837:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5f6:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:2.0:1716999786.594207:0:15837:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5f6:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:2.0:1716999786.594238:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+70:1959:x1800404480643712:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 216us (514us total) trans 4294970119 rc 0/0 00000100:00100000:2.0:1716999786.594244:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9891 00000100:00100000:0.0:1716999786.595830:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.595852:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480643840 00000100:00100000:0.0:1716999786.595857:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480643840 00000100:00100000:0.0:1716999786.595895:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45104 00000100:00100000:0.0:1716999786.595901:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480643840:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:0.0:1716999786.595938:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc379f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.595949:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc379f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.595957:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc379f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.595974:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc379f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.595979:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc379f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.595983:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc379f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.595988:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.595991:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc379f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.596106:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc379f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.596115:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:0.0:1716999786.596118:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1716999786.596120:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc379f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.596125:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc379f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999786.596282:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480643840:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 379us (529us total) trans 0 rc -22/-22 00000100:00100000:0.0:1716999786.596288:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45104 00000100:00100000:2.0:1716999786.598121:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.598138:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480643904 00000100:00100000:2.0:1716999786.598143:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480643904 00000100:00100000:2.0:1716999786.598296:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45105 00000100:00100000:2.0:1716999786.598302:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480643904:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.598314:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.598327:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc37a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64fc2 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.598429:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc37ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598439:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc37ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598447:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc37ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598455:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc37b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598461:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc37b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598466:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc37b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598542:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc37bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598547:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc37bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598552:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc37bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00200000:2.0:1716999786.598571:0:16641:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc24:0x0]: returning size 74834 00000004:00200000:2.0:1716999786.598573:0:16641:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999786.598584:0:16641:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc37bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598590:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc37bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598596:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc37ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598601:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc37ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598606:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc37ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598611:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.598613:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc37ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598619:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc37ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598626:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.598628:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.598631:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc37ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598635:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc37ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598643:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc37b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598647:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc37b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598652:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc37b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598655:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.598658:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc37b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598662:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc37b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598668:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88012bf53000) 00010000:00010000:2.0:1716999786.598670:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.598672:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc37b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598676:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc37b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.598695:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc37a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fc2 expref: 561 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.598704:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc37bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fc2 expref: 560 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.598710:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:2.0:1716999786.598712:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999786.598713:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ebcc0, rc 0) 00000100:00100000:2.0:1716999786.598748:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+560:11419:x1800404480643904:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 445us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.598754:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45105 00000100:00100000:1.0:1716999786.601491:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.601536:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480643968 00000100:00100000:2.0:1716999786.601542:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480643968 00000100:00100000:2.0:1716999786.601562:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45106 00000100:00100000:2.0:1716999786.601566:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bafaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+560:11419:x1800404480643968:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.601577:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.601587:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc37c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64fc9 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.601618:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc37c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601627:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc37c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601631:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc37c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601640:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc37d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601643:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc37d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601645:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc37d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601709:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc37d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601713:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc37d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601715:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc37d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00200000:2.0:1716999786.601730:0:16641:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc21:0x0]: returning size 74402 00000004:00200000:2.0:1716999786.601732:0:16641:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999786.601740:0:16641:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc37d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601746:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc37d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601749:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc37c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601752:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc37c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601755:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc37c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601761:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e98c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.601763:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc37c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601766:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc37c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601772:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.601773:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.601775:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc37c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601777:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc37c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601783:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc37d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601786:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc37d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601788:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc37d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601790:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.601792:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc37d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601794:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc37d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601797:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01f5e8 (ffff88012bf53800) 00010000:00010000:2.0:1716999786.601798:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.601799:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc37d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601802:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc37d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.601814:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc37c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fc9 expref: 562 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.601820:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc37d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fc9 expref: 561 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.601837:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff88009208be00) 00010000:00010000:2.0:1716999786.601839:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999786.601841:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8900, rc 0) 00000100:00100000:2.0:1716999786.601876:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bafaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+561:11419:x1800404480643968:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 309us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.601901:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45106 00000100:00100000:0.0:1716999786.603783:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.603938:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480644096 00000100:00100000:3.0:1716999786.603945:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480644096 00000100:00100000:3.0:1716999786.603973:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8987 00000100:00100000:3.0:1716999786.603978:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+561:11419:x1800404480644096:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999786.604284:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11339, 168 off2027944 00000001:00080000:3.0:1716999786.604290:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985809 00000100:00100000:3.0:1716999786.604355:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480644096:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 376us (575us total) trans 4294985810 rc 0/0 00000100:00100000:3.0:1716999786.604361:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8987 00000020:00080000:3.0:1716999786.604365:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:2.0:1716999786.605327:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970154 is committed 00000001:00080000:2.0:1716999786.605341:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970155 is committed 00000100:00100000:3.0:1716999786.605500:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+68:1958:x1800404480643456:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 55147us (55490us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.605508:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9890 00000100:00100000:2.0:1716999786.605730:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.605745:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480644224 00000100:00100000:0.0:1716999786.605752:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480644224 00000100:00100000:0.0:1716999786.605775:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45107 00000100:00100000:0.0:1716999786.605779:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480644224:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999786.605810:0:16641:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999786.605839:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc37d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc21:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fc9 expref: 563 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.605854:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc342d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc21:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64eb1 expref: 562 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.605864:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc33ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc21:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64eaa expref: 561 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.605872:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff88009208be00) 00010000:00010000:0.0:1716999786.605897:0:16641:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999786.605917:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc37de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.605931:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc37de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.605938:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc37de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.605948:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc37e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.605952:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc37e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.605957:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc37e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606194:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc37ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606201:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc37ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606206:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc37ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000040:00080000:0.0:1716999786.606623:0:16641:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1473, 64 off102528 00000040:00080000:0.0:1716999786.606640:0:16641:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11340, 184 off2028128 00010000:00010000:0.0:1716999786.606688:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc37f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606695:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc37f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606701:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc37f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606711:0:16641:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc37f3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606715:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc37f3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606720:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc37f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606725:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc37f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606730:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999786.606733:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc37f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606738:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc37f3 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606746:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff8800a5c6ec00) 00010000:00010000:0.0:1716999786.606748:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999786.606751:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc37f3 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606754:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc37f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc21:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606771:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc37ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606776:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc37ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606780:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc37ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606784:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddb00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.606786:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc37ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606791:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc37ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606797:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc21:0x0].0x0 (ffff8800a5c6ec00) 00010000:00010000:0.0:1716999786.606890:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999786.606893:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc37ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606896:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc37ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc21:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606927:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc37de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606932:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc37de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606935:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc37de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606939:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.606941:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc37de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606946:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc37de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606952:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999786.606954:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.606956:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc37de lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.606961:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc37de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000004:00010000:0.0:1716999786.606967:0:16641:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bc9c00 reply state ffff8800925de000 transno 4294985811 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc37e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:0.0:1716999786.606973:0:16641:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999786.607017:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+562:11419:x1800404480644224:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1236us (1286us total) trans 4294985811 rc 0/0 00000100:00100000:0.0:1716999786.607022:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45107 00000100:00100000:2.0:1716999786.607351:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.607403:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480644288 00000100:00100000:0.0:1716999786.607407:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480644288 00000100:00100000:0.0:1716999786.607426:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45108 00000100:00100000:0.0:1716999786.607431:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+562:11420:x1800404480644288:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.607440:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.607448:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc37fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64fd0 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.607480:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3801 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607486:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3801 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607492:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3801 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607501:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3808 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607509:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607514:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607578:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc380f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607585:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc380f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607591:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc380f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00200000:0.0:1716999786.607608:0:16641:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc25:0x0]: returning size 74834 00000004:00200000:0.0:1716999786.607611:0:16641:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999786.607623:0:16641:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc380f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607630:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc380f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607635:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3801 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607639:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3801 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607642:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3801 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607646:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.607648:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3801 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607653:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3801 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607659:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:0.0:1716999786.607661:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.607663:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3801 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607667:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3801 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607673:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3808 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607677:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3808 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607681:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607684:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdfcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.607686:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3808 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607689:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3808 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607694:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff8800a5c6e000) 00010000:00010000:0.0:1716999786.607695:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.607697:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3808 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607700:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3808 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.607717:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc37fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fd0 expref: 564 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.607726:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc380f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fd0 expref: 563 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.607731:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:0.0:1716999786.607733:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999786.607735:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcfc0, rc 0) 00000100:00100000:0.0:1716999786.608385:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+563:11420:x1800404480644288:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 952us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.608391:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45108 00000100:00100000:1.0:1716999786.610311:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999786.610396:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc37e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.610404:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc37e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.610409:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc37e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.610414:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.610417:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc37e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.610422:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc37e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.610433:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01f5e8 (ffff8800a5c6eb00) 00010000:00010000:0.0:1716999786.610436:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.610439:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc37e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.610443:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc37e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000100:00100000:2.0:1716999786.610547:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480644352 00000100:00100000:2.0:1716999786.610554:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480644352 00000100:00100000:2.0:1716999786.610578:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45109 00000100:00100000:2.0:1716999786.610583:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bafb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+562:11419:x1800404480644352:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.610598:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.610608:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3816 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64fd7 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.610644:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc381d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.610653:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc381d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.610660:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc381d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.610669:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3824 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x449ca6a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.610674:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.610679:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.610975:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc381d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.610981:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc381d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.610985:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc381d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.610989:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.610991:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc381d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.610996:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc381d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.611006:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.611008:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.611010:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc381d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.611014:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc381d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.611020:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3824 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.611025:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3824 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.611029:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.611033:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eba80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.611035:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3824 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.611040:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3824 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.611044:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x449ca6a3 (ffff88012bf53700) 00010000:00010000:2.0:1716999786.611046:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.611047:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3824 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.611051:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3824 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.611080:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3816 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fd7 expref: 563 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.611087:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3816 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fd7 expref: 563 pid: 16641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999786.611088:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999786.611093:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea400, rc 0) 00000100:00100000:1.0:1716999786.611166:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480644480 00000100:00100000:1.0:1716999786.611171:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480644480 00000100:00100000:2.0:1716999786.611178:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bafb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480644352:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 594us (871us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999786.611184:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45109 00000100:00100000:2.0:1716999786.611260:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45110 00000100:00100000:2.0:1716999786.611265:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+562:11420:x1800404480644480:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999786.611348:0:16641:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999786.611360:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc380f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fd0 expref: 562 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.611370:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:2.0:1716999786.611373:0:16641:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999786.611393:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc382b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.611399:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc382b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.611405:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc382b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00010000:2.0:1716999786.611782:0:16641:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880091295c00 reply state ffff880091f8e000 transno 4294985812 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc382b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:2.0:1716999786.611789:0:16641:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999786.611850:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+563:11420:x1800404480644480:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 583us (760us total) trans 4294985812 rc 0/0 00000100:00100000:2.0:1716999786.611855:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45110 00000100:00100000:0.0:1716999786.612364:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.612437:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480644544 00000100:00100000:2.0:1716999786.612441:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480644544 00000100:00100000:2.0:1716999786.612467:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45111 00000100:00100000:2.0:1716999786.612472:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480644544:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.612480:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.612488:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc3832 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64fde expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.612503:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc3832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fde expref: 564 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.612512:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc3832 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fde expref: 564 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.612517:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.612520:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.612521:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8fc0, rc 0) 00000100:00100000:2.0:1716999786.612542:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480644544:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 69us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.612547:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45111 00010000:00010000:2.0:1716999786.612847:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc382b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.612853:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc382b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.612858:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc382b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.612863:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.612866:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc382b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.612870:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc382b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.612902:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:2.0:1716999786.612905:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.612908:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc382b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.612912:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc382b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000100:00100000:2.0:1716999786.613100:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.613430:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480644608 00000100:00100000:3.0:1716999786.613434:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480644608 00000100:00100000:3.0:1716999786.613492:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9892 00000100:00100000:3.0:1716999786.613496:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+68:1958:x1800404480644608:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:3.0:1716999786.613646:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5f7:0x0] updating lvb size from disk: 74834 -> 74834 00002000:00010000:3.0:1716999786.613649:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5f7:0x0] updating lvb mtime from disk: 1716999774 -> 1716999775 00002000:00010000:3.0:1716999786.613650:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5f7:0x0] updating lvb atime from disk: 1716999776 -> 1716999766 00002000:00010000:3.0:1716999786.613652:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5f7:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:3.0:1716999786.613654:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5f7:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:3.0:1716999786.614172:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+69:1958:x1800404480644608:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 674us (1071us total) trans 4294970156 rc 0/0 00000100:00100000:3.0:1716999786.614180:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9892 00000100:00100000:0.0:1716999786.614336:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.614431:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480644672 00000100:00100000:2.0:1716999786.614435:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480644672 00000100:00100000:2.0:1716999786.614578:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8988 00000100:00100000:2.0:1716999786.614584:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480644672:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999786.615873:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.615972:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480644800 00000100:00100000:3.0:1716999786.615978:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480644800 00000100:00100000:3.0:1716999786.616047:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45112 00000100:00100000:3.0:1716999786.616053:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bafb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480644800:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:3.0:1716999786.616088:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3839 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.616103:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.616112:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.616266:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3839 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.616272:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3839 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.616277:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3839 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.616282:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.616285:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3839 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.616291:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3839 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.616300:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:3.0:1716999786.616303:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999786.616306:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3839 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.616311:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3839 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999786.616560:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bafb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480644800:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 506us (689us total) trans 0 rc -22/-22 00000100:00100000:3.0:1716999786.616566:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45112 00000100:00100000:0.0:1716999786.617416:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480644672:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2829us (3077us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.617424:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8988 00000100:00100000:1.0:1716999786.617810:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.617890:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480644864 00000100:00100000:3.0:1716999786.617895:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480644864 00000100:00100000:3.0:1716999786.617923:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45113 00000100:00100000:3.0:1716999786.617928:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+563:11420:x1800404480644864:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.617937:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.617948:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3840 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64fe5 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.617985:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3847 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.617993:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3847 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.617998:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3847 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618007:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc384e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618011:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc384e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618015:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc384e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618097:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3855 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618102:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618106:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:3.0:1716999786.618124:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc25:0x0]: returning size 74834 00000004:00200000:3.0:1716999786.618127:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999786.618137:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618143:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3855 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618147:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3847 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618151:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3847 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618155:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618159:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.618162:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3847 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618166:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3847 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618172:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999786.618174:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.618176:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3847 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618180:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3847 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618188:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc384e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618192:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc384e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618196:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc384e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618198:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.618200:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc384e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618204:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc384e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618208:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff880135ac4200) 00010000:00010000:3.0:1716999786.618209:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.618211:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc384e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618214:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc384e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.618230:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3840 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fe5 expref: 565 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.618237:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3855 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fe5 expref: 564 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.618242:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:3.0:1716999786.618243:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999786.618245:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94240, rc 0) 00000100:00100000:3.0:1716999786.618279:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+564:11420:x1800404480644864:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 349us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.618284:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45113 00000100:00100000:1.0:1716999786.619198:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.619252:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480644928 00000100:00100000:2.0:1716999786.619257:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480644928 00000100:00100000:2.0:1716999786.619276:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45114 00000100:00100000:2.0:1716999786.619280:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012baf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480644928:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.619288:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.619297:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc385c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64fec expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.619323:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3863 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619330:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3863 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619337:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3863 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619344:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc386a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x7d62c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619350:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc386a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619355:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc386a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619396:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3863 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619401:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3863 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619406:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3863 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619409:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.619412:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3863 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619416:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3863 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619423:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.619425:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.619427:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3863 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619431:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc3863 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619436:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc386a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619440:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc386a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619444:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc386a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619448:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.619450:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc386a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619454:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc386a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619458:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x7d62c0d (ffff88012bf53600) 00010000:00010000:2.0:1716999786.619460:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.619462:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc386a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619466:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc386a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.619491:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc385c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fec expref: 565 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.619497:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc385c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fec expref: 565 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.619503:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8900, rc 0) 00000100:00100000:2.0:1716999786.619538:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012baf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480644928:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 256us (340us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999786.619543:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45114 00000100:00100000:2.0:1716999786.620517:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.620575:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480644992 00000100:00100000:0.0:1716999786.620579:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480644992 00000100:00100000:0.0:1716999786.620599:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45115 00000100:00100000:0.0:1716999786.620604:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+564:11420:x1800404480644992:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.620613:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.620623:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3871 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64ff3 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.620648:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3878 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620655:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3878 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620661:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3878 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620670:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc387f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620679:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc387f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620684:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc387f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620755:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3886 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620762:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620767:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:0.0:1716999786.620787:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc20:0x0]: returning size 74402 00000004:00200000:0.0:1716999786.620790:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999786.620799:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620805:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3886 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620811:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3878 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620815:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3878 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620820:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3878 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620838:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdfcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.620841:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3878 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620846:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3878 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620853:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:0.0:1716999786.620855:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.620857:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3878 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620861:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3878 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620870:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc387f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620874:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc387f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620907:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc387f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620911:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.620913:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc387f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620917:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc387f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620923:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01f5e8 (ffff8800a5c6e000) 00010000:00010000:0.0:1716999786.620925:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.620927:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc387f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620932:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc387f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.620950:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3871 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ff3 expref: 566 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.620959:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3886 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ff3 expref: 565 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.620964:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:0.0:1716999786.620966:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999786.620968:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf180, rc 0) 00000100:00100000:0.0:1716999786.620996:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480644992:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 392us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.621002:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45115 00000100:00100000:1.0:1716999786.622981:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.623038:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480645120 00000100:00100000:0.0:1716999786.623043:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480645120 00000100:00100000:0.0:1716999786.623075:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8989 00000100:00100000:0.0:1716999786.623080:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480645120:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999786.623387:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11341, 168 off2028296 00000001:00080000:0.0:1716999786.623391:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985813 00000100:00100000:0.0:1716999786.623454:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480645120:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 374us (476us total) trans 4294985814 rc 0/0 00000100:00100000:0.0:1716999786.623461:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8989 00000020:00080000:0.0:1716999786.623464:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999786.624229:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.624270:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480645248 00000100:00100000:2.0:1716999786.624274:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480645248 00000100:00100000:2.0:1716999786.624303:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45116 00000100:00100000:2.0:1716999786.624308:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+567:11419:x1800404480645248:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999786.624329:0:16641:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999786.624345:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc37bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fc2 expref: 567 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.624356:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:2.0:1716999786.624359:0:16641:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999786.624381:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc388d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.624391:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc388d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.624398:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc388d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00010000:2.0:1716999786.624550:0:16641:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135028a80 reply state ffff880135ae4000 transno 4294985815 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc388d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:1.0:1716999786.624554:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.624556:0:16641:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999786.624591:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480645376 00000100:00100000:0.0:1716999786.624595:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480645376 00000100:00100000:2.0:1716999786.624605:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480645248:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 296us (376us total) trans 4294985815 rc 0/0 00000100:00100000:2.0:1716999786.624610:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45116 00000100:00100000:0.0:1716999786.624616:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45117 00000100:00100000:0.0:1716999786.624621:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+568:11420:x1800404480645376:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999786.624641:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999786.624650:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3886 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc20:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ff3 expref: 568 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.624661:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc343b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc20:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64eb8 expref: 567 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.624670:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc33cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc20:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e95 expref: 566 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.624676:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff88009330d200) 00010000:00010000:0.0:1716999786.624682:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999786.624694:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3894 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.624700:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3894 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.624706:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3894 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.624715:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc389b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.624720:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc389b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.624724:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc389b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.624870:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc38a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.624914:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc38a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.624921:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc38a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:0.0:1716999786.625389:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1470, 64 off102336 00000040:00080000:0.0:1716999786.625406:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11342, 184 off2028480 00010000:00010000:0.0:1716999786.625448:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc38a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625454:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc38a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625460:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc38a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625465:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc38a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625469:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc38a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625473:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc38a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625478:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc38a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625482:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcd80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999786.625485:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc38a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625490:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc38a9 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625497:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff8800a5c6ec00) 00010000:00010000:0.0:1716999786.625499:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999786.625502:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc38a9 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625506:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc38a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc20:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625523:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc38a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625527:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc38a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625532:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc38a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625535:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.625536:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc38a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625540:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc38a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625545:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc20:0x0].0x0 (ffff8800a5c6ec00) 00010000:00010000:0.0:1716999786.625547:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999786.625549:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc38a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625553:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc38a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc20:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625642:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3894 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625648:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3894 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625652:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3894 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625656:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddb00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.625658:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3894 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625662:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3894 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625669:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:0.0:1716999786.625671:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.625673:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3894 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.625677:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3894 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999786.625751:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135029c00 reply state ffff8800925df000 transno 4294985816 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc389b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999786.625756:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999786.625835:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc388d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.625841:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc388d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.625845:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc388d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.625849:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.625851:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc388d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.625855:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc388d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.625861:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:2.0:1716999786.625863:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.625866:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc388d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.625870:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc388d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000100:00100000:0.0:1716999786.625943:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+566:11420:x1800404480645376:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1320us (1387us total) trans 4294985816 rc 0/0 00000100:00100000:0.0:1716999786.625950:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45117 00000100:00100000:3.0:1716999786.626578:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.626859:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480645440 00000100:00100000:0.0:1716999786.626863:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480645440 00000100:00100000:0.0:1716999786.626910:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9893 00000100:00100000:0.0:1716999786.626916:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+70:1959:x1800404480645440:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999786.627023:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5f6:0x0] updating lvb size from disk: 74834 -> 74834 00002000:00010000:0.0:1716999786.627026:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5f6:0x0] updating lvb mtime from disk: 1716999775 -> 1716999763 00002000:00010000:0.0:1716999786.627028:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5f6:0x0] updating lvb atime from disk: 1716999766 -> 1716999777 00002000:00010000:0.0:1716999786.627030:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5f6:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:0.0:1716999786.627032:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5f6:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:0.0:1716999786.627054:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+71:1959:x1800404480645440:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 138us (476us total) trans 4294970120 rc 0/0 00000100:00100000:0.0:1716999786.627059:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9893 00010000:00010000:2.0:1716999786.627264:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc389b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.627271:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc389b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.627276:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc389b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.627281:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.627283:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc389b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.627288:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc389b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.627296:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01f5e8 (ffff8800a5c6e500) 00010000:00010000:2.0:1716999786.627298:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.627300:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc389b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.627304:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc389b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01f5e8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999786.628446:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.628480:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.628525:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480645504 00000100:00100000:2.0:1716999786.628529:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480645504 00000100:00100000:2.0:1716999786.628555:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480645568 00000100:00100000:2.0:1716999786.628557:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480645568 00000100:00100000:2.0:1716999786.628570:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45118 00000100:00100000:3.0:1716999786.628575:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45119 00000100:00100000:2.0:1716999786.628575:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+566:11419:x1800404480645504:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:3.0:1716999786.628579:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+566:11420:x1800404480645568:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.628589:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.628594:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.628599:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc38b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f64ffa expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.628600:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc38b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65001 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.628629:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc38c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628629:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc38be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628637:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc38c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628637:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc38be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628644:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc38c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628645:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc38be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628653:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc38cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x449ca6a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628653:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc38d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628658:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc38cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628658:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc38d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.628662:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc38d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628663:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc38cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.628700:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc38c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628700:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc38be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628705:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc38c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628705:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc38be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.628709:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc38be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628712:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc38c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628713:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.628715:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc38be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628716:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.628718:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc38c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628720:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc38be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628722:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc38c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628726:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999786.628727:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999786.628728:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.628728:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.628730:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc38c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628730:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc38be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628734:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc38c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628734:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc38be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628740:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc38cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628740:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc38d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628745:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc38cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628745:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc38d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628749:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc38cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628749:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc38d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628753:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.628753:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.628754:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc38d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628755:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc38cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628758:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc38d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628759:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc38cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628763:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01e3f1 (ffff88012bf53700) 00010000:00010000:3.0:1716999786.628764:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x449ca6a3 (ffff880135ac4e00) 00010000:00010000:2.0:1716999786.628764:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.628766:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.628766:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc38d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628767:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc38cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.628770:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc38d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.628771:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc38cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x449ca6a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.628798:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc38b7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65001 expref: 568 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.628798:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc38b0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ffa expref: 568 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.628804:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc38b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65001 expref: 568 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.628804:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc38b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ffa expref: 568 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.628810:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8240, rc 0) 00010000:00010000:3.0:1716999786.628811:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95d40, rc 0) 00000100:00100000:3.0:1716999786.628844:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+566:11420:x1800404480645568:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 263us (362us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999786.628844:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+566:11419:x1800404480645504:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 268us (399us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.628849:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45119 00000100:00100000:2.0:1716999786.628851:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45118 00000100:00100000:3.0:1716999786.630197:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.630530:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.630595:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480645696 00000100:00100000:2.0:1716999786.630600:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480645696 00000100:00100000:2.0:1716999786.630618:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480645760 00000100:00100000:2.0:1716999786.630620:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480645760 00000100:00100000:2.0:1716999786.630635:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45120 00000100:00100000:2.0:1716999786.630640:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+566:11420:x1800404480645696:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.630650:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.630659:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc38da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65008 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.630676:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc38da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65008 expref: 567 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.630685:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc38da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65008 expref: 567 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.630690:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999786.630693:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.630696:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea880, rc 0) 00000100:00100000:2.0:1716999786.630730:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480645696:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 89us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.630736:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45120 00000100:00100000:2.0:1716999786.630748:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45121 00000100:00100000:2.0:1716999786.630751:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880090680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+566:11419:x1800404480645760:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.630759:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.630761:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1716999786.630771:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc3832 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fde expref: 566 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.630779:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.630782:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999786.630786:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc38e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6500f expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.630990:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc38e8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.630998:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc38e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631004:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc38e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631013:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc38ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631018:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc38ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631023:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc38ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:2.0:1716999786.631435:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f7:0x0], index 0: 0 00000040:00080000:2.0:1716999786.631495:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11343, 184 off2028664 00010000:00010000:2.0:1716999786.631581:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc38f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631591:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc38f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631597:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc38f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631617:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc38e8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631622:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc38e8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631627:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc38e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631631:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.631633:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc38e8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631638:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc38e8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631645:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.631647:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.631649:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc38e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.631653:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc38e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999786.631660:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880090680000 reply state ffff880135ae7000 transno 4294985817 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc38ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999786.631668:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999786.631684:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc38e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6500f expref: 568 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.631691:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc38f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc26:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6500f expref: 567 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.631696:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc26:0x0].0x0 (ffff88012bf53000) 00010000:00010000:2.0:1716999786.631698:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999786.631700:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea400, rc 0) 00000100:00100000:2.0:1716999786.632033:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880090680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+568:11419:x1800404480645760:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1279us (1502us total) trans 4294985817 rc 0/0 00000100:00100000:2.0:1716999786.632039:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45121 00000100:00100000:3.0:1716999786.632851:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999786.632939:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc38ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.632949:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc38ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.632953:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc38ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.632957:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.632960:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc38ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.632964:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc38ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.632972:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01e3f1 (ffff88012bf53800) 00010000:00010000:2.0:1716999786.632974:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.632977:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc38ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.632981:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc38ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999786.633037:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480645824 00000100:00100000:0.0:1716999786.633042:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480645824 00000100:00100000:0.0:1716999786.633061:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8990 00000100:00100000:0.0:1716999786.633066:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480645824:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999786.633421:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.633588:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480645888 00000100:00100000:2.0:1716999786.633592:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480645888 00000100:00100000:2.0:1716999786.633618:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9894 00000100:00100000:2.0:1716999786.633622:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+71:1956:x1800404480645888:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.633629:0:19195:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.633639:0:19195:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3904 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65016 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999786.633706:0:19195:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999786.633718:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999786.633720:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999786.633726:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3904 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65016 expref: 72 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999786.633735:0:19195:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3904 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65016 expref: 72 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999786.633743:0:19195:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eba80, rc 0) 00000100:00100000:2.0:1716999786.633801:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+72:1956:x1800404480645888:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 177us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.633807:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9894 00000100:00100000:3.0:1716999786.635013:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.635141:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480646016 00000100:00100000:2.0:1716999786.635145:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480646016 00000100:00100000:2.0:1716999786.635246:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8991 00000100:00100000:2.0:1716999786.635251:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+568:11419:x1800404480646016:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999786.635274:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+568:11420:x1800404480645824:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2206us (2422us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.635279:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8990 00000040:00080000:2.0:1716999786.635709:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11344, 168 off2028832 00000001:00080000:2.0:1716999786.635714:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985818 00000100:00100000:2.0:1716999786.635800:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480646016:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 547us (787us total) trans 4294985819 rc 0/0 00000100:00100000:2.0:1716999786.635805:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8991 00000020:00080000:2.0:1716999786.635808:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999786.637286:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.637329:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.637384:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480646208 00000100:00100000:0.0:1716999786.637384:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480646080 00000100:00100000:2.0:1716999786.637388:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480646208 00000100:00100000:0.0:1716999786.637388:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480646080 00000100:00100000:2.0:1716999786.637416:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45122 00000100:00100000:2.0:1716999786.637421:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480646208:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:0.0:1716999786.637458:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45123 00000100:00100000:0.0:1716999786.637463:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480646080:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.637470:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.637482:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc390b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6501d expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.637515:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3912 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637526:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3912 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637533:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3912 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637542:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3919 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x7d62c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637547:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637552:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.637564:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999786.637576:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc38f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc26:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6500f expref: 571 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.637585:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc26:0x0].0x0 (ffff88012bf53000) 00010000:00010000:2.0:1716999786.637590:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999786.637590:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3912 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637595:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3912 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637599:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3912 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.637602:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3920 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.637604:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.637607:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3912 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.637608:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3920 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.637612:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3912 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.637613:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3920 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.637618:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:0.0:1716999786.637619:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.637620:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3927 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.637622:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3912 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.637625:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3927 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.637626:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3912 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.637630:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3927 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.637635:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3919 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637638:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3919 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637642:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3919 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637646:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.637648:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3919 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637652:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3919 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637657:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x7d62c0d (ffff880092624000) 00010000:00010000:0.0:1716999786.637658:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.637660:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3919 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.637663:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3919 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x7d62c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:2.0:1716999786.637684:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc392e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc26:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.637684:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc390b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6501d expref: 570 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.637689:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc392e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.637690:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc390b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6501d expref: 570 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.637694:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc392e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.637696:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd8c0, rc 0) 00000100:00100000:0.0:1716999786.637720:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480646080:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 256us (435us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.637724:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45123 00000040:00080000:2.0:1716999786.638187:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1471, 64 off102400 00000040:00080000:2.0:1716999786.638204:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11345, 184 off2029016 00010000:00010000:2.0:1716999786.638246:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3935 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc26:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638252:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638258:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638264:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3935 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638268:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3935 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638272:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3935 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638280:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3935 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638284:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e98c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999786.638285:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3935 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638289:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3935 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638295:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc26:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:2.0:1716999786.638297:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999786.638299:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3935 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638303:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3935 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc26:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638316:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc392e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638321:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc392e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638325:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc392e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638329:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.638331:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc392e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638336:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc392e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638344:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc26:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:2.0:1716999786.638346:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999786.638347:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc392e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638351:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc392e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc26:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638379:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3920 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638383:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3920 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638387:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3920 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638391:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.638394:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3920 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638398:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3920 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638403:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.638404:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.638406:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3920 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.638410:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3920 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999786.638416:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099445500 reply state ffff880135ae0000 transno 4294985820 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3927 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999786.638422:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999786.638463:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480646208:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1040us (1133us total) trans 4294985820 rc 0/0 00000100:00100000:2.0:1716999786.638469:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45122 00000100:00100000:3.0:1716999786.639859:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999786.639937:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3927 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.639944:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3927 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.639949:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3927 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.639953:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.639956:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3927 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.639961:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3927 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.639970:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01e3f1 (ffff88009ab4a800) 00010000:00010000:2.0:1716999786.639972:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.639974:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3927 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.639979:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3927 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999786.640244:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480646272 00000100:00100000:0.0:1716999786.640249:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480646272 00000100:00100000:0.0:1716999786.640280:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45124 00000100:00100000:0.0:1716999786.640286:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a68f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480646272:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.640298:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.640306:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc393c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65024 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.640337:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3943 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640344:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3943 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640351:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3943 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640359:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc394a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640364:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc394a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640369:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc394a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640432:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3951 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640439:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640444:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:0.0:1716999786.640464:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc24:0x0]: returning size 74834 00000004:00200000:0.0:1716999786.640467:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999786.640475:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640482:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640487:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3943 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640492:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3943 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640496:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3943 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640500:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.640503:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3943 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640507:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3943 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640513:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999786.640515:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.640518:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3943 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640522:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3943 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640529:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc394a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640534:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc394a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640539:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc394a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640543:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.640545:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc394a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640549:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc394a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640554:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff880092624500) 00010000:00010000:0.0:1716999786.640556:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.640558:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc394a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640562:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc394a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.640579:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc393c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65024 expref: 571 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.640591:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3951 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65024 expref: 570 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.640596:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:0.0:1716999786.640598:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999786.640600:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdeac0, rc 0) 00000100:00100000:0.0:1716999786.640637:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a68f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480646272:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 350us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.640643:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45124 00000100:00100000:1.0:1716999786.642063:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.642144:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480646400 00000100:00100000:0.0:1716999786.642149:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480646400 00000100:00100000:0.0:1716999786.642182:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45125 00000100:00100000:0.0:1716999786.642187:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480646400:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999786.642211:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999786.642223:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3855 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fe5 expref: 570 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.642233:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:0.0:1716999786.642236:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999786.642256:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3958 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.642263:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3958 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.642269:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3958 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999786.642538:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135029180 reply state ffff88008e4d0000 transno 4294985821 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3958 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999786.642544:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999786.642546:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.642640:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480646464 00000100:00100000:1.0:1716999786.642643:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480646464 00000100:00100000:1.0:1716999786.642659:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45126 00000100:00100000:1.0:1716999786.642663:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a68f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+572:11419:x1800404480646464:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.642670:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.642676:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc395f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6502b expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.642698:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3966 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642704:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3966 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642709:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3966 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642716:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc396d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642721:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc396d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642729:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc396d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642760:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3966 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642763:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3966 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642768:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3966 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642772:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.642775:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3966 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642779:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3966 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642784:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.642786:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.642788:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3966 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642792:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3966 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642802:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc396d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642805:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc396d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642812:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc396d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642815:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.642817:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc396d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642835:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc396d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642841:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01e3f1 (ffff88009240ec00) 00010000:00010000:1.0:1716999786.642842:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.642844:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc396d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642848:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc396d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999786.642869:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc395f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6502b expref: 573 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.642875:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc395f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6502b expref: 573 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.642899:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131440, rc 0) 00000100:00100000:0.0:1716999786.642954:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+572:11420:x1800404480646400:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 765us (891us total) trans 4294985821 rc 0/0 00000100:00100000:0.0:1716999786.642959:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45125 00000100:00100000:1.0:1716999786.643246:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a68f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480646464:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 580us (699us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999786.643251:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45126 00010000:00010000:2.0:1716999786.644499:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3958 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.644506:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3958 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.644512:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3958 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.644516:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.644518:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3958 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999786.644520:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999786.644524:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3958 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.644533:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:2.0:1716999786.644535:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.644537:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3958 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.644542:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3958 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999786.644921:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.644971:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480646592 00000100:00100000:0.0:1716999786.644976:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480646592 00000100:00100000:0.0:1716999786.644997:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45127 00000100:00100000:0.0:1716999786.645006:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480646592:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.645018:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.645027:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3974 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65032 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999786.645031:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480646528 00000100:00100000:3.0:1716999786.645034:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480646528 00010000:00010000:0.0:1716999786.645042:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65032 expref: 571 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.645051:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3974 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65032 expref: 571 pid: 11055 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999786.645052:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9895 00000100:00100000:3.0:1716999786.645055:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+69:1958:x1800404480646528:12345-192.168.203.3@tcp:2:dbench.0 00010000:00010000:0.0:1716999786.645057:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999786.645059:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.645061:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc000, rc 0) 00000100:00100000:0.0:1716999786.645101:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480646592:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 98us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.645106:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45127 00002000:00010000:3.0:1716999786.645215:0:19195:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5f7:0x0] updating lvb size from disk: 74834 -> 74834 00002000:00010000:3.0:1716999786.645218:0:19195:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5f7:0x0] updating lvb mtime from disk: 1716999775 -> 1716999763 00002000:00010000:3.0:1716999786.645220:0:19195:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5f7:0x0] updating lvb atime from disk: 1716999766 -> 1716999777 00002000:00010000:3.0:1716999786.645221:0:19195:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5f7:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:3.0:1716999786.645223:0:19195:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5f7:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:3.0:1716999786.645239:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+70:1958:x1800404480646528:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 182us (719us total) trans 4294970157 rc 0/0 00000100:00100000:3.0:1716999786.645244:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9895 00000100:00100000:2.0:1716999786.647162:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.647205:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.647261:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480646720 00000100:00100000:1.0:1716999786.647267:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480646720 00000100:00100000:1.0:1716999786.647289:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45128 00000100:00100000:1.0:1716999786.647295:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+571:11420:x1800404480646720:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.647305:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.647321:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc397b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65039 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999786.647332:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480646656 00000100:00100000:3.0:1716999786.647335:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480646656 00000100:00100000:3.0:1716999786.647353:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8992 00010000:00010000:1.0:1716999786.647356:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3982 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00000100:00100000:3.0:1716999786.647357:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+573:11419:x1800404480646656:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:1.0:1716999786.647365:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3982 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647371:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3982 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647380:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3989 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647385:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647389:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647435:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3982 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647439:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3982 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647450:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3982 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647454:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.647457:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3982 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647461:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3982 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647469:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.647470:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.647473:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3982 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647476:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3982 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647483:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3989 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647487:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3989 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647491:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3989 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647494:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.647495:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3989 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647499:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3989 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647503:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01e3f1 (ffff88009240ef00) 00010000:00010000:1.0:1716999786.647505:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.647507:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3989 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647511:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3989 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.647535:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc397b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65039 expref: 573 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.647540:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc397b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65039 expref: 573 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.647545:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130480, rc 0) 00000100:00100000:1.0:1716999786.647569:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+572:11420:x1800404480646720:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 275us (364us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999786.647573:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45128 00000100:00100000:3.0:1716999786.649515:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480646656:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2151us (2351us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.649524:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8992 00000100:00100000:0.0:1716999786.650497:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.650640:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480646848 00000100:00100000:1.0:1716999786.650646:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480646848 00000100:00100000:1.0:1716999786.650708:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45129 00000100:00100000:1.0:1716999786.650714:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+571:11420:x1800404480646848:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.650726:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.650728:0:16641:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999786.650746:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc38da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65008 expref: 571 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.650756:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.650760:0:16641:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.650769:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3990 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65040 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.650892:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3997 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.650902:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3997 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.650908:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3997 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.650917:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc399e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.650921:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc399e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.650926:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc399e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00080000:1.0:1716999786.651304:0:16641:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f8:0x0], index 1: 0 00000040:00080000:1.0:1716999786.651363:0:16641:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11346, 184 off2029200 00010000:00010000:1.0:1716999786.651449:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc39a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.651456:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc39a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.651462:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc39a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.651484:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3997 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.651488:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3997 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.651493:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3997 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.651496:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.651498:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3997 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.651503:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3997 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.651510:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.651511:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.651514:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3997 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.651518:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3997 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000004:00010000:1.0:1716999786.651524:0:16641:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880091297100 reply state ffff880099963000 transno 4294985822 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc399e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:1.0:1716999786.651530:0:16641:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999786.651546:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3990 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65040 expref: 573 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.651553:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc39a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65040 expref: 572 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.651558:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc27:0x0].0x0 (ffff88009240ec00) 00010000:00010000:1.0:1716999786.651560:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999786.651561:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132d00, rc 0) 00000100:00100000:1.0:1716999786.652606:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+573:11420:x1800404480646848:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1889us (2107us total) trans 4294985822 rc 0/0 00000100:00100000:1.0:1716999786.652613:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45129 00000100:00100000:2.0:1716999786.652755:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.652812:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480646912 00000100:00100000:1.0:1716999786.652816:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480646912 00000100:00100000:1.0:1716999786.652854:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45130 00000100:00100000:1.0:1716999786.652859:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+573:11419:x1800404480646912:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.652868:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.652972:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc39b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65047 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.653002:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc39ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653011:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc39ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653017:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc39ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653027:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc39c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653032:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc39c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653037:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc39c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653083:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc39ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653091:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc39ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653096:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc39ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653099:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.653101:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc39ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653106:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc39ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653113:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.653115:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.653117:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc39ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653121:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc39ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653130:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc39c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653135:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc39c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653138:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc39c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653142:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.653143:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc39c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653151:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc39c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653157:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01e3f1 (ffff88009240e300) 00010000:00010000:1.0:1716999786.653158:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.653160:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc39c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653164:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc39c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.653192:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc39b3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65047 expref: 574 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.653199:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc39b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65047 expref: 574 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.653207:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133a80, rc 0) 00000100:00100000:1.0:1716999786.653239:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+573:11419:x1800404480646912:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 380us (485us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999786.653245:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45130 00010000:00010000:3.0:1716999786.654695:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc399e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.654702:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc399e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.654706:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc399e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.654710:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.654713:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc399e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.654718:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc399e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.654727:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01e3f1 (ffff88009240e500) 00010000:00010000:3.0:1716999786.654729:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.654731:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc399e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.654735:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc399e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000100:00100000:3.0:1716999786.655515:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.655571:0:6836:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480647040 00000100:00100000:0.0:1716999786.655577:0:6836:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480647040 00000100:00100000:2.0:1716999786.655592:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.655612:0:6836:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 600 00000100:00100000:0.0:1716999786.655618:0:6836:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+572:11419:x1800404480647040:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999786.655647:0:6836:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999786.655658:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3951 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65024 expref: 572 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.655670:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:0.0:1716999786.655677:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3974 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65032 expref: 571 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.655687:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999786.655690:0:6836:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999786.655729:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc39c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.655739:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc39c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00000100:00100000:3.0:1716999786.655744:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480647104 00010000:00010000:0.0:1716999786.655744:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc39c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:3.0:1716999786.655747:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480647104 00010000:00010000:0.0:1716999786.655754:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc39cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.655758:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc39cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.655763:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc39cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:3.0:1716999786.655776:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9896 00010000:00010000:0.0:1716999786.655777:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc39d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00000100:00100000:3.0:1716999786.655780:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+70:1959:x1800404480647104:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.655782:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc39d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.655786:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc39d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999786.655787:0:19195:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.655796:0:19195:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc39dd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6504e expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999786.655810:0:19195:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x5f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999786.655833:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.655835:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.655840:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc39dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6504e expref: 71 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.655850:0:19195:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc39dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6504e expref: 71 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.655861:0:19195:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97600, rc 0) 00010000:00010000:0.0:1716999786.655873:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc39e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.655900:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc39e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.655907:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc39e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:3.0:1716999786.656070:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+71:1959:x1800404480647104:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 288us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.656076:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9896 00000040:00080000:0.0:1716999786.656196:0:6836:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11347, 224 off2029424 00000004:00010000:0.0:1716999786.656263:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b3480 reply state ffff88008e4d7000 transno 4294985823 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc39e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999786.656269:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:0.0:1716999786.656272:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b3480 reply state ffff88008e4d7000 transno 4294985823 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc39d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999786.656276:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1716999786.656278:0:6836:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc39c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.656282:0:6836:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc39c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.656287:0:6836:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc39c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.656291:0:6836:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.656294:0:6836:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc39c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.656299:0:6836:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc39c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.656306:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999786.656308:0:6836:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.656310:0:6836:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc39c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.656314:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc39c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000004:00010000:0.0:1716999786.656321:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b3480 reply state ffff88008e4d7000 transno 4294985823 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc39cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999786.656325:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1716999786.656434:0:6836:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+572:11419:x1800404480647040:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 814us (920us total) trans 4294985823 rc 0/0 00000100:00100000:0.0:1716999786.656439:0:6836:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 600 00010000:00010000:0.0:1716999786.657564:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc39cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657572:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc39cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657576:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc39cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657580:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.657583:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc39cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657588:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc39cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657597:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff8800941a3400) 00010000:00010000:0.0:1716999786.657599:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.657601:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc39cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657605:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc39cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657615:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc39d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657620:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc39d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657624:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc39d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657628:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.657630:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc39d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657634:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc39d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657640:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01e3f1 (ffff8800941a3300) 00010000:00010000:0.0:1716999786.657642:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.657644:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc39d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657651:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc39d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657658:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc39e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657662:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc39e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657666:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc39e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657670:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.657672:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc39e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657676:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc39e4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657681:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:0.0:1716999786.657683:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1716999786.657686:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc39e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.657690:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc39e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999786.657789:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.657841:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.657907:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480647296 00000100:00100000:1.0:1716999786.657912:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480647296 00000100:00100000:1.0:1716999786.657936:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45131 00000100:00100000:1.0:1716999786.657941:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480647296:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.657953:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.657962:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc39eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65055 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.657996:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc39f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658004:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc39f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658010:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc39f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658017:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc39f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658021:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc39f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658026:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc39f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:3.0:1716999786.658051:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480647232 00000100:00100000:3.0:1716999786.658054:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480647232 00010000:00010000:1.0:1716999786.658064:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc39f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658068:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc39f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658072:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc39f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658076:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.658078:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc39f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658082:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc39f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00000100:00100000:3.0:1716999786.658083:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8993 00000100:00100000:3.0:1716999786.658088:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+573:11420:x1800404480647232:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:1.0:1716999786.658090:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.658092:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.658094:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc39f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658098:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc39f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658105:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc39f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658108:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc39f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658112:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc39f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658115:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.658117:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc39f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658120:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc39f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658125:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009240ea00) 00010000:00010000:1.0:1716999786.658127:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.658128:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc39f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658132:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc39f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.658156:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc39eb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65055 expref: 573 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.658163:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc39eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65055 expref: 573 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.658169:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131d40, rc 0) 00000100:00100000:1.0:1716999786.658195:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+573:11419:x1800404480647296:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 253us (354us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999786.658201:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45131 00000040:00080000:3.0:1716999786.658416:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11348, 168 off2029592 00000001:00080000:3.0:1716999786.658421:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985824 00000100:00100000:3.0:1716999786.658470:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+573:11420:x1800404480647232:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 381us (682us total) trans 4294985825 rc 0/0 00000100:00100000:3.0:1716999786.658475:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8993 00000020:00080000:3.0:1716999786.658478:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999786.659651:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.659728:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480647360 00000100:00100000:1.0:1716999786.659732:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480647360 00000100:00100000:1.0:1716999786.659961:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45132 00000100:00100000:1.0:1716999786.659967:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+573:11419:x1800404480647360:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.659979:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.659989:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3a00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6505c expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.660007:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3a00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6505c expref: 574 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.660016:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3a00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6505c expref: 574 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.660021:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.660023:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.660026:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131f80, rc 0) 00000100:00100000:1.0:1716999786.660054:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480647360:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 88us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.660062:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45132 00000100:00100000:2.0:1716999786.660091:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.660103:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480647488 00000100:00100000:1.0:1716999786.660106:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480647488 00000100:00100000:1.0:1716999786.660128:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45133 00000100:00100000:1.0:1716999786.660132:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+574:11420:x1800404480647488:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999786.660152:0:16641:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999786.660162:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc39a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc27:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65040 expref: 574 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.660172:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc27:0x0].0x0 (ffff88009240ec00) 00010000:00010000:1.0:1716999786.660177:0:16641:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.660190:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3a07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660196:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3a07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660202:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3a07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660210:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3a0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660215:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660220:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660287:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3a15 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660293:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3a15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660298:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3a15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000040:00080000:1.0:1716999786.660689:0:16641:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1474, 64 off102592 00000040:00080000:1.0:1716999786.660705:0:16641:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11349, 184 off2029776 00010000:00010000:1.0:1716999786.660746:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3a1c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc27:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660753:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3a1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660759:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3a1c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660764:0:16641:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3a1c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660769:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3a1c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660774:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3a1c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660779:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3a1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660783:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999786.660785:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3a1c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660790:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3a1c lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660796:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc27:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999786.660798:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999786.660801:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3a1c lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660805:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3a1c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc27:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660820:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3a15 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660837:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3a15 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660841:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3a15 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660845:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.660848:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3a15 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660852:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3a15 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660857:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc27:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999786.660859:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999786.660861:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3a15 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660865:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3a15 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc27:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660925:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3a07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660931:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3a07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660935:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3a07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660939:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.660941:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3a07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660945:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3a07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660951:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.660952:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.660954:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3a07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.660958:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3a07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000004:00010000:1.0:1716999786.660964:0:16641:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f779f80 reply state ffff880099962000 transno 4294985826 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000100:00100000:1.0:1716999786.660969:0:16641:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999786.661007:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+575:11420:x1800404480647488:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 873us (916us total) trans 4294985826 rc 0/0 00000100:00100000:1.0:1716999786.661013:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45133 00000100:00100000:3.0:1716999786.661676:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.661808:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480647552 00000100:00100000:0.0:1716999786.661813:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480647552 00000100:00100000:0.0:1716999786.661845:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8994 00000100:00100000:0.0:1716999786.661850:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480647552:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999786.662250:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999786.662286:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.662293:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3a0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.662298:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3a0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.662302:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.662305:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3a0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.662313:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3a0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.662321:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01e3f1 (ffff88009240e900) 00010000:00010000:3.0:1716999786.662323:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.662326:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3a0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:3.0:1716999786.662330:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3a0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00000100:00100000:1.0:1716999786.662388:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480647616 00000100:00100000:1.0:1716999786.662392:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480647616 00000100:00100000:1.0:1716999786.662410:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45134 00000100:00100000:1.0:1716999786.662415:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+575:11420:x1800404480647616:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.662427:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.662439:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc3a23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65063 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.662470:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3a2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662477:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3a2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662483:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3a2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662492:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3a31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662497:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3a31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662502:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3a31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662569:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3a38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662575:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662581:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00000004:00200000:1.0:1716999786.662600:0:16641:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc25:0x0]: returning size 74834 00000004:00200000:1.0:1716999786.662602:0:16641:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999786.662611:0:16641:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662618:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3a38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662622:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3a2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662626:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3a2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662630:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3a2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662634:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.662636:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3a2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662640:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3a2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662646:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.662648:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.662650:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3a2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662654:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3a2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662666:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3a31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662671:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3a31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662675:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3a31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662679:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.662681:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3a31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662686:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3a31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662690:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff88009240ef00) 00010000:00010000:1.0:1716999786.662692:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.662694:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3a31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662698:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3a31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.662715:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc3a23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65063 expref: 577 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.662723:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3a38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65063 expref: 576 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.662729:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:1.0:1716999786.662730:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999786.662733:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133cc0, rc 0) 00000100:00100000:1.0:1716999786.663143:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+576:11420:x1800404480647616:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 726us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.663149:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45134 00000100:00100000:1.0:1716999786.666554:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480647552:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4696us (4873us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.666567:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8994 00000100:00100000:3.0:1716999786.667278:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.667773:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480647680 00000100:00100000:1.0:1716999786.667780:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480647680 00000100:00100000:1.0:1716999786.667808:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45135 00000100:00100000:1.0:1716999786.667814:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+575:11420:x1800404480647680:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.667924:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.667939:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3a3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6506a expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.667983:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3a46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.667993:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3a46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668001:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3a46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668012:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3a4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668018:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3a4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668023:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3a4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668074:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3a46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668081:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3a46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668086:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3a46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668091:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.668094:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3a46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668100:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3a46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668108:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.668110:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.668113:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3a46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668118:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3a46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668127:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3a4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668131:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3a4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668136:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3a4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668139:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.668141:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3a4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668144:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3a4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668148:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01e3f1 (ffff88009240e300) 00010000:00010000:1.0:1716999786.668149:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.668150:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3a4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:1.0:1716999786.668153:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3a4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.668251:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3a3f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6506a expref: 576 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.668260:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3a3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6506a expref: 576 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.668295:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130240, rc 0) 00000100:00100000:0.0:1716999786.668369:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+575:11420:x1800404480647680:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 554us (1091us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.668375:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45135 00000100:00100000:2.0:1716999786.669448:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.669492:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480647808 00000100:00100000:0.0:1716999786.669497:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480647808 00000100:00100000:0.0:1716999786.669523:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45136 00000100:00100000:0.0:1716999786.669528:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480647808:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.669535:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.669543:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3a54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65071 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.669590:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3a5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669598:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3a5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669605:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3a5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669612:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3a62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669617:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669622:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669644:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3a5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669649:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3a5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669654:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3a5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669658:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.669661:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3a5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669665:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3a5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669671:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999786.669673:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.669676:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3a5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669680:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3a5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669687:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3a62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669691:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3a62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669699:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3a62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669703:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.669705:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3a62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669709:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3a62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669713:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88012ecfab00) 00010000:00010000:0.0:1716999786.669715:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.669717:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3a62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669721:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3a62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.669734:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3a54 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65071 expref: 576 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.669740:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3a54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65071 expref: 576 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.669745:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde400, rc 0) 00000100:00100000:0.0:1716999786.669804:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480647808:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 275us (357us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.669809:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45136 00000100:00100000:1.0:1716999786.672535:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.672614:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.672708:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480647872 00000100:00100000:0.0:1716999786.672715:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480647872 00000100:00100000:0.0:1716999786.672741:0:16641:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480647936 00000100:00100000:0.0:1716999786.672744:0:16641:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480647936 00000100:00100000:0.0:1716999786.672769:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45137 00000100:00100000:0.0:1716999786.672775:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+576:11420:x1800404480647872:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.672789:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.672802:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3a69 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65078 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.672833:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65078 expref: 577 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.672843:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3a69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65078 expref: 577 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.672850:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:0.0:1716999786.672852:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.672855:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf840, rc 0) 00000100:00100000:0.0:1716999786.672906:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480647872:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 131us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.672913:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45137 00000100:00100000:0.0:1716999786.672926:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45138 00000100:00100000:0.0:1716999786.672930:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480647936:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.672936:0:16641:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.672943:0:16641:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3a70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6507f expref: -99 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.672974:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3a77 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.672985:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3a77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.672991:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3a77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.672999:0:16641:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3a7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673004:0:16641:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3a7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673008:0:16641:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3a7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673057:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3a77 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673062:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3a77 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673066:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3a77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673071:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.673074:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3a77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673079:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3a77 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673086:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999786.673088:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.673091:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3a77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673095:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3a77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673103:0:16641:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3a7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673107:0:16641:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3a7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673111:0:16641:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3a7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673114:0:16641:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcd80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.673115:0:16641:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3a7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673120:0:16641:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3a7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673124:0:16641:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009330da00) 00010000:00010000:0.0:1716999786.673125:0:16641:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.673127:0:16641:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3a7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673130:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3a7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16641 initiator: MDT0 00010000:00010000:0.0:1716999786.673160:0:16641:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3a70 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6507f expref: 577 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.673165:0:16641:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3a70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6507f expref: 577 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.673172:0:16641:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bddb00, rc 0) 00000100:00100000:0.0:1716999786.673188:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480647936:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 257us (575us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.673194:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45138 00000100:00100000:3.0:1716999786.674676:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.674712:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.674720:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480648000 00000100:00100000:1.0:1716999786.674726:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480648000 00000100:00100000:2.0:1716999786.674749:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480648128 00000100:00100000:2.0:1716999786.674753:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480648128 00000100:00100000:1.0:1716999786.674762:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8995 00000100:00100000:1.0:1716999786.674770:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480648000:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999786.674773:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45139 00000100:00100000:2.0:1716999786.674776:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480648128:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.674782:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.674784:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1716999786.674794:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3a00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6505c expref: 577 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.674803:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.674805:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999786.674810:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3a85 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65086 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.674912:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3a8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.674921:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3a8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.674927:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3a8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.674935:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3a93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.674940:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3a93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.674944:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3a93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:2.0:1716999786.675377:0:11055:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f8:0x0], index 0: 0 00000040:00080000:2.0:1716999786.675430:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11350, 184 off2029960 00010000:00010000:2.0:1716999786.675511:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3a9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.675518:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3a9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.675523:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3a9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.675542:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3a8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.675546:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3a8c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.675550:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3a8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.675555:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.675558:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3a8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.675562:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3a8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.675569:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.675571:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.675573:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3a8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.675577:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3a8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999786.675584:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b0a80 reply state ffff880135ae3000 transno 4294985827 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3a93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999786.675593:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999786.675608:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3a85 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65086 expref: 579 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.675615:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3a9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65086 expref: 578 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.675620:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:2.0:1716999786.675621:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999786.675623:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ead00, rc 0) 00000100:00100000:2.0:1716999786.675666:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+579:11419:x1800404480648128:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 889us (953us total) trans 4294985827 rc 0/0 00000100:00100000:2.0:1716999786.675672:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45139 00010000:00010000:0.0:1716999786.676667:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3a93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.676675:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3a93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.676681:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3a93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.676685:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.676687:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3a93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.676692:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3a93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.676700:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009ab4a800) 00010000:00010000:0.0:1716999786.676703:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.676705:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3a93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.676709:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3a93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999786.677550:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.677703:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480648192 00000100:00100000:3.0:1716999786.677709:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480648192 00000100:00100000:3.0:1716999786.677742:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9897 00000100:00100000:3.0:1716999786.677748:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480648192:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.677759:0:19195:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.677775:0:19195:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3aa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6508d expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999786.677791:0:19195:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999786.677804:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.677806:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.677811:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6508d expref: 73 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.677830:0:19195:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6508d expref: 73 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.677840:0:19195:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96880, rc 0) 00000100:00100000:3.0:1716999786.677875:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480648192:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 126us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.677900:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9897 00000100:00100000:1.0:1716999786.678951:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480648000:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4181us (4274us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.678959:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8995 00000100:00100000:2.0:1716999786.680609:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.680656:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480648256 00000100:00100000:3.0:1716999786.680662:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480648256 00000100:00100000:3.0:1716999786.680694:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9898 00000100:00100000:3.0:1716999786.680700:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+73:11419:x1800404480648256:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.680710:0:19195:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.680721:0:19195:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65094 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.680743:0:19195:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3aa8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6508d expref: 74 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.680749:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.680750:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.680753:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65094 expref: 74 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.680775:0:19195:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6508d expref: 74 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.680783:0:19195:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3aa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6508d expref: 74 pid: 19195 timeout: 405 lvb_type: 1 00000100:00100000:3.0:1716999786.680798:0:19195:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800917b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19195:1800404483006784:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999786.681150:0:19195:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800914b39c0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999786.681445:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.681463:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480648320 00000100:00100000:0.0:1716999786.681467:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480648320 00000100:00100000:0.0:1716999786.681522:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45140 00000100:00100000:0.0:1716999786.681527:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480648320:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.681538:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.681548:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3ab6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6509b expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.681583:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3abd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681592:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3abd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681600:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3abd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681608:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3ac4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681613:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681618:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681669:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3abd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681673:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3abd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681678:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3abd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681686:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddd40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.681689:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3abd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681695:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3abd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681703:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:0.0:1716999786.681705:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.681708:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3abd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681712:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3abd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681720:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681724:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3ac4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681728:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681732:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.681734:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681738:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681743:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01e3f1 (ffff88009330d100) 00010000:00010000:0.0:1716999786.681745:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.681747:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3ac4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681751:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd440/0x6d188eabd8dc3ac4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.681780:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3ab6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6509b expref: 578 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.681787:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3ab6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6509b expref: 578 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.681792:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf180, rc 0) 00000100:00100000:0.0:1716999786.681837:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480648320:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 308us (392us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.681842:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45140 00000100:00100000:3.0:1716999786.682876:0:19195:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800917b2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19195:1800404483006784:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999786.682913:0:19195:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65094 expref: 74 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.682922:0:19195:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95680, rc 0) 00000100:00100000:3.0:1716999786.682957:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+74:11419:x1800404480648256:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2256us (2350us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.682962:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9898 00000100:00100000:2.0:1716999786.684378:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.684448:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.684462:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480648384 00000100:00100000:0.0:1716999786.684466:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480648384 00010000:00010000:0.0:1716999786.684482:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3aa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6508d expref: 74 pid: 19195 timeout: 405 lvb_type: 1 00000100:00100000:0.0:1716999786.684496:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4498 00000100:00100000:0.0:1716999786.684500:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+74:1958:x1800404480648384:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999786.684506:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999786.684518:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3aa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6508d expref: 74 pid: 19195 timeout: 405 lvb_type: 1 00010000:00010000:0.0:1716999786.684524:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3aa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6508d expref: 74 pid: 19195 timeout: 405 lvb_type: 1 00010000:00010000:0.0:1716999786.684536:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3aa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6508d expref: 74 pid: 19195 timeout: 405 lvb_type: 1 00010000:00010000:0.0:1716999786.684544:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999786.684545:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999786.684548:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65094 expref: 73 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.684553:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65094 expref: 73 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.684574:0:25864:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65094 expref: 73 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999786.684581:0:25864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091297480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:25864:1800404483006848:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999786.684605:0:6836:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480648512 00000100:00100000:1.0:1716999786.684609:0:6836:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480648512 00000100:00100000:0.0:1716999786.684612:0:25864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219d80 going to sleep for 11 seconds 00000100:00100000:1.0:1716999786.684632:0:6836:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 601 00000100:00100000:1.0:1716999786.684637:0:6836:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480648512:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999786.684662:0:6836:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999786.684675:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc3a38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65063 expref: 577 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.684700:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:1.0:1716999786.684709:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3a69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65078 expref: 576 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.684718:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.684720:0:6836:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.684765:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc3acb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.684774:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc3acb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.684781:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc3acb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.684791:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3ad2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.684796:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.684801:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.684814:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3ad9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.684819:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.684840:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.684937:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3ae0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.684944:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3ae0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.684950:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3ae0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000040:00080000:1.0:1716999786.685291:0:6836:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11351, 224 off2030184 00000004:00010000:1.0:1716999786.685354:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f77bb80 reply state ffff8801350c9000 transno 4294985828 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3ae0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999786.685359:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1716999786.685360:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f77bb80 reply state ffff8801350c9000 transno 4294985828 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999786.685363:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1716999786.685364:0:6836:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc3acb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.685367:0:6836:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc3acb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.685370:0:6836:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc3acb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.685373:0:6836:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.685375:0:6836:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc3acb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.685379:0:6836:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc3acb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.685383:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999786.685384:0:6836:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.685386:0:6836:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc3acb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999786.685391:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc3acb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000004:00010000:1.0:1716999786.685395:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f77bb80 reply state ffff8801350c9000 transno 4294985828 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999786.685397:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1716999786.685435:0:6836:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480648512:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 796us (986us total) trans 4294985828 rc 0/0 00000100:00100000:1.0:1716999786.685441:0:6836:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 601 00000100:00100000:0.0:1716999786.685613:0:25864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091297480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:25864:1800404483006848:192.168.203.3@tcp:105: 00010000:00010000:0.0:1716999786.685623:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999786.685637:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+73:1958:x1800404480648384:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1136us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.685642:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4498 00010000:00010000:0.0:1716999786.686196:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3ad2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686202:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3ad2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686210:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3ad2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686214:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.686216:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3ad2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686219:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3ad2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686224:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff88009240e400) 00010000:00010000:0.0:1716999786.686226:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.686227:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3ad2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686230:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc3ad2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686240:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3ad9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686245:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3ad9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686248:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3ad9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686252:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.686254:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3ad9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686259:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3ad9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686264:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01e3f1 (ffff88009240eb00) 00010000:00010000:0.0:1716999786.686266:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.686268:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3ad9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686271:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc3ad9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686278:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3ae0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686283:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3ae0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686287:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3ae0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686290:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.686292:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3ae0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686297:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3ae0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686302:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:0.0:1716999786.686304:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1716999786.686306:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3ae0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999786.686311:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc3ae0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000100:00100000:3.0:1716999786.686524:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.686660:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480648576 00000100:00100000:0.0:1716999786.686666:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480648576 00000100:00100000:0.0:1716999786.686698:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45141 00000100:00100000:0.0:1716999786.686704:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+576:11420:x1800404480648576:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.686715:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.686724:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ae7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650a2 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.686754:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3aee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686761:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3aee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686767:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3aee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686776:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3af5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686781:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3af5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686786:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3af5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999786.686809:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999786.686839:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3aee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686844:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3aee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686848:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3aee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686856:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.686858:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3aee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686863:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3aee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686869:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:0.0:1716999786.686871:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.686874:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3aee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686892:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3aee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686899:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3af5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686904:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3af5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686908:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3af5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686912:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcfc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.686914:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3af5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686919:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3af5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686924:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff88009330d200) 00010000:00010000:0.0:1716999786.686927:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.686929:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3af5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.686932:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3af5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999786.686934:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480648704 00000100:00100000:1.0:1716999786.686937:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480648704 00010000:00010000:0.0:1716999786.686964:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ae7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650a2 expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999786.686965:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8996 00000100:00100000:1.0:1716999786.686970:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+578:11419:x1800404480648704:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:0.0:1716999786.686971:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ae7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650a2 expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.686977:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdfcc0, rc 0) 00000100:00100000:0.0:1716999786.687009:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480648576:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 305us (487us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.687015:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45141 00000040:00080000:1.0:1716999786.687382:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11352, 168 off2030352 00000001:00080000:1.0:1716999786.687386:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985829 00000100:00100000:1.0:1716999786.687441:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+578:11419:x1800404480648704:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 470us (631us total) trans 4294985830 rc 0/0 00000100:00100000:1.0:1716999786.687450:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8996 00000020:00080000:1.0:1716999786.687454:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999786.688223:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.688238:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480648768 00000100:00100000:0.0:1716999786.688242:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480648768 00000100:00100000:0.0:1716999786.688264:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45142 00000100:00100000:0.0:1716999786.688268:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+578:11420:x1800404480648768:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.688276:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.688284:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3afc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650a9 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.688298:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3afc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650a9 expref: 579 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.688306:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3afc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650a9 expref: 579 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.688312:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:0.0:1716999786.688314:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.688316:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde640, rc 0) 00000100:00100000:0.0:1716999786.688338:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480648768:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 69us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.688417:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45142 00000100:00100000:2.0:1716999786.689217:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.689270:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480648896 00000100:00100000:0.0:1716999786.689275:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480648896 00000100:00100000:0.0:1716999786.689302:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45143 00000100:00100000:0.0:1716999786.689307:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+579:11419:x1800404480648896:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.689317:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.689325:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3b03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650b0 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.689422:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3b0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.689430:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3b0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc28:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.689436:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3b0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc28:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:0.0:1716999786.689446:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc28:0x0]: returning size 77076 00000100:00100000:3.0:1716999786.689449:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.689500:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480648960 00000100:00100000:1.0:1716999786.689504:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480648960 00010000:00010000:0.0:1716999786.689513:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3b03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650b0 expref: 583 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.689524:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3b0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc28:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650b0 expref: 582 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999786.689528:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8997 00010000:00010000:0.0:1716999786.689529:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:0.0:1716999786.689531:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00000100:00100000:1.0:1716999786.689532:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+582:11420:x1800404480648960:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:0.0:1716999786.689533:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf180, rc 0) 00000100:00100000:0.0:1716999786.689553:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+582:11419:x1800404480648896:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 245us (336us total) trans 4294985831 rc 0/0 00000100:00100000:0.0:1716999786.689558:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45143 00000100:00100000:3.0:1716999786.691389:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.691640:0:8347:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480649024 00000100:00100000:2.0:1716999786.691646:0:8347:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480649024 00002000:00100000:2.0:1716999786.691669:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5f8:0x0] (0->77075) req@ffff8800917b0700 x1800404480649024/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 488/0 e 0 to 0 dl 1716999797 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.691682:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800917b0700 with x1800404480649024 ext(0->77075) 00002000:00010000:2.0:1716999786.691686:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800917b0700 00000100:00100000:2.0:1716999786.691709:0:8347:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1428 00000100:00100000:2.0:1716999786.691714:0:8347:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480649024:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:1.0:1716999786.692442:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+581:11420:x1800404480648960:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2907us (2990us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.692449:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8997 00000100:00100000:2.0:1716999786.693728:0:8347:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+75:1959:x1800404480649024:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 2010us (2339us total) trans 4294970121 rc 0/0 00000100:00100000:2.0:1716999786.693735:0:8347:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1428 00002000:00100000:2.0:1716999786.693742:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5f8:0x0] (0->77075) req@ffff8800917b0700 x1800404480649024/t4294970121(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 488/448 e 0 to 0 dl 1716999797 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.693749:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff8800917b0700 with x1800404480649024 ext(0->77075) 00002000:00010000:2.0:1716999786.693753:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800917b0700 00000100:00100000:0.0:1716999786.694250:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.694314:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480649152 00000100:00100000:2.0:1716999786.694318:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480649152 00000100:00100000:2.0:1716999786.694350:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45144 00000100:00100000:2.0:1716999786.694355:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+581:11420:x1800404480649152:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.694368:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.694380:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650b7 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.694462:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3b1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694472:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3b1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694480:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3b1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694489:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3b26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694494:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3b26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694501:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3b26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694527:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3b1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694532:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3b1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694536:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3b1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694541:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.694544:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3b1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694549:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3b1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694557:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999786.694560:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.694563:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3b1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694567:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3b1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694786:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3b26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694791:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3b26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694795:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3b26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694800:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.694802:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3b26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694807:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3b26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694813:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff88009ab4a700) 00010000:00010000:2.0:1716999786.694815:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.694817:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3b26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694834:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3b26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.694855:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b18 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650b7 expref: 582 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.694861:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650b7 expref: 582 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.694866:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb600, rc 0) 00000100:00100000:2.0:1716999786.694913:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+581:11420:x1800404480649152:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 557us (663us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999786.694918:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45144 00000100:00100000:3.0:1716999786.695047:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.695087:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480649216 00000100:00100000:2.0:1716999786.695091:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480649216 00000100:00100000:2.0:1716999786.695116:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45145 00000100:00100000:2.0:1716999786.695121:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+581:11419:x1800404480649216:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:2.0:1716999786.696779:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.696798:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480649280 00000100:00100000:2.0:1716999786.696803:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480649280 00000100:00100000:2.0:1716999786.696839:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45146 00000100:00100000:2.0:1716999786.696844:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+582:11420:x1800404480649280:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.696853:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.696863:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc3b2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650be expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.697119:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3b34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697129:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3b34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697137:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3b34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697147:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3b3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697152:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697157:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697280:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3b34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697286:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3b34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697294:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3b34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697299:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.697302:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3b34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697307:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3b34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697315:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999786.697317:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.697319:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3b34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697323:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3b34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697330:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3b3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697334:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3b3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697338:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3b3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697342:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.697343:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3b3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697347:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3b3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697354:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff88009ab4a800) 00010000:00010000:2.0:1716999786.697356:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.697358:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3b3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697362:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3b3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.697518:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc3b2d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650be expref: 583 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.697525:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc3b2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650be expref: 583 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.697531:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea880, rc 0) 00000100:00100000:2.0:1716999786.697559:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+582:11420:x1800404480649280:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 714us (783us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999786.697564:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45146 00000100:00100000:3.0:1716999786.699012:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.699126:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480649408 00000100:00100000:2.0:1716999786.699131:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480649408 00000100:00100000:2.0:1716999786.699247:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45147 00000100:00100000:2.0:1716999786.699253:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+582:11420:x1800404480649408:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.699263:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.699265:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1716999786.699278:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3afc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650a9 expref: 582 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.699288:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999786.699292:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999786.699300:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3b42 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650c5 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.699646:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.699655:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.699662:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.699670:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3b50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.699675:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3b50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.699680:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3b50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:2.0:1716999786.700613:0:11055:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5f9:0x0], index 1: 0 00000040:00080000:2.0:1716999786.700706:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11353, 184 off2030536 00010000:00010000:2.0:1716999786.700797:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3b57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.700804:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3b57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.700810:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3b57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.700844:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.700850:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b49 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.700856:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.700860:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e98c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.700862:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.700868:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.700875:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999786.700878:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.700898:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.700903:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999786.700911:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b2680 reply state ffff88009c0e4000 transno 4294985832 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3b50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999786.700916:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999786.700936:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3b42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650c5 expref: 584 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.700945:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3b57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650c5 expref: 583 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.700951:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800920ebf00) 00010000:00010000:2.0:1716999786.700954:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999786.700955:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea640, rc 0) 00000100:00100000:2.0:1716999786.701006:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+584:11420:x1800404480649408:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1753us (1995us total) trans 4294985832 rc 0/0 00000100:00100000:2.0:1716999786.701013:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45147 00010000:00010000:0.0:1716999786.702975:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3b50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.702984:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3b50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.702989:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3b50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.702993:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.702996:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3b50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.703001:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3b50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.703011:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff8800920eb100) 00010000:00010000:0.0:1716999786.703014:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.703016:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3b50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.703020:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc3b50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999786.703903:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.703924:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480649472 00000100:00100000:2.0:1716999786.703930:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480649472 00000100:00100000:2.0:1716999786.703958:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9899 00000100:00100000:2.0:1716999786.703964:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+71:1959:x1800404480649472:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.703976:0:19195:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.703988:0:19195:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b65 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650cc expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999786.704003:0:19195:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x5f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999786.704015:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999786.704017:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999786.704021:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650cc expref: 72 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999786.704031:0:19195:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650cc expref: 72 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999786.704040:0:19195:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb600, rc 0) 00000100:00100000:2.0:1716999786.704071:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480649472:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 106us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.704076:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9899 00000100:00100000:2.0:1716999786.705580:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.706157:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480649536 00000100:00100000:0.0:1716999786.706162:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480649536 00000100:00100000:0.0:1716999786.706191:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9900 00000100:00100000:0.0:1716999786.706197:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+72:11420:x1800404480649536:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.706205:0:19195:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.706215:0:19195:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650d3 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.706282:0:19195:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b65 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650cc expref: 73 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999786.706290:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999786.706292:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999786.706295:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [4096->8191] (req 4096->8191) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650d3 expref: 73 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.706321:0:19195:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b65 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f650cc expref: 73 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999786.706332:0:19195:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f650cc expref: 73 pid: 19195 timeout: 405 lvb_type: 1 00000100:00100000:0.0:1716999786.706342:0:19195:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091297b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19195:1800404483006912:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999786.706387:0:19195:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219780 going to sleep for 11 seconds 00000100:00100000:2.0:1716999786.708924:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.709405:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480649600 00000100:00100000:0.0:1716999786.709411:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480649600 00010000:00010000:0.0:1716999786.709433:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b65 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f650cc expref: 74 pid: 19195 timeout: 405 lvb_type: 1 00000100:00100000:0.0:1716999786.709453:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4499 00000100:00100000:0.0:1716999786.709458:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480649600:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999786.709467:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999786.709483:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b65 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f650cc expref: 74 pid: 19195 timeout: 405 lvb_type: 1 00010000:00010000:0.0:1716999786.709491:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b65 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f650cc expref: 74 pid: 19195 timeout: 405 lvb_type: 1 00010000:00010000:0.0:1716999786.709512:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999786.709514:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999786.709519:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650d3 expref: 74 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.709526:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650d3 expref: 74 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.709548:0:25864:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650d3 expref: 74 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999786.709558:0:25864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091296a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:25864:1800404483006976:192.168.203.3@tcp:105: 00000100:00100000:0.0:1716999786.709595:0:25864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219300 going to sleep for 11 seconds 00010000:00010000:0.0:1716999786.709667:0:19195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918eb600/0x6d188eabd8dc3b65 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f650cc expref: 74 pid: 19195 timeout: 405 lvb_type: 1 00000100:00100000:0.0:1716999786.709682:0:19195:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091297b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19195:1800404483006912:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999786.709914:0:19195:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650d3 expref: 73 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.709923:0:19195:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd440, rc 0) 00000100:00100000:0.0:1716999786.709943:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+73:11420:x1800404480649536:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 3746us (4366us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.709950:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9900 00000100:00100000:1.0:1716999786.712223:0:25864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091296a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0001_UUID:25864:1800404483006976:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999786.712259:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999786.712287:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480649600:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2827us (3365us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.712294:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4499 00000100:00100000:3.0:1716999786.714090:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.714206:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480649728 00000100:00100000:1.0:1716999786.714212:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480649728 00000100:00100000:1.0:1716999786.714240:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8998 00000100:00100000:1.0:1716999786.714245:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+583:11420:x1800404480649728:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999786.714549:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11354, 168 off2030704 00000001:00080000:1.0:1716999786.714554:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985833 00000100:00100000:1.0:1716999786.714627:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+585:11420:x1800404480649728:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 381us (539us total) trans 4294985834 rc 0/0 00000100:00100000:1.0:1716999786.714634:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8998 00000020:00080000:1.0:1716999786.714638:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999786.717503:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.717527:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480649856 00000100:00100000:2.0:1716999786.717532:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480649856 00000100:00100000:2.0:1716999786.717557:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45148 00000100:00100000:2.0:1716999786.717563:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+585:11420:x1800404480649856:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.717576:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.717590:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3b73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650da expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.717653:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b7a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.717665:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc29:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.717674:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc29:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:2.0:1716999786.717682:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc29:0x0]: returning size 77076 00010000:00010000:2.0:1716999786.717760:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3b73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650da expref: 588 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.717772:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc29:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650da expref: 587 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.717778:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800920ebf00) 00010000:00010000:2.0:1716999786.717781:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999786.717783:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e98c0, rc 0) 00000100:00100000:2.0:1716999786.717812:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+587:11420:x1800404480649856:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 248us (313us total) trans 4294985835 rc 0/0 00000100:00100000:2.0:1716999786.717818:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45148 00000001:00080000:1.0:1716999786.720352:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985831 is committed 00000100:00100000:0.0:1716999786.720705:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+560:11419:x1800404480649216:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 25580us (25656us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.720714:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45145 00000100:00100000:2.0:1716999786.720794:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.720940:0:8347:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480649920 00000100:00100000:0.0:1716999786.720945:0:8347:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480649920 00002000:00100000:0.0:1716999786.720967:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5f9:0x0] (0->77075) req@ffff88012cdec700 x1800404480649920/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 488/0 e 0 to 0 dl 1716999797 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:0.0:1716999786.720975:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec700 with x1800404480649920 ext(0->77075) 00002000:00010000:0.0:1716999786.720980:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdec700 00000100:00100000:0.0:1716999786.720991:0:8347:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1429 00000100:00100000:0.0:1716999786.720995:0:8347:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480649920:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:3.0:1716999786.723074:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.723659:0:8347:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480649920:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 2661us (2862us total) trans 4294970158 rc 0/0 00000100:00100000:0.0:1716999786.723667:0:8347:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1429 00002000:00100000:0.0:1716999786.723675:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5f9:0x0] (0->77075) req@ffff88012cdec700 x1800404480649920/t4294970158(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 488/448 e 0 to 0 dl 1716999797 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:0.0:1716999786.723684:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdec700 with x1800404480649920 ext(0->77075) 00002000:00010000:0.0:1716999786.723688:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cdec700 00000100:00100000:1.0:1716999786.723753:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480649984 00000100:00100000:1.0:1716999786.723758:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480649984 00000100:00100000:1.0:1716999786.723790:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9901 00000100:00100000:1.0:1716999786.723795:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+75:1959:x1800404480649984:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:1.0:1716999786.725015:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.725082:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480650048 00000100:00100000:0.0:1716999786.725086:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480650048 00000100:00100000:0.0:1716999786.725107:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45149 00000100:00100000:0.0:1716999786.725112:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+560:11420:x1800404480650048:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:1.0:1716999786.752942:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+560:11420:x1800404480650048:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 27823us (27923us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.752952:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45149 00000001:00080000:1.0:1716999786.752976:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985834 is committed 00000001:00080000:1.0:1716999786.752984:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985835 is committed 00000100:00100000:3.0:1716999786.757090:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.757238:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480650112 00000100:00100000:2.0:1716999786.757245:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480650112 00000100:00100000:2.0:1716999786.757271:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9902 00000100:00100000:2.0:1716999786.757277:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480650112:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:1.0:1716999786.766393:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+75:1959:x1800404480649984:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 42592us (43317us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.766404:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9901 00000001:00080000:1.0:1716999786.766936:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970120 is committed 00000001:00080000:1.0:1716999786.766943:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970121 is committed 00000100:00100000:3.0:1716999786.769538:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.769557:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480650240 00000100:00100000:1.0:1716999786.769565:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480650240 00000100:00100000:1.0:1716999786.769596:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45150 00000100:00100000:1.0:1716999786.769603:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+556:11419:x1800404480650240:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999786.769638:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999786.769657:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3a9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65086 expref: 556 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.769670:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:1.0:1716999786.769673:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.769714:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3b88 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.769724:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.769737:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999786.770014:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b1880 reply state ffff88009c0e2000 transno 4294985836 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999786.770020:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999786.770073:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11419:x1800404480650240:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 469us (538us total) trans 4294985836 rc 0/0 00000100:00100000:1.0:1716999786.770079:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45150 00010000:00010000:1.0:1716999786.772118:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3b88 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.772127:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3b88 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.772132:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3b88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.772137:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.772140:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3b88 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.772146:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3b88 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.772155:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:1.0:1716999786.772157:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.772160:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3b88 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.772164:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc3b88 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999786.772222:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.772262:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480650304 00000100:00100000:1.0:1716999786.772267:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480650304 00000100:00100000:1.0:1716999786.772288:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45151 00000100:00100000:1.0:1716999786.772293:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+556:11419:x1800404480650304:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.772307:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.772317:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3b8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650e1 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.772347:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3b8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650e1 expref: 557 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.772356:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3b8f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650e1 expref: 557 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.772367:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:1.0:1716999786.772369:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1716999786.772371:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133a80, rc 0) 00000100:00100000:1.0:1716999786.772393:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11419:x1800404480650304:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 99us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.772399:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45151 00000100:00100000:0.0:1716999786.774623:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.774666:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480650368 00000100:00100000:1.0:1716999786.774672:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480650368 00000100:00100000:1.0:1716999786.774695:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9903 00000100:00100000:1.0:1716999786.774700:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+71:1958:x1800404480650368:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:1.0:1716999786.774875:0:19195:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5f8:0x0] updating lvb size from disk: 0 -> 77076 00002000:00010000:1.0:1716999786.774901:0:19195:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5f8:0x0] updating lvb mtime from disk: 0 -> 1716999775 00002000:00010000:1.0:1716999786.774903:0:19195:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5f8:0x0] updating lvb atime from disk: 0 -> 1716999777 00002000:00010000:1.0:1716999786.774905:0:19195:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5f8:0x0] updating lvb ctime from disk: 0 -> 1716999787 00002000:00010000:1.0:1716999786.774907:0:19195:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5f8:0x0] updating lvb blocks from disk: 1 -> 259 00000100:00100000:1.0:1716999786.774965:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091297b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+72:1958:x1800404480650368:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 263us (344us total) trans 4294970122 rc 0/0 00000100:00100000:1.0:1716999786.774971:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9903 00000100:00100000:3.0:1716999786.777489:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.777793:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480650496 00000100:00100000:1.0:1716999786.777798:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480650496 00000100:00100000:1.0:1716999786.777857:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45152 00000100:00100000:1.0:1716999786.777863:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11419:x1800404480650496:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:1.0:1716999786.777919:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3b96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.777931:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3b96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.777939:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3b96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.777955:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3b96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.777960:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3b96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.777965:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3b96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.777970:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.777973:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3b96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.777978:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3b96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.777986:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:1.0:1716999786.777988:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1716999786.777990:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3b96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.777994:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3b96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999786.778037:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11419:x1800404480650496:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 174us (552us total) trans 0 rc -22/-22 00000100:00100000:1.0:1716999786.778044:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45152 00000100:00100000:2.0:1716999786.780922:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.781144:0:8347:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480650560 00000100:00100000:0.0:1716999786.781151:0:8347:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480650560 00002000:00100000:0.0:1716999786.781200:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5f8:0x0] (0->4095) req@ffff88012cdedf80 x1800404480650560/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 4584/0 e 0 to 0 dl 1716999797 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:0.0:1716999786.781208:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdedf80 with x1800404480650560 ext(0->4095) 00002000:00010000:0.0:1716999786.781213:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdedf80 00000100:00100000:2.0:1716999786.781234:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1430 00000100:00100000:2.0:1716999786.781240:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480650560:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:2.0:1716999786.781486:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480650560:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 244us (565us total) trans 4294970123 rc 0/0 00000100:00100000:2.0:1716999786.781492:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1430 00002000:00100000:2.0:1716999786.781497:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x5f8:0x0] (0->4095) req@ffff88012cdedf80 x1800404480650560/t4294970123(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 4584/448 e 0 to 0 dl 1716999797 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999786.781504:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cdedf80 with x1800404480650560 ext(0->4095) 00002000:00010000:2.0:1716999786.781506:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cdedf80 00000100:00100000:0.0:1716999786.783805:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.783834:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480650624 00000100:00100000:0.0:1716999786.783840:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480650624 00000100:00100000:0.0:1716999786.783866:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45153 00000100:00100000:0.0:1716999786.783871:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11419:x1800404480650624:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:0.0:1716999786.783955:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11419:x1800404480650624:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 84us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.783961:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45153 00000100:00100000:3.0:1716999786.785900:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.785954:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480650688 00000100:00100000:1.0:1716999786.785960:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480650688 00000100:00100000:1.0:1716999786.785982:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9904 00000100:00100000:1.0:1716999786.785988:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+74:1958:x1800404480650688:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:2.0:1716999786.788136:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480650112:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 30856us (31053us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.788144:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9902 00000001:00080000:2.0:1716999786.788166:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970158 is committed 00000100:00100000:0.0:1716999786.791281:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.791478:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480650816 00000100:00100000:1.0:1716999786.791485:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480650816 00000100:00100000:1.0:1716999786.791512:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45154 00000100:00100000:1.0:1716999786.791519:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11420:x1800404480650816:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999786.791552:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999786.791576:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3b57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650c5 expref: 557 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.791587:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800920ebf00) 00010000:00010000:1.0:1716999786.791591:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.791628:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3b9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.791954:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3b9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.791962:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3b9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999786.792298:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880091297800 reply state ffff88009c0e7000 transno 4294985837 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3b9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999786.792305:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999786.792372:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480650816:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 852us (1093us total) trans 4294985837 rc 0/0 00000100:00100000:1.0:1716999786.792379:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45154 00010000:00010000:1.0:1716999786.794681:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3b9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.794692:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3b9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.794701:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3b9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.794706:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.794710:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3b9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.794716:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3b9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.794727:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800920ebf00) 00010000:00010000:1.0:1716999786.794730:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.794733:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3b9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.794738:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3b9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999786.794967:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.795168:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480650880 00000100:00100000:0.0:1716999786.795175:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480650880 00000100:00100000:0.0:1716999786.795203:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45155 00000100:00100000:0.0:1716999786.795209:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11420:x1800404480650880:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.795225:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.795237:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3ba4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650e8 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.795275:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3ba4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650e8 expref: 558 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.795285:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3ba4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc29:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650e8 expref: 558 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.795297:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800920ebf00) 00010000:00010000:0.0:1716999786.795300:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1716999786.795302:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bddd40, rc 0) 00000100:00100000:0.0:1716999786.795335:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480650880:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 126us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.795340:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45155 00000100:00100000:0.0:1716999786.797916:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.797954:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480650944 00000100:00100000:2.0:1716999786.797961:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480650944 00000100:00100000:2.0:1716999786.797985:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9905 00000100:00100000:2.0:1716999786.797990:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+70:1959:x1800404480650944:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:2.0:1716999786.798206:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5f9:0x0] updating lvb size from disk: 0 -> 77076 00002000:00010000:2.0:1716999786.798208:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5f9:0x0] updating lvb mtime from disk: 0 -> 1716999775 00002000:00010000:2.0:1716999786.798209:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5f9:0x0] updating lvb atime from disk: 0 -> 1716999777 00002000:00010000:2.0:1716999786.798210:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5f9:0x0] updating lvb ctime from disk: 0 -> 1716999787 00002000:00010000:2.0:1716999786.798211:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5f9:0x0] updating lvb blocks from disk: 1 -> 259 00000100:00100000:2.0:1716999786.798238:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+71:1959:x1800404480650944:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 248us (327us total) trans 4294970159 rc 0/0 00000100:00100000:2.0:1716999786.798243:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9905 00000100:00100000:2.0:1716999786.801007:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.801067:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480651072 00000100:00100000:0.0:1716999786.801073:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480651072 00000100:00100000:0.0:1716999786.801115:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45156 00000100:00100000:0.0:1716999786.801122:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480651072:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:0.0:1716999786.801164:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3bab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.801175:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3bab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.801188:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3bab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.801456:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3bab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.801462:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3bab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.801468:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3bab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.801473:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddb00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.801476:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3bab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.801481:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3bab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.801489:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800920ebf00) 00010000:00010000:0.0:1716999786.801492:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1716999786.801495:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3bab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.801499:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3bab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999786.801700:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480651072:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 578us (698us total) trans 0 rc -22/-22 00000100:00100000:0.0:1716999786.801707:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45156 00000100:00100000:2.0:1716999786.805226:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.805300:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480651136 00000100:00100000:3.0:1716999786.805308:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480651136 00002000:00100000:3.0:1716999786.805337:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5f9:0x0] (0->4095) req@ffff88012ee4c850 x1800404480651136/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 4584/0 e 0 to 0 dl 1716999797 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999786.805346:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee4c850 with x1800404480651136 ext(0->4095) 00002000:00010000:3.0:1716999786.805351:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee4c850 00000100:00100000:3.0:1716999786.805367:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1431 00000100:00100000:3.0:1716999786.805373:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ee4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+71:1958:x1800404480651136:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:3.0:1716999786.805950:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ee4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+73:1958:x1800404480651136:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 576us (727us total) trans 4294970160 rc 0/0 00000100:00100000:3.0:1716999786.805956:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1431 00002000:00100000:3.0:1716999786.805962:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x5f9:0x0] (0->4095) req@ffff88012ee4c850 x1800404480651136/t4294970160(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:692/0 lens 4584/448 e 0 to 0 dl 1716999797 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999786.805969:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88012ee4c850 with x1800404480651136 ext(0->4095) 00002000:00010000:3.0:1716999786.805972:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012ee4c850 00000100:00100000:0.0:1716999786.807564:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.808128:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480651200 00000100:00100000:2.0:1716999786.808135:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480651200 00000100:00100000:2.0:1716999786.808172:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45157 00000100:00100000:2.0:1716999786.808179:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480651200:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:2.0:1716999786.808257:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+558:11420:x1800404480651200:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 79us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.808263:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45157 00000100:00100000:3.0:1716999786.810128:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.810210:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480651264 00000100:00100000:0.0:1716999786.810216:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480651264 00000100:00100000:0.0:1716999786.810278:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9906 00000100:00100000:0.0:1716999786.810284:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480651264:12345-192.168.203.3@tcp:16:dbench.0 00000001:00080000:2.0:1716999786.811503:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970122 is committed 00000001:00080000:2.0:1716999786.811512:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970123 is committed 00000100:00100000:0.0:1716999786.811599:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+71:1958:x1800404480650688:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 25609us (25720us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.811606:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9904 00000100:00100000:0.0:1716999786.813555:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.813631:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480651328 00000100:00100000:2.0:1716999786.813638:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480651328 00000100:00100000:2.0:1716999786.813663:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45158 00000100:00100000:2.0:1716999786.813668:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+558:11419:x1800404480651328:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.813680:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.813692:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3bb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650ef expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.813735:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3bb9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813745:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813753:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813761:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3bc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813766:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813770:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813861:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc3bc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813867:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc3bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813872:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc3bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:2.0:1716999786.813908:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc28:0x0]: returning size 77076 00000004:00200000:2.0:1716999786.813911:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999786.813922:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc3bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813929:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc3bc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813935:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3bb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813939:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3bb9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813944:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813948:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ead00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.813950:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3bb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813955:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3bb9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813963:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999786.813965:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.813968:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3bb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813972:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3bb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813979:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3bc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813982:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3bc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813986:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813990:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.813992:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3bc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.813996:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3bc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.814001:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff8800908c6400) 00010000:00010000:2.0:1716999786.814003:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.814005:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3bc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.814009:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3bc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.814027:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3bb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650ef expref: 560 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.814036:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc3bc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650ef expref: 559 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.814041:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:2.0:1716999786.814192:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999786.814195:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea880, rc 0) 00000100:00100000:2.0:1716999786.814516:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480651328:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 845us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.814523:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45158 00000100:00100000:0.0:1716999786.819064:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.819131:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480651456 00000100:00100000:2.0:1716999786.819138:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480651456 00000100:00100000:2.0:1716999786.819208:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45159 00000100:00100000:2.0:1716999786.819215:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480651456:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999786.819257:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999786.819276:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc3bc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650ef expref: 559 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.819289:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:2.0:1716999786.819293:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999786.819319:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3bce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.819329:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3bce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.819336:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3bce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999786.819537:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131caaa00 reply state ffff8800903d5000 transno 4294985838 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3bce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999786.819544:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999786.820133:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+560:11419:x1800404480651456:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 916us (1072us total) trans 4294985838 rc 0/0 00000100:00100000:2.0:1716999786.820139:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45159 00010000:00010000:1.0:1716999786.822786:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3bce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.822796:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3bce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.822801:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3bce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.822809:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.822813:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3bce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.822819:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3bce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999786.822835:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999786.822841:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:1.0:1716999786.822843:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.822847:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3bce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.822851:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc3bce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999786.822854:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480651520 00000100:00100000:0.0:1716999786.822859:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480651520 00000100:00100000:0.0:1716999786.822894:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9907 00000100:00100000:0.0:1716999786.822900:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+71:1958:x1800404480651520:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999786.823652:0:19195:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5f8:0x0] updating lvb size from disk: 77076 -> 77076 00002000:00010000:0.0:1716999786.823656:0:19195:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5f8:0x0] updating lvb mtime from disk: 1716999775 -> 1716999775 00002000:00010000:0.0:1716999786.823658:0:19195:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5f8:0x0] updating lvb atime from disk: 1716999777 -> 1716999767 00002000:00010000:0.0:1716999786.823660:0:19195:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5f8:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:0.0:1716999786.823661:0:19195:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5f8:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:0.0:1716999786.823847:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:107d663a-2216-406b-94c6-b2fcb1558728+72:1958:x1800404480651520:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 945us (1023us total) trans 4294970124 rc 0/0 00000100:00100000:0.0:1716999786.823854:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9907 00000100:00100000:3.0:1716999786.826759:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.826781:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480651648 00000100:00100000:3.0:1716999786.826786:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480651648 00000100:00100000:3.0:1716999786.826819:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45160 00000100:00100000:3.0:1716999786.826838:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480651648:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:3.0:1716999786.827019:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3bd5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.827032:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.827043:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.827060:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3bd5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.827065:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3bd5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.827070:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3bd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.827075:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.827078:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3bd5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.827082:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3bd5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.827091:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:3.0:1716999786.827093:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999786.827096:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3bd5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.827101:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3bd5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999786.827139:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480651648:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 301us (382us total) trans 0 rc -22/-22 00000100:00100000:3.0:1716999786.827146:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45160 00000100:00100000:1.0:1716999786.829240:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.829260:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480651712 00000100:00100000:1.0:1716999786.829264:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480651712 00000100:00100000:1.0:1716999786.829286:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45161 00000100:00100000:1.0:1716999786.829291:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480651712:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.829302:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.829326:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc3bdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650f6 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.829414:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3be3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829424:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3be3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829431:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3be3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829441:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3bea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829446:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829451:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829527:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3bf1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829534:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829540:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999786.829559:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc28:0x0]: returning size 77076 00000004:00200000:1.0:1716999786.829562:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999786.829574:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829581:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3bf1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829586:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3be3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829591:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3be3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829596:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3be3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829606:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.829609:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3be3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829614:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3be3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829622:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999786.829624:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.829627:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3be3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829632:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3be3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829639:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3bea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829644:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3bea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829648:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3bea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829651:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.829653:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3bea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829657:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3bea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829661:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff88009240ef00) 00010000:00010000:1.0:1716999786.829663:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.829665:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3bea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829668:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3bea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.829686:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc3bdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650f6 expref: 561 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.829694:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3bf1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650f6 expref: 560 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.829699:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:1.0:1716999786.829700:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999786.829702:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132f40, rc 0) 00000100:00100000:1.0:1716999786.829748:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+560:11419:x1800404480651712:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 457us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.829753:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45161 00000100:00100000:0.0:1716999786.833201:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.833224:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480651776 00000100:00100000:0.0:1716999786.833230:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480651776 00000100:00100000:0.0:1716999786.833260:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45162 00000100:00100000:0.0:1716999786.833266:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+560:11419:x1800404480651776:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.833281:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.833296:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3bf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f650fd expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.833339:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3bff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833349:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3bff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833356:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3bff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833366:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3c06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833371:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833376:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833461:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3c0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833481:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833487:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:0.0:1716999786.833516:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc24:0x0]: returning size 74834 00000004:00200000:0.0:1716999786.833520:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999786.833532:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833539:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3c0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833545:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3bff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833550:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3bff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833555:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3bff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833559:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.833562:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3bff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833568:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3bff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833666:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999786.833669:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.833672:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3bff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833678:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3bff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833686:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833691:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3c06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833695:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3c06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833699:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.833701:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3c06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833729:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3c06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833736:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01e3f1 (ffff88009330d700) 00010000:00010000:0.0:1716999786.833738:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.833740:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3c06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833744:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3c06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.833765:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3bf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650fd expref: 562 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.833776:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3c0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650fd expref: 561 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.833781:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:0.0:1716999786.833782:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999786.833784:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:0.0:1716999786.833841:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+561:11419:x1800404480651776:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 572us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.833847:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45162 00000100:00100000:1.0:1716999786.838293:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.838369:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480651904 00000100:00100000:0.0:1716999786.838376:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480651904 00000100:00100000:0.0:1716999786.838408:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 8999 00000100:00100000:0.0:1716999786.838425:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+561:11419:x1800404480651904:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999786.839006:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11355, 168 off2030872 00000001:00080000:0.0:1716999786.839013:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985839 00000100:00100000:0.0:1716999786.839348:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480651904:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 932us (1058us total) trans 4294985840 rc 0/0 00000100:00100000:0.0:1716999786.839354:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 8999 00000020:00080000:0.0:1716999786.839359:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999786.841157:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.841251:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652032 00000100:00100000:0.0:1716999786.841257:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652032 00000100:00100000:0.0:1716999786.841279:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45163 00000100:00100000:0.0:1716999786.841284:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480652032:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999786.841316:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999786.841335:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3c0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc24:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650fd expref: 563 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.841348:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc3759 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc24:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fad expref: 562 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.841357:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc36f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc24:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f8a expref: 561 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.841365:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88008a83f500) 00010000:00010000:0.0:1716999786.841423:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999786.841443:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3c14 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.841453:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3c14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.841462:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3c14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.841471:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3c1b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.841476:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3c1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.841481:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3c1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.841589:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3c22 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.841596:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3c22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.841602:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3c22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:0.0:1716999786.842775:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1472, 64 off102464 00000040:00080000:0.0:1716999786.842796:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11356, 184 off2031056 00010000:00010000:0.0:1716999786.842864:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3c29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.842872:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.842892:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3c29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.842899:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3c29 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.842908:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3c29 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843048:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3c29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843053:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3c29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843058:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999786.843061:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3c29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843066:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3c29 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843074:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88009330dd00) 00010000:00010000:0.0:1716999786.843076:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999786.843079:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3c29 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843083:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3c29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc24:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843107:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3c22 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843111:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3c22 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843115:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3c22 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843119:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.843122:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3c22 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843126:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3c22 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843131:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc24:0x0].0x0 (ffff88009330dd00) 00010000:00010000:0.0:1716999786.843133:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999786.843135:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3c22 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843139:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3c22 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843174:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3c14 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843179:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3c14 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843183:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3c14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843188:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.843191:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3c14 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843195:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3c14 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843200:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999786.843202:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.843204:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3c14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.843212:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3c14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999786.843218:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012cded180 reply state ffff8800919d1000 transno 4294985841 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3c1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999786.843223:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999786.843602:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+562:11419:x1800404480652032:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2315us (2444us total) trans 4294985841 rc 0/0 00000100:00100000:0.0:1716999786.843610:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45163 00010000:00010000:2.0:1716999786.846020:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3c1b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.846032:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3c1b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.846038:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3c1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.846046:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.846050:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3c1b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.846056:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3c1b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.846068:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xfe01e3f1 (ffff88009330de00) 00010000:00010000:2.0:1716999786.846071:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.846074:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3c1b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.846079:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3c1b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999786.849024:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483007232:0@lo:400:kworker.0 00000100:00100000:0.0:1716999786.849082:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999786.849105:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1716999786.849110:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6183665d-a269-4a7c-8dd8-59206e554b99:3219:1800404483007040:0@lo:400:kworker.0 00000100:00100000:0.0:1716999786.849131:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999786.849139:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3219:1800404483007296:0@lo:400:kworker.0 00000100:00100000:0.0:1716999786.849154:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999786.849168:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3217:1800404483007104:0@lo:400:kworker.0 00000100:00100000:0.0:1716999786.849182:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999786.849190:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483007360:0@lo:400:kworker.0 00000100:00100000:0.0:1716999786.849204:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999786.849212:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1716999786.849216:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3217:1800404483007168:0@lo:400:kworker.0 00000100:00100000:0.0:1716999786.849230:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999786.849266:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483007232 00000100:00100000:0.0:1716999786.849272:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483007232 00000100:00100000:0.0:1716999786.849297:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483007360 00000100:00100000:0.0:1716999786.849299:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483007360 00000100:00100000:0.0:1716999786.849309:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1716999786.849315:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3219:x1800404483007232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1716999786.849348:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3219:x1800404483007232:12345-0@lo:400:kworker.0 Request processed in 33us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.849353:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1716999786.849365:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1716999786.849369:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3217:x1800404483007360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1716999786.849388:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3217:x1800404483007360:12345-0@lo:400:kworker.0 Request processed in 18us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.849392:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1716999786.849405:0:6816:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483007040 00000100:00100000:0.0:1716999786.849407:0:6816:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483007040 00000100:00100000:0.0:1716999786.849425:0:6816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1716999786.849429:0:6816:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6183665d-a269-4a7c-8dd8-59206e554b99+18:3219:x1800404483007040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1716999786.849448:0:6816:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6183665d-a269-4a7c-8dd8-59206e554b99+18:3219:x1800404483007040:12345-0@lo:400:kworker.0 Request processed in 18us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.849453:0:6816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00080000:0.0:1716999786.849472:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1716999756 00000100:00100000:0.0:1716999786.849488:0:3217:0:(client.c:2952:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970149 gen 2 00000004:00080000:0.0:1716999786.849492:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af52680, transno 4294970147 00000004:00080000:0.0:1716999786.849499:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af52300, transno 4294970148 00000004:00080000:0.0:1716999786.849501:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af50a80, transno 4294970149 00000100:00100000:0.0:1716999786.849506:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131c58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483007360:0@lo:400:kworker.0 00000004:00080000:0.0:1716999786.849637:0:10149:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 4 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:0.0:1716999786.849653:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6183665d-a269-4a7c-8dd8-59206e554b99:3219:1800404483007040:0@lo:400:kworker.0 00000100:00100000:0.0:1716999786.849660:0:3219:0:(client.c:2952:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294970112 gen 2 00000004:00080000:0.0:1716999786.849663:0:3219:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af51500, transno 4294970110 00000004:00080000:0.0:1716999786.849669:0:3219:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af50e00, transno 4294970111 00000004:00080000:0.0:1716999786.849672:0:3219:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af52a00, transno 4294970112 00000100:00100000:0.0:1716999786.849704:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483007232:0@lo:400:kworker.0 00000100:00100000:2.0:1716999786.849782:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483007296 00000100:00100000:2.0:1716999786.849785:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483007296 00000100:00080000:3.0:1716999786.849800:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1716999756 00000100:00100000:2.0:1716999786.849807:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483007104 00000100:00100000:2.0:1716999786.849810:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483007104 00000100:00100000:2.0:1716999786.849830:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483007168 00000100:00100000:2.0:1716999786.849832:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483007168 00000100:00100000:3.0:1716999786.849842:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1716999786.849849:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3219:x1800404483007296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1716999786.849998:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1716999786.850003:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3217:x1800404483007104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1716999786.850037:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3217:x1800404483007104:12345-0@lo:400:kworker.0 Request processed in 34us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.850041:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1716999786.850053:0:16641:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1716999786.850057:0:16641:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3217:x1800404483007168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1716999786.850077:0:16641:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3217:x1800404483007168:12345-0@lo:400:kworker.0 Request processed in 19us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.850083:0:16641:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1716999786.850609:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3219:x1800404483007296:12345-0@lo:400:kworker.0 Request processed in 759us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.850615:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1716999786.850630:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1716999756 00000004:00080000:0.0:1716999786.854227:0:8674:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 5 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:0.0:1716999786.854272:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3217:1800404483007168:0@lo:400:kworker.0 00000100:00100000:0.0:1716999786.854282:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131cabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3217:1800404483007104:0@lo:400:kworker.0 00000100:00100000:0.0:1716999786.854305:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800996f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3219:1800404483007296:0@lo:400:kworker.0 00000100:00100000:2.0:1716999786.857257:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.857279:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652096 00000100:00100000:0.0:1716999786.857286:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652096 00000100:00100000:0.0:1716999786.857325:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45164 00000100:00100000:0.0:1716999786.857332:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+561:11419:x1800404480652096:12345-192.168.203.3@tcp:41:dbench.0 00000004:00000024:0.0:1716999786.857400:0:6822:0:(mdt_handler.c:569:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 7642021888 avail 7538212864 00000100:00100000:0.0:1716999786.857478:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+561:11419:x1800404480652096:12345-192.168.203.3@tcp:41:dbench.0 Request processed in 146us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.857484:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45164 00000001:00080000:3.0:1716999786.857619:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970159 is committed 00000001:00080000:3.0:1716999786.857628:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970160 is committed 00000100:00100000:0.0:1716999786.857648:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+70:1959:x1800404480651264:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 47363us (47523us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.857655:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9906 00000100:00100000:2.0:1716999786.859478:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.859510:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.859557:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652160 00000100:00100000:3.0:1716999786.859558:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652224 00000100:00100000:3.0:1716999786.859563:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652224 00000100:00100000:0.0:1716999786.859563:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652160 00000100:00100000:3.0:1716999786.859599:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45165 00000100:00100000:3.0:1716999786.859604:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+562:11420:x1800404480652224:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.859617:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1716999786.859664:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45166 00000100:00100000:0.0:1716999786.859669:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+562:11419:x1800404480652160:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.859677:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.859685:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3c37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65104 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.859725:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3c3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859735:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3c3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859743:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3c3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859752:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3c45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x42adbbf5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859758:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859763:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.859801:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc3c30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6510b expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.859819:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3c3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859857:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3c3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859862:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3c3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859867:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.859870:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3c3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859876:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3c3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859911:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.859914:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.859917:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3c3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859922:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3c3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859934:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3c45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.859938:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3c4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.859939:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3c45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859943:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3c45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.859946:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3c4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.859947:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdeac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.859949:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3c45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.859952:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3c4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.859953:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3c45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.859958:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x42adbbf5 (ffff88009330da00) 00010000:00010000:3.0:1716999786.859960:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3c53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.859960:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.859961:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3c45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.859965:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.859965:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3c45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.859969:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.859994:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3c37 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65104 expref: 564 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.860001:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3c37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65104 expref: 564 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.860007:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc900, rc 0) 00000100:00100000:0.0:1716999786.860038:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480652160:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 369us (565us total) trans 0 rc 301/301 00010000:00010000:3.0:1716999786.860040:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3c5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999786.860044:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45166 00010000:00010000:3.0:1716999786.860046:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860050:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:3.0:1716999786.860075:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc29:0x0]: returning size 77076 00000004:00200000:3.0:1716999786.860078:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999786.860090:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860096:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3c5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860101:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3c4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860104:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3c4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860108:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3c4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860111:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.860113:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3c4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860117:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3c4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860123:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999786.860126:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.860128:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3c4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860132:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3c4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860140:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860145:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3c53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860149:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860153:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c973c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.860154:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860158:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3c53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860164:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff880135ac4f00) 00010000:00010000:3.0:1716999786.860166:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.860168:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3c53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860171:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3c53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.860189:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc3c30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6510b expref: 563 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.860201:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3c5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6510b expref: 562 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.860205:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800920ebf00) 00010000:00010000:3.0:1716999786.860207:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999786.860208:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94000, rc 0) 00000100:00100000:3.0:1716999786.860237:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+562:11420:x1800404480652224:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 632us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.860242:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45165 00000100:00100000:2.0:1716999786.862716:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.862833:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652352 00000100:00100000:3.0:1716999786.862839:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652352 00000100:00100000:2.0:1716999786.862899:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.862938:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652416 00000100:00100000:1.0:1716999786.862942:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652416 00000100:00100000:3.0:1716999786.863500:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45167 00000100:00100000:3.0:1716999786.863508:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+563:11420:x1800404480652352:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:0.0:1716999786.863540:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45168 00010000:00010000:3.0:1716999786.863546:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1716999786.863546:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480652416:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.863553:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.863561:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3c5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6510b expref: 563 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.863563:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3c61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65112 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.863572:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800920ebf00) 00010000:00010000:3.0:1716999786.863575:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999786.863579:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3c61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65112 expref: 563 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.863586:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3c61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65112 expref: 563 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.863591:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.863592:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.863594:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd680, rc 0) 00010000:00010000:3.0:1716999786.863595:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3c68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.863600:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.863606:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999786.863630:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480652416:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 84us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.863636:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45168 00000004:00010000:3.0:1716999786.863845:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012cdece00 reply state ffff88008bbc3000 transno 4294985842 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999786.863850:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999786.863961:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+564:11420:x1800404480652352:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 453us (1249us total) trans 4294985842 rc 0/0 00000100:00100000:3.0:1716999786.863966:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45167 00000100:00100000:2.0:1716999786.865199:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999786.865255:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3c68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999786.865255:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652480 00000100:00100000:0.0:1716999786.865260:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652480 00010000:00010000:1.0:1716999786.865261:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3c68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.865266:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3c68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.865270:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.865274:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3c68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.865279:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3c68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999786.865280:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9000 00000100:00100000:0.0:1716999786.865284:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480652480:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:1.0:1716999786.865287:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800920ebf00) 00010000:00010000:1.0:1716999786.865289:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.865291:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3c68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.865296:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3c68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999786.865769:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.865848:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652544 00000100:00100000:2.0:1716999786.865851:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652544 00000100:00100000:2.0:1716999786.865894:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9908 00000100:00100000:2.0:1716999786.865899:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+70:1957:x1800404480652544:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:2.0:1716999786.866174:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5f9:0x0] updating lvb size from disk: 77076 -> 77076 00002000:00010000:2.0:1716999786.866177:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5f9:0x0] updating lvb mtime from disk: 1716999775 -> 1716999775 00002000:00010000:2.0:1716999786.866179:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5f9:0x0] updating lvb atime from disk: 1716999777 -> 1716999767 00002000:00010000:2.0:1716999786.866181:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5f9:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:2.0:1716999786.866183:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5f9:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:2.0:1716999786.866215:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+71:1957:x1800404480652544:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 314us (445us total) trans 4294970161 rc 0/0 00000100:00100000:2.0:1716999786.866221:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9908 00000100:00100000:1.0:1716999786.867547:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.867569:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480652480:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2278us (2365us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.867577:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9000 00000100:00100000:3.0:1716999786.867700:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652672 00000100:00100000:3.0:1716999786.867705:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652672 00000100:00100000:3.0:1716999786.867725:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45169 00000100:00100000:3.0:1716999786.867729:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+563:11420:x1800404480652672:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:3.0:1716999786.867763:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3c6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.867773:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.867781:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.867793:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3c6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.867798:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3c6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.867803:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3c6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.867806:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.867808:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3c6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.867814:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3c6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.867833:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800920ebf00) 00010000:00010000:3.0:1716999786.867835:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999786.867838:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3c6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.867842:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc3c6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999786.867870:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+563:11420:x1800404480652672:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 140us (324us total) trans 0 rc -22/-22 00000100:00100000:3.0:1716999786.867876:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45169 00000100:00100000:0.0:1716999786.869070:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.869131:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652736 00000100:00100000:3.0:1716999786.869135:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652736 00000100:00100000:3.0:1716999786.869152:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45170 00000100:00100000:3.0:1716999786.869157:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480652736:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.869167:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.869176:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3c76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65119 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.869205:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3c7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869211:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3c7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869217:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3c7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869229:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3c84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x5291a9a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869234:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3c84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869244:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3c84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869295:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3c7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869304:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3c7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869309:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3c7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869312:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.869315:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3c7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869320:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3c7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869326:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999786.869328:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.869331:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3c7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869335:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3c7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869343:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3c84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869348:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3c84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869352:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3c84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869356:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.869358:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3c84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869363:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3c84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869368:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x5291a9a7 (ffff880135ac4200) 00010000:00010000:3.0:1716999786.869370:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.869372:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3c84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869376:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3c84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869408:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3c76 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65119 expref: 564 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.869414:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3c76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65119 expref: 564 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.869419:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94240, rc 0) 00000100:00100000:3.0:1716999786.869450:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+563:11419:x1800404480652736:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 292us (382us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.869458:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45170 00000100:00100000:1.0:1716999786.869772:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.869835:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652800 00000100:00100000:3.0:1716999786.869839:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652800 00000100:00100000:3.0:1716999786.869862:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45171 00000100:00100000:3.0:1716999786.869866:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+563:11420:x1800404480652800:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.869873:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.869900:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3c8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65120 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.869923:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3c92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869930:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3c92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869935:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3c92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869943:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3c99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869948:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.869953:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870015:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3ca0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870021:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870027:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:3.0:1716999786.870050:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc29:0x0]: returning size 77076 00000004:00200000:3.0:1716999786.870053:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999786.870064:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870070:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3ca0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870075:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3c92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870079:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3c92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870083:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3c92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870087:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.870090:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3c92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870094:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3c92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870100:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999786.870102:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.870104:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3c92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870108:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3c92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870115:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3c99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870119:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3c99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870123:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3c99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870127:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.870128:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3c99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870133:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3c99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870138:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff880135ac4e00) 00010000:00010000:3.0:1716999786.870140:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.870142:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3c99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870146:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3c99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.870241:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3c8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65120 expref: 565 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.870250:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3ca0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65120 expref: 564 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.870255:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800920ebf00) 00010000:00010000:3.0:1716999786.870257:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999786.870259:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97840, rc 0) 00000100:00100000:3.0:1716999786.870288:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+564:11420:x1800404480652800:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 421us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.870293:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45171 00000100:00100000:1.0:1716999786.870991:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.871028:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652864 00000100:00100000:3.0:1716999786.871032:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652864 00000100:00100000:3.0:1716999786.871075:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45172 00000100:00100000:3.0:1716999786.871080:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480652864:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.871088:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.871096:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3ca7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65127 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.871116:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3cae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871123:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3cae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871128:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3cae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871135:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3cb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871140:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871145:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871184:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3cae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871189:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3cae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871193:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3cae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871198:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.871200:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3cae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871204:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3cae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871211:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999786.871213:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.871215:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3cae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871219:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3cae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871226:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3cb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871231:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3cb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871234:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871238:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.871240:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3cb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871248:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3cb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871258:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4f4f46 (ffff880135ac4a00) 00010000:00010000:3.0:1716999786.871260:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.871262:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3cb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871266:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3cb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.871294:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3ca7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65127 expref: 565 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.871300:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3ca7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65127 expref: 565 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.871307:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96ac0, rc 0) 00000100:00100000:3.0:1716999786.871336:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480652864:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 256us (346us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.871340:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45172 00000100:00100000:0.0:1716999786.872946:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.873013:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.873147:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652928 00000100:00100000:3.0:1716999786.873152:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652928 00000100:00100000:3.0:1716999786.873173:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480652992 00000100:00100000:3.0:1716999786.873175:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480652992 00000100:00100000:3.0:1716999786.873185:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45173 00000100:00100000:3.0:1716999786.873191:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480652928:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.873201:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.873213:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3cbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6512e expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.873242:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3cc3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873251:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873260:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873269:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3cca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873274:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873279:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873352:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3cd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873358:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873363:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:3.0:1716999786.873382:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc25:0x0]: returning size 74834 00000004:00200000:3.0:1716999786.873386:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999786.873397:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873404:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3cd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873409:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3cc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873414:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3cc3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873419:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873423:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.873425:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3cc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873431:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3cc3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873438:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999786.873440:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.873443:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3cc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873447:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3cc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873456:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873461:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3cca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873465:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3cca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873469:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.873471:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3cca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873475:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3cca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873481:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01e3f1 (ffff880135ac4500) 00010000:00010000:3.0:1716999786.873482:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.873484:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3cca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873487:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3cca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873507:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3cbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6512e expref: 567 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.873517:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3cd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6512e expref: 566 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.873522:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:3.0:1716999786.873524:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999786.873526:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97a80, rc 0) 00000100:00100000:3.0:1716999786.873555:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+566:11420:x1800404480652928:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 363us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.873560:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45173 00000100:00100000:3.0:1716999786.873604:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45174 00000100:00100000:3.0:1716999786.873608:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012feff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+565:11419:x1800404480652992:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.873614:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.873621:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3cd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65135 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.873641:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc3cdf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873647:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc3cdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873653:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc3cdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873661:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc3ce6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x50417874 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873665:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc3ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873670:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc3ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873701:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc3cdf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873705:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc3cdf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873710:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc3cdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873714:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a8900240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.873716:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc3cdf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873720:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc3cdf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873729:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999786.873731:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.873734:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc3cdf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873738:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc3cdf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873744:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc3ce6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873748:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc3ce6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873752:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc3ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873756:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a8901d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.873758:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc3ce6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873763:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc3ce6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873768:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x50417874 (ffff880131c40d00) 00010000:00010000:3.0:1716999786.873769:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.873771:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc3ce6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873776:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc3ce6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.873806:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3cd8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65135 expref: 566 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.873813:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3cd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65135 expref: 566 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.873828:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94b40, rc 0) 00000100:00100000:3.0:1716999786.875117:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012feff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+565:11419:x1800404480652992:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1505us (2100us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.875123:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45174 00000100:00100000:0.0:1716999786.877965:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.878762:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480653120 00000100:00100000:2.0:1716999786.878769:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480653120 00000100:00100000:2.0:1716999786.878802:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9001 00000100:00100000:2.0:1716999786.878808:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480653120:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999786.879590:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.879676:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480653184 00000100:00100000:0.0:1716999786.879680:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480653184 00000100:00100000:0.0:1716999786.879709:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45175 00000100:00100000:0.0:1716999786.879714:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+567:11419:x1800404480653184:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.879722:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.879735:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ced lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6513c expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.879765:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3cf4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879774:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3cf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879782:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3cf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879793:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3cfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879797:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3cfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879801:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3cfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879855:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3cf4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879860:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3cf4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879865:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879869:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdeac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.879872:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3cf4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879876:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3cf4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879909:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.879911:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.879914:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3cf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879919:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3cf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879938:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3cfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879944:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3cfb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879948:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3cfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879952:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.879954:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3cfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879958:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3cfb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879964:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7f675ee7 (ffff88009330d300) 00010000:00010000:0.0:1716999786.879966:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.879968:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3cfb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.879971:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3cfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.880003:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ced lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6513c expref: 568 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.880010:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ced lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6513c expref: 568 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.880017:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc900, rc 0) 00000100:00100000:0.0:1716999786.880057:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+567:11419:x1800404480653184:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 341us (467us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.880066:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45175 00000040:00080000:2.0:1716999786.880220:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11357, 168 off2031224 00000001:00080000:2.0:1716999786.880225:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985843 00000100:00100000:2.0:1716999786.880341:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480653120:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1532us (2382us total) trans 4294985844 rc 0/0 00000100:00100000:2.0:1716999786.880347:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9001 00000020:00080000:2.0:1716999786.880350:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999786.881671:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.881721:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480653312 00000100:00100000:0.0:1716999786.881727:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480653312 00000100:00100000:0.0:1716999786.881747:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45176 00000100:00100000:0.0:1716999786.881752:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480653312:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999786.881780:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999786.881792:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc3cd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc25:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6512e expref: 567 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.881806:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc376e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc25:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fb4 expref: 566 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.881972:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3744 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc25:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64fa6 expref: 565 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.881980:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:0.0:1716999786.881988:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999786.881998:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999786.882005:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3d02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882013:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3d02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882019:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3d02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882028:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3d09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882033:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882038:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882107:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3d10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882113:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3d10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882118:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3d10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999786.882263:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480653440 00000100:00100000:3.0:1716999786.882266:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480653440 00000100:00100000:3.0:1716999786.882293:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45177 00000100:00100000:3.0:1716999786.882297:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+565:11419:x1800404480653440:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.882304:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.882306:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1716999786.882314:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3c61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65112 expref: 565 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.882322:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999786.882325:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999786.882330:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc3d17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65143 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.882389:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc3d1e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.882396:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc3d1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.882401:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc3d1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.882408:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3d25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.882413:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3d25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.882417:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3d25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:0.0:1716999786.882514:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1475, 64 off102656 00000040:00080000:0.0:1716999786.882531:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11358, 184 off2031408 00010000:00010000:0.0:1716999786.882573:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3d2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882580:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3d2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882586:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3d2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882591:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3d2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882596:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3d2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882600:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3d2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882605:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3d2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882613:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999786.882616:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3d2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882621:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3d2c lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882627:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff88009330d200) 00010000:00010000:0.0:1716999786.882629:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999786.882631:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3d2c lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882635:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3d2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc25:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882649:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3d10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882654:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3d10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882658:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3d10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882661:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.882663:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3d10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882667:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3d10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882673:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc25:0x0].0x0 (ffff88009330d200) 00010000:00010000:0.0:1716999786.882675:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999786.882677:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3d10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882680:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3d10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882714:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3d02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882718:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3d02 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882723:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3d02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882726:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.882729:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3d02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882733:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3d02 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882739:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:0.0:1716999786.882741:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.882743:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3d02 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.882746:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3d02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00080000:3.0:1716999786.882750:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5f9:0x0], index 0: 0 00000004:00010000:0.0:1716999786.882752:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008927c000 reply state ffff880090561000 transno 4294985845 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999786.882757:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999786.882791:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480653312:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1038us (1121us total) trans 4294985845 rc 0/0 00000100:00100000:0.0:1716999786.882798:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45176 00000040:00080000:3.0:1716999786.882813:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11359, 184 off2031592 00010000:00010000:3.0:1716999786.883114:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc3d33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.883122:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc3d33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.883127:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc3d33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.883148:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc3d1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.883153:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc3d1e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.883157:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc3d1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.883161:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a8903cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.883164:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc3d1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.883168:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc3d1e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.883175:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999786.883177:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.883179:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc3d1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.883182:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc3d1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:3.0:1716999786.883189:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88013502aa00 reply state ffff8801350cb000 transno 4294985846 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3d25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999786.883194:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999786.883209:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc3d17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65143 expref: 568 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.883218:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc3d33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65143 expref: 567 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.883223:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2a:0x0].0x0 (ffff880131c40b00) 00010000:00010000:3.0:1716999786.883225:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999786.883226:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94480, rc 0) 00010000:00010000:2.0:1716999786.883669:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3d09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.883675:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3d09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.883679:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3d09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.883682:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.883684:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3d09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.883688:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3d09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.883695:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xfe01e3f1 (ffff88009330dd00) 00010000:00010000:2.0:1716999786.883697:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.883699:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3d09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.883703:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3d09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xfe01e3f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999786.884369:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+567:11419:x1800404480653440:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2069us (2368us total) trans 4294985846 rc 0/0 00000100:00100000:2.0:1716999786.884375:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45177 00010000:00010000:2.0:1716999786.885578:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3d25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.885589:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3d25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.885594:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3d25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.885598:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.885600:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3d25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.885606:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3d25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.885615:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7f675ee7 (ffff880131c40100) 00010000:00010000:2.0:1716999786.885617:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.885620:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3d25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999786.885624:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc3d25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999786.885922:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.886188:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480653504 00000100:00100000:2.0:1716999786.886194:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480653504 00000100:00100000:2.0:1716999786.886230:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9909 00000100:00100000:2.0:1716999786.886235:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480653504:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.886247:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.886259:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3d41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6514a expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999786.886277:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999786.886291:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999786.886293:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999786.886298:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3d41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6514a expref: 73 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999786.886311:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3d41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6514a expref: 73 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999786.886319:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea640, rc 0) 00000100:00100000:2.0:1716999786.886357:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480653504:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 121us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.886363:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9909 00000100:00100000:0.0:1716999786.887846:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.887910:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480653568 00000100:00100000:2.0:1716999786.887914:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480653568 00000100:00100000:2.0:1716999786.887943:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9910 00000100:00100000:2.0:1716999786.888018:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+73:11419:x1800404480653568:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.888027:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.888036:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65151 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.888053:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3d41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6514a expref: 74 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999786.888059:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999786.888060:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999786.888063:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65151 expref: 74 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.888089:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3d41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6514a expref: 74 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999786.888099:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3d41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6514a expref: 74 pid: 17864 timeout: 406 lvb_type: 1 00000100:00100000:2.0:1716999786.888110:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012cdeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483007424:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999786.888325:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008ed62180 going to sleep for 11 seconds 00000100:00100000:1.0:1716999786.891943:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.892031:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480653632 00000100:00100000:2.0:1716999786.892035:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012cdeed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483007424:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999786.892038:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480653632 00010000:00010000:2.0:1716999786.892059:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65151 expref: 75 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.892060:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3d41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6514a expref: 75 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:2.0:1716999786.892071:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8b40, rc 0) 00000100:00100000:0.0:1716999786.892082:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4500 00000100:00100000:0.0:1716999786.892087:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+75:1958:x1800404480653632:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999786.892098:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1716999786.892105:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+75:11419:x1800404480653568:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 4088us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.892110:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9910 00010000:00010000:0.0:1716999786.892116:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3d41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6514a expref: 75 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:0.0:1716999786.892126:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3d41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6514a expref: 74 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:0.0:1716999786.892141:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc3d41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6514a expref: 74 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:0.0:1716999786.892150:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999786.892152:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999786.892157:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65151 expref: 73 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.892164:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65151 expref: 73 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.892187:0:25864:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65151 expref: 73 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999786.892343:0:25864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:25864:1800404483007488:192.168.203.3@tcp:105: 00000100:00100000:0.0:1716999786.892386:0:25864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093549c00 going to sleep for 11 seconds 00000100:00100000:0.0:1716999786.893285:0:25864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:25864:1800404483007488:192.168.203.3@tcp:105: 00010000:00010000:0.0:1716999786.893295:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999786.893323:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+73:1958:x1800404480653632:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1234us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.893329:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4500 00000100:00100000:2.0:1716999786.896384:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.896444:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.896498:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480653760 00000100:00100000:0.0:1716999786.896503:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480653760 00000100:00100000:3.0:1716999786.896579:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480653824 00000100:00100000:3.0:1716999786.896583:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480653824 00000100:00100000:0.0:1716999786.896617:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9002 00000100:00100000:0.0:1716999786.896622:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+567:11419:x1800404480653760:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999786.897012:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11361, 168 off2031784 00000001:00080000:0.0:1716999786.897018:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985847 00000100:00100000:3.0:1716999786.897177:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45178 00000100:00100000:3.0:1716999786.897187:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480653824:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.897196:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1716999786.897196:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480653760:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 573us (816us total) trans 4294985848 rc 0/0 00000100:00100000:0.0:1716999786.897202:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9002 00000020:00080000:0.0:1716999786.897205:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1716999786.897210:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3d4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65158 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.897364:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3d56 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897376:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3d56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897384:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3d56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897394:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3d5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x42adbbf5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897400:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897405:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897546:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3d56 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897552:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3d56 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897557:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3d56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897561:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.897564:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3d56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897569:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3d56 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897578:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999786.897581:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.897584:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3d56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897588:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc3d56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897610:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3d5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897615:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3d5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897619:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3d5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897623:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.897625:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3d5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897629:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3d5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897636:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x42adbbf5 (ffff880131c40d00) 00010000:00010000:3.0:1716999786.897638:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.897640:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3d5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897644:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc3d5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x42adbbf5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.897672:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3d4f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65158 expref: 569 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.897679:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3d4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65158 expref: 569 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.897684:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c973c0, rc 0) 00000100:00100000:3.0:1716999786.897714:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+568:11420:x1800404480653824:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 531us (1270us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.897719:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45178 00000100:00100000:2.0:1716999786.900029:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.900257:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480653888 00000100:00100000:3.0:1716999786.900263:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480653888 00000100:00100000:3.0:1716999786.900288:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45179 00000100:00100000:3.0:1716999786.900294:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+568:11420:x1800404480653888:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.900307:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.900320:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3d64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6515f expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.900339:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3d64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6515f expref: 569 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.900348:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3d64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6515f expref: 569 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.900354:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999786.900356:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.900359:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94b40, rc 0) 00000100:00100000:3.0:1716999786.900460:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480653888:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 165us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.900469:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45179 00000100:00100000:2.0:1716999786.900915:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.901025:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480653952 00000100:00100000:3.0:1716999786.901028:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480653952 00000100:00100000:3.0:1716999786.901051:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45180 00000100:00100000:3.0:1716999786.901056:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480653952:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.901062:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.901070:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3d6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65166 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.901101:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3d72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901107:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3d72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901113:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3d72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901121:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3d79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x44a29697 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901125:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901130:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901171:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3d72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901175:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3d72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901180:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3d72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901184:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.901186:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3d72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901191:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3d72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901197:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999786.901199:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.901201:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3d72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901205:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3d72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901213:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901216:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3d79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901220:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901223:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.901225:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901228:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3d79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901233:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x44a29697 (ffff8800941a3400) 00010000:00010000:3.0:1716999786.901234:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.901236:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3d79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901239:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3d79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.901261:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3d6b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65166 expref: 570 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.901266:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3d6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65166 expref: 570 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.901271:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96400, rc 0) 00000100:00100000:3.0:1716999786.901300:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480653952:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 244us (386us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.901305:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45180 00000100:00100000:3.0:1716999786.901774:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.901829:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654016 00000100:00100000:0.0:1716999786.901833:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654016 00000100:00100000:0.0:1716999786.901863:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9003 00000100:00100000:0.0:1716999786.901868:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480654016:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999786.903072:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.903109:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654080 00000100:00100000:0.0:1716999786.903114:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654080 00000100:00100000:0.0:1716999786.903144:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45181 00000100:00100000:0.0:1716999786.903150:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480654080:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.903158:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.903168:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3d80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6516d expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.903186:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3d80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6516d expref: 572 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.903195:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3d80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6516d expref: 572 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.903201:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.903203:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.903205:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:0.0:1716999786.903227:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+572:11419:x1800404480654080:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.903232:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45181 00000100:00100000:0.0:1716999786.904036:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480654016:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2166us (2261us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.904042:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9003 00000100:00100000:3.0:1716999786.904833:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.904904:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654144 00000100:00100000:0.0:1716999786.904909:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654144 00000100:00100000:0.0:1716999786.904931:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9004 00000100:00100000:0.0:1716999786.904936:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480654144:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999786.906311:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.906473:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654208 00000100:00100000:3.0:1716999786.906479:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654208 00000100:00100000:3.0:1716999786.906512:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45182 00000100:00100000:3.0:1716999786.906517:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+572:11420:x1800404480654208:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.906526:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1716999786.907175:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480654144:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2236us (2353us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.907181:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9004 00010000:00010000:3.0:1716999786.907263:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3d87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65174 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.907313:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3d8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907323:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3d8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907331:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3d8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907342:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3d95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x5291a9a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907347:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3d95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907352:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3d95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907404:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3d8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907410:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3d8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907415:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3d8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907419:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.907422:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3d8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907427:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3d8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907438:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999786.907441:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.907443:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3d8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907448:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc3d8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907457:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3d95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907461:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3d95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907465:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3d95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907469:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.907471:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3d95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907475:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3d95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907480:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x5291a9a7 (ffff8800941a3300) 00010000:00010000:3.0:1716999786.907482:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.907484:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3d95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907488:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc3d95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x5291a9a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.907522:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3d87 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65174 expref: 571 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.907529:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc3d87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65174 expref: 571 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.907536:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96ac0, rc 0) 00000100:00100000:3.0:1716999786.907780:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480654208:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1261us (1470us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.907785:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45182 00000100:00100000:2.0:1716999786.909302:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.909380:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.909464:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654272 00000100:00100000:3.0:1716999786.909469:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654272 00000100:00100000:3.0:1716999786.909497:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654336 00000100:00100000:3.0:1716999786.909499:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654336 00000100:00100000:1.0:1716999786.909503:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45183 00000100:00100000:1.0:1716999786.909509:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480654272:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:3.0:1716999786.909513:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45184 00000100:00100000:3.0:1716999786.909516:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11420:x1800404480654336:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.909521:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.909521:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.909530:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3d9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65182 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.909530:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3da3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6517b expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.909558:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3daa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909566:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3daa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909576:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3daa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909585:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3db1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909590:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3db1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909595:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3db1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.909596:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3db8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909601:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3db8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909605:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3db8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909613:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3dbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909620:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3dbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909625:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3dbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.909637:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3daa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909642:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3daa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909646:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3daa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909650:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.909652:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3db8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.909653:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3daa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909657:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3daa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909664:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999786.909666:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.909669:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3daa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909673:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3daa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909697:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3db1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909701:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3db1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909705:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3db1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909708:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.909710:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3db1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909713:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3db1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909718:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff88009240e800) 00010000:00010000:1.0:1716999786.909720:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.909722:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3db1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909726:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc3db1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.909753:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3da3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6517b expref: 573 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.909760:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3da3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6517b expref: 573 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.909767:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133600, rc 0) 00000100:00100000:1.0:1716999786.909791:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+572:11419:x1800404480654272:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 282us (491us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999786.909797:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45183 00010000:00010000:3.0:1716999786.909803:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3db8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909808:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3db8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909811:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.909813:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3db8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909817:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3db8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909836:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999786.909838:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.909840:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3db8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909844:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc3db8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909851:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3dbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909855:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3dbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909859:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3dbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909862:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.909864:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3dbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909868:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3dbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909872:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4f4f46 (ffff88009439cc00) 00010000:00010000:3.0:1716999786.909873:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.909875:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3dbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909895:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc3dbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.909925:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3d9c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65182 expref: 571 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.909931:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc3d9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65182 expref: 571 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.909937:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97180, rc 0) 00000100:00100000:3.0:1716999786.909952:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480654336:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 434us (572us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.909957:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45184 00000100:00100000:2.0:1716999786.911641:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.911676:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.911715:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654400 00000100:00100000:3.0:1716999786.911721:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654400 00000100:00100000:3.0:1716999786.911748:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45185 00000100:00100000:0.0:1716999786.911750:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654528 00000100:00100000:3.0:1716999786.911754:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480654400:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:0.0:1716999786.911754:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654528 00010000:00010000:3.0:1716999786.911765:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1716999786.911768:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45186 00000100:00100000:0.0:1716999786.911772:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480654528:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.911774:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3dc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65189 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.911777:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.911779:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1716999786.911790:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3d80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6516d expref: 572 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.911801:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999786.911802:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3dcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.911804:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999786.911809:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3dd4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65190 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.911810:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3dcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911816:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3dcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911839:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3ddb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x50417874 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911844:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3ddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911849:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3ddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911897:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3dcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911902:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3dcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911907:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3dcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.911909:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3de2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.911912:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.911915:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3dcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.911916:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3de2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.911920:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3dcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.911921:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3de2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.911926:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999786.911928:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.911929:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3de9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.911930:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3dcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.911933:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3de9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.911934:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc3dcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.911939:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3de9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.911941:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3ddb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911945:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3ddb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911949:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3ddb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911953:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.911955:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3ddb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911959:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3ddb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911963:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x50417874 (ffff88009439ce00) 00010000:00010000:3.0:1716999786.911965:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.911966:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3ddb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911972:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc3ddb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x50417874 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999786.911998:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3dc6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65189 expref: 572 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.912004:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94240/0x6d188eabd8dc3dc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65189 expref: 572 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.912010:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94240, rc 0) 00000100:00100000:3.0:1716999786.912044:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11420:x1800404480654400:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 291us (404us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999786.912049:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45185 00000004:00080000:0.0:1716999786.912418:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5fa:0x0], index 1: 0 00000040:00080000:0.0:1716999786.912463:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11362, 184 off2031968 00010000:00010000:0.0:1716999786.912529:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3df0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.912533:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3df0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.912537:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3df0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.912552:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3de2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.912555:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3de2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.912558:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3de2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.912560:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.912561:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3de2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.912564:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3de2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.912567:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.912569:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.912570:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3de2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.912573:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3de2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999786.912577:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012cdee680 reply state ffff880090564000 transno 4294985849 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3de9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999786.912581:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999786.912590:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3dd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65190 expref: 572 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.912598:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3df0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65190 expref: 571 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.912602:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2b:0x0].0x0 (ffff88009330d100) 00010000:00010000:0.0:1716999786.912603:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999786.912604:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bddb00, rc 0) 00000100:00100000:0.0:1716999786.912631:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+572:11419:x1800404480654528:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 857us (954us total) trans 4294985849 rc 0/0 00000100:00100000:0.0:1716999786.912639:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45186 00000100:00100000:2.0:1716999786.913952:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.914089:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654592 00000100:00100000:0.0:1716999786.914094:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654592 00000100:00100000:0.0:1716999786.914125:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45187 00000100:00100000:0.0:1716999786.914130:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+572:11420:x1800404480654592:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.914140:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.914149:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3dfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65197 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.914180:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3e05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914187:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3e05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914192:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3e05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914199:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3e0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914205:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914210:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914253:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3e05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914258:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3e05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914261:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3e05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914265:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.914267:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3e05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914271:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3e05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914280:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999786.914282:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.914284:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3e05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914288:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3e05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914294:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3e0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914298:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3e0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914302:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914304:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdfcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.914306:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3e0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914310:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3e0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914314:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7f675ee7 (ffff88009330d200) 00010000:00010000:0.0:1716999786.914316:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.914318:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3e0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914322:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3e0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.914347:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3dfe lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65197 expref: 573 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.914354:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3dfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65197 expref: 573 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.914361:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde640, rc 0) 00000100:00100000:0.0:1716999786.914393:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+572:11420:x1800404480654592:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 262us (442us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.914398:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45187 00000100:00100000:2.0:1716999786.915485:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999786.915536:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3de9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.915542:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3de9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.915547:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3de9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.915551:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.915553:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3de9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.915558:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3de9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.915566:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff88009330de00) 00010000:00010000:0.0:1716999786.915568:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.915570:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3de9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.915573:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3de9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999786.915648:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654656 00000100:00100000:3.0:1716999786.915654:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654656 00000100:00100000:3.0:1716999786.916044:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9911 00000100:00100000:3.0:1716999786.916050:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+71:1959:x1800404480654656:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.916060:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.916351:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc3e13 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6519e expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999786.916410:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x5fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999786.916426:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.916427:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.916433:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc3e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6519e expref: 72 pid: 17864 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1716999786.916486:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.916558:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654784 00000100:00100000:1.0:1716999786.916562:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654784 00000100:00100000:1.0:1716999786.916591:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45188 00000100:00100000:1.0:1716999786.916596:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+571:11420:x1800404480654784:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.916606:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.916608:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999786.916625:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc3d64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6515f expref: 571 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.916635:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999786.916637:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.916643:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc3e1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651a5 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.916735:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc3e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6519e expref: 72 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999786.916739:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc3e21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.916742:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96880, rc 0) 00010000:00010000:1.0:1716999786.916746:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc3e21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.916752:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc3e21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.916759:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3e28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.916764:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.916772:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999786.916779:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480654656:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 729us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.916785:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9911 00000004:00080000:1.0:1716999786.917233:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5fa:0x0], index 0: 0 00000040:00080000:1.0:1716999786.917324:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11363, 184 off2032152 00010000:00010000:1.0:1716999786.917407:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3e2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.917414:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.917420:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.917441:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc3e21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.917445:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc3e21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.917449:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc3e21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.917454:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.917456:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc3e21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.917461:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc3e21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.917467:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999786.917469:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.917472:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc3e21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.917476:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc3e21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:1.0:1716999786.917484:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012cdedf80 reply state ffff8800935b2000 transno 4294985850 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999786.917489:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999786.917504:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc3e1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651a5 expref: 573 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.917513:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3e2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651a5 expref: 572 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.917519:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2c:0x0].0x0 (ffff88009240e400) 00010000:00010000:1.0:1716999786.917520:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999786.917522:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c1318c0, rc 0) 00000100:00100000:1.0:1716999786.917558:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+573:11420:x1800404480654784:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 961us (1072us total) trans 4294985850 rc 0/0 00000100:00100000:1.0:1716999786.917564:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45188 00000100:00100000:2.0:1716999786.920032:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.920087:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654912 00000100:00100000:0.0:1716999786.920094:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654912 00000100:00100000:0.0:1716999786.920127:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9005 00000100:00100000:0.0:1716999786.920133:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+573:11419:x1800404480654912:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:3.0:1716999786.920335:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3e28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.920343:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3e28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.920349:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3e28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.920353:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.920356:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3e28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.920361:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3e28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.920376:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7f675ee7 (ffff88009240e200) 00010000:00010000:3.0:1716999786.920379:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.920382:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3e28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.920386:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc3e28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999786.920471:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.920536:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480654976 00000100:00100000:3.0:1716999786.920540:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480654976 00000100:00100000:3.0:1716999786.920566:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9912 00000100:00100000:3.0:1716999786.920571:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+73:1958:x1800404480654976:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.920579:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.920591:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3e3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651ac expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999786.920605:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999786.920615:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.920617:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.920622:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3e3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651ac expref: 74 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.920631:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3e3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651ac expref: 74 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.920639:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96400, rc 0) 00000100:00100000:3.0:1716999786.920676:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+74:1958:x1800404480654976:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 103us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.920681:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9912 00000040:00080000:0.0:1716999786.920723:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11364, 168 off2032320 00000001:00080000:0.0:1716999786.920729:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985851 00000100:00100000:0.0:1716999786.920779:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480654912:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 645us (752us total) trans 4294985852 rc 0/0 00000100:00100000:0.0:1716999786.920785:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9005 00000020:00080000:0.0:1716999786.920788:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999786.923293:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.923377:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.923414:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655168 00000100:00100000:0.0:1716999786.923421:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655168 00000100:00100000:1.0:1716999786.923433:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655040 00000100:00100000:1.0:1716999786.923436:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655040 00000100:00100000:0.0:1716999786.923449:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45189 00000100:00100000:0.0:1716999786.923454:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480655168:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:1.0:1716999786.923465:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9913 00000100:00100000:1.0:1716999786.923469:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+74:11420:x1800404480655040:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.923475:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.923488:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651b3 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.923488:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999786.923502:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3df0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65190 expref: 574 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.923507:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3e3d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651ac expref: 75 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999786.923512:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999786.923512:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2b:0x0].0x0 (ffff88009330d100) 00010000:00010000:1.0:1716999786.923514:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.923516:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651b3 expref: 75 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.923519:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999786.923534:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3e4b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.923538:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3e3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651ac expref: 75 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999786.923542:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3e4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.923547:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3e3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651ac expref: 75 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:0.0:1716999786.923548:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3e4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999786.923558:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135028a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483007552:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999786.923560:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3e52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.923564:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.923568:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999786.923592:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930ef000 going to sleep for 11 seconds 00010000:00010000:0.0:1716999786.923648:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3e59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.923654:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3e59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.923659:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3e59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:0.0:1716999786.924320:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1476, 64 off102720 00000040:00080000:0.0:1716999786.924338:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11365, 184 off2032504 00010000:00010000:0.0:1716999786.924385:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3e60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924391:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3e60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924397:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3e60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924402:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3e60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924407:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3e60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924414:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3e60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924419:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3e60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924424:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999786.924427:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3e60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924432:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3e60 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924439:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2b:0x0].0x0 (ffff88009330dd00) 00010000:00010000:0.0:1716999786.924441:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999786.924443:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3e60 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924448:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3e60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924466:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3e59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924470:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3e59 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924474:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3e59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924477:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.924479:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3e59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924485:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3e59 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924491:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2b:0x0].0x0 (ffff88009330dd00) 00010000:00010000:0.0:1716999786.924492:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999786.924494:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3e59 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924498:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3e59 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924531:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3e4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924536:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3e4b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924540:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3e4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924544:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcfc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.924546:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3e4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924550:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3e4b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924555:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.924557:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.924559:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3e4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.924562:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3e4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999786.924573:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131c3f480 reply state ffff880090567000 transno 4294985853 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999786.924651:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999786.924864:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480655168:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1406us (1483us total) trans 4294985853 rc 0/0 00000100:00100000:0.0:1716999786.924871:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45189 00000100:00100000:1.0:1716999786.925091:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880135028a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483007552:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999786.925109:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651b3 expref: 75 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.925119:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133600, rc 0) 00000100:00100000:1.0:1716999786.925136:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+75:11420:x1800404480655040:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1667us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.925142:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9913 00000100:00100000:2.0:1716999786.926100:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.926318:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655232 00000100:00100000:0.0:1716999786.926324:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655232 00010000:00010000:0.0:1716999786.926342:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3e3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651ac expref: 75 pid: 17864 timeout: 406 lvb_type: 1 00000100:00100000:1.0:1716999786.926511:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4501 00000100:00100000:1.0:1716999786.926518:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+75:1959:x1800404480655232:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999786.926528:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999786.926543:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3e3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651ac expref: 75 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999786.926553:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3e3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651ac expref: 75 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999786.926567:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3e3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651ac expref: 75 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999786.926577:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.926579:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.926583:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651b3 expref: 74 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.926590:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651b3 expref: 74 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.926614:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651b3 expref: 74 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999786.926624:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135028a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483007616:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999786.926665:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930ef000 going to sleep for 11 seconds 00010000:00010000:0.0:1716999786.926735:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3e52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.926741:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3e52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.926745:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3e52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.926750:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.926752:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3e52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.926757:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3e52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.926765:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff88009330d300) 00010000:00010000:0.0:1716999786.926767:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.926770:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3e52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.926774:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3e52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999786.926851:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.926967:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655296 00000100:00100000:0.0:1716999786.926970:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655296 00000100:00100000:0.0:1716999786.926986:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45190 00000100:00100000:0.0:1716999786.926990:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480655296:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.927002:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.927011:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3e67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651ba expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.927043:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3e6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927051:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3e6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927058:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3e6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927066:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3e75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927071:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927075:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927120:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3e6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927125:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3e6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927130:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3e6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927134:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.927136:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3e6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927141:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3e6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927147:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.927149:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.927151:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3e6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927155:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3e6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927162:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3e75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927166:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3e75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927170:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3e75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927174:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.927175:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3e75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927182:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3e75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927194:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff88009330da00) 00010000:00010000:0.0:1716999786.927196:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.927197:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3e75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927201:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3e75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.927229:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3e67 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651ba expref: 575 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.927235:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3e67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651ba expref: 575 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.927242:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bded00, rc 0) 00000100:00100000:0.0:1716999786.927263:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480655296:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 272us (412us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.927269:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45190 00000100:00100000:1.0:1716999786.929242:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1716999786.929262:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483007680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1716999786.929332:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999786.930093:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.930142:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655360 00000100:00100000:2.0:1716999786.930148:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655360 00000100:00100000:2.0:1716999786.930174:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45191 00000100:00100000:2.0:1716999786.930180:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480655360:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.930200:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.930213:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3e7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651c1 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.930233:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3e7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651c1 expref: 575 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.930243:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3e7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651c1 expref: 575 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.930248:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999786.930251:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.930253:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ead00, rc 0) 00000100:00100000:0.0:1716999786.930334:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880135028a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483007616:192.168.203.3@tcp:105: 00010000:00010000:0.0:1716999786.930349:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999786.930732:0:8344:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483007680 00000100:00100000:3.0:1716999786.930737:0:8344:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483007680 00000100:00100000:3.0:1716999786.930761:0:8344:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1716999786.930765:0:8344:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1800404483007680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1716999786.930776:0:8344:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 10223616 granted 254345216 pending 0 free 3834642432 avail 3831496704 00000100:00100000:3.0:1716999786.930813:0:8344:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1800404483007680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.930829:0:8344:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1716999786.930851:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483007680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1716999786.930930:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480655360:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 748us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.930936:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45191 00000100:00100000:0.0:1716999786.931035:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480655232:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 4516us (4935us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.931042:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4501 00000100:00100000:3.0:1716999786.931090:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.931176:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655488 00000100:00100000:0.0:1716999786.931179:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655488 00000100:00100000:0.0:1716999786.931245:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9006 00000100:00100000:0.0:1716999786.931250:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+575:11420:x1800404480655488:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999786.931578:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11366, 168 off2032672 00000001:00080000:0.0:1716999786.931584:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985854 00000100:00100000:0.0:1716999786.932101:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480655488:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 849us (1009us total) trans 4294985855 rc 0/0 00000100:00100000:0.0:1716999786.932106:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9006 00000020:00080000:0.0:1716999786.932110:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999786.932606:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.932801:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655552 00000100:00100000:0.0:1716999786.932805:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655552 00000100:00100000:0.0:1716999786.932840:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9007 00000100:00100000:0.0:1716999786.932845:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480655552:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999786.936164:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480655552:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3312us (3551us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.936173:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9007 00000100:00100000:3.0:1716999786.938219:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.938438:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655616 00000100:00100000:0.0:1716999786.938445:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655616 00000100:00100000:0.0:1716999786.938485:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45192 00000100:00100000:0.0:1716999786.938491:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480655616:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.938508:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.938522:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3e83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651c8 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.938563:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3e8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938574:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3e8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938583:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3e8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938591:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3e91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x44a29697 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938596:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938601:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938651:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3e8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938656:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3e8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938662:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3e8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938666:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.938669:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3e8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938674:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3e8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938682:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999786.938685:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.938687:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3e8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938691:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3e8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938700:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3e91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938704:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3e91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938708:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938711:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.938713:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3e91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938717:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3e91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938722:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x44a29697 (ffff88009330d200) 00010000:00010000:0.0:1716999786.938724:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.938726:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3e91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938730:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3e91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x44a29697 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.938758:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3e83 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651c8 expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.938766:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3e83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651c8 expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.938776:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc000, rc 0) 00000100:00100000:0.0:1716999786.938874:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480655616:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 382us (658us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.938907:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45192 00000100:00100000:3.0:1716999786.939032:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.939331:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655680 00000100:00100000:0.0:1716999786.939335:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655680 00000100:00100000:0.0:1716999786.939363:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45193 00000100:00100000:0.0:1716999786.939367:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480655680:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.939374:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.939382:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3e98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651cf expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.939404:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3e9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939411:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3e9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939417:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3e9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939425:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3ea6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939430:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939435:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939468:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3e9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939473:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3e9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939478:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3e9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939482:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.939484:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3e9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939489:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3e9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939495:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.939496:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.939499:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3e9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939503:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3e9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939734:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3ea6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939740:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3ea6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939745:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939749:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.939751:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3ea6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939755:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3ea6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939765:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff88009330d700) 00010000:00010000:0.0:1716999786.939767:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.939769:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3ea6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939773:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3ea6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.939803:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3e98 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651cf expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.939811:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3e98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651cf expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.939817:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdeac0, rc 0) 00000100:00100000:0.0:1716999786.940314:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480655680:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 945us (1280us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.940319:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45193 00000100:00100000:3.0:1716999786.940848:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.940901:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655744 00000100:00100000:0.0:1716999786.940906:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655744 00000100:00100000:0.0:1716999786.941025:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45194 00000100:00100000:0.0:1716999786.941030:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480655744:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.941040:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.941048:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ead lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651d6 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.941064:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651d6 expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.941077:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ead lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651d6 expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.941082:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999786.941084:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.941087:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdfcc0, rc 0) 00000100:00100000:0.0:1716999786.941120:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+578:11420:x1800404480655744:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 89us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.941125:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45194 00000100:00100000:3.0:1716999786.941907:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.941953:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655808 00000100:00100000:0.0:1716999786.941957:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655808 00000100:00100000:0.0:1716999786.941975:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45195 00000100:00100000:0.0:1716999786.941979:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+578:11419:x1800404480655808:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.941986:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.941993:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3eb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651dd expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.942022:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3ebb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942029:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3ebb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942035:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3ebb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942043:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3ec2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942051:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942055:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942098:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3ebb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942103:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3ebb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942107:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3ebb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942111:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcd80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.942113:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3ebb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942118:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3ebb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942124:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.942126:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.942127:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3ebb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942131:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3ebb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942141:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3ec2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942145:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3ec2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942150:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942153:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.942155:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3ec2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942158:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3ec2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942162:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x68e4194e (ffff88009330de00) 00010000:00010000:0.0:1716999786.942164:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.942165:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3ec2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942171:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3ec2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.942193:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3eb4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651dd expref: 579 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.942198:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3eb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651dd expref: 579 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.942203:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf840, rc 0) 00000100:00100000:0.0:1716999786.942233:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+578:11419:x1800404480655808:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 253us (327us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.942238:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45195 00000100:00100000:3.0:1716999786.944219:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.944293:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655872 00000100:00100000:0.0:1716999786.944299:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655872 00000100:00100000:1.0:1716999786.944597:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9008 00000100:00100000:1.0:1716999786.944603:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+578:11420:x1800404480655872:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999786.944742:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.944902:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480655936 00000100:00100000:0.0:1716999786.944906:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480655936 00000100:00100000:0.0:1716999786.944938:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45196 00000100:00100000:0.0:1716999786.944943:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+579:11419:x1800404480655936:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.944950:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.944962:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3ec9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651e4 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.944996:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ed0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945006:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945013:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945022:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3ed7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945027:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945031:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945228:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ed0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945233:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ed0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945238:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945246:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.945249:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ed0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945255:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ed0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945264:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.945266:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.945269:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ed0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945274:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc3ed0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945285:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3ed7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945289:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3ed7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945377:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945381:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.945384:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3ed7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945388:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3ed7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945395:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x68e4194e (ffff88009330d300) 00010000:00010000:0.0:1716999786.945398:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.945400:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3ed7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945404:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc3ed7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.945436:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3ec9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651e4 expref: 581 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.945442:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc3ec9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651e4 expref: 581 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.945449:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bded00, rc 0) 00000100:00100000:0.0:1716999786.945818:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+580:11419:x1800404480655936:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 873us (1074us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.945832:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45196 00000100:00100000:1.0:1716999786.946945:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+578:11420:x1800404480655872:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2339us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.946954:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9008 00000100:00100000:3.0:1716999786.947436:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.947485:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480656064 00000100:00100000:0.0:1716999786.947490:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480656064 00000100:00100000:0.0:1716999786.947553:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45197 00000100:00100000:0.0:1716999786.947558:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+578:11419:x1800404480656064:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.947568:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.947571:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1716999786.947585:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc3e7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651c1 expref: 578 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.947594:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.947597:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999786.947605:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3ede lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651eb expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.947677:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3ee5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.947685:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.947692:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.947700:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3eec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.947704:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.947709:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:0.0:1716999786.948094:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5fb:0x0], index 1: 0 00000040:00080000:0.0:1716999786.948152:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11367, 184 off2032856 00010000:00010000:0.0:1716999786.948239:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3ef3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.948246:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.948252:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.948273:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3ee5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.948278:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3ee5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.948284:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.948288:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcfc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.948291:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3ee5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.948638:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3ee5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.948646:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.948652:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.948655:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3ee5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.948659:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc3ee5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999786.948669:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008927df80 reply state ffff880134aeb000 transno 4294985856 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999786.948673:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999786.948691:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc3ede lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651eb expref: 580 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.948700:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651eb expref: 579 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.948706:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:0.0:1716999786.948707:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999786.948709:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf600, rc 0) 00000100:00100000:0.0:1716999786.948750:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+580:11419:x1800404480656064:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1191us (1313us total) trans 4294985856 rc 0/0 00000100:00100000:0.0:1716999786.948757:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45197 00000100:00100000:3.0:1716999786.949098:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.949201:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480656128 00000100:00100000:0.0:1716999786.949205:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480656128 00000100:00100000:0.0:1716999786.949233:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45198 00000100:00100000:0.0:1716999786.949238:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+580:11420:x1800404480656128:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.949247:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.949260:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3f01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651f2 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.949288:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3f08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949296:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3f08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949301:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3f08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949310:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3f0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949315:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949319:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949355:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3f08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949367:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3f08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949371:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3f08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949375:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.949377:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3f08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949382:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3f08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949388:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999786.949390:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.949392:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3f08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949396:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc3f08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949403:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3f0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949407:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3f0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949411:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3f0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949415:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.949417:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3f0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949424:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3f0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949429:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009330d900) 00010000:00010000:0.0:1716999786.949430:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.949432:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3f0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949436:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc3f0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.949460:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3f01 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651f2 expref: 581 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.949466:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3f01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651f2 expref: 581 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.949471:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bddb00, rc 0) 00000100:00100000:0.0:1716999786.949498:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+580:11420:x1800404480656128:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 259us (400us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.949502:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45198 00010000:00010000:3.0:1716999786.950563:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3eec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.950570:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3eec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.950574:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3eec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.950578:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.950580:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3eec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.950585:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3eec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.950593:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x68e4194e (ffff88009330d600) 00010000:00010000:3.0:1716999786.950595:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.950597:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3eec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999786.950602:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3eec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999786.951173:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.951246:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480656192 00000100:00100000:1.0:1716999786.951252:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480656192 00000100:00100000:1.0:1716999786.951390:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9914 00000100:00100000:1.0:1716999786.951396:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480656192:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.951407:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.951418:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c131680/0x6d188eabd8dc3f16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f651f9 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1716999786.951435:0:15837:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x5fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1716999786.951447:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.951448:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.951454:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c131680/0x6d188eabd8dc3f16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651f9 expref: 73 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999786.951513:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c131680/0x6d188eabd8dc3f16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651f9 expref: 73 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999786.951521:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131680, rc 0) 00000100:00100000:1.0:1716999786.951837:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480656192:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 391us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.951846:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9914 00000100:00100000:2.0:1716999786.951970:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.952026:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480656320 00000100:00100000:0.0:1716999786.952030:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480656320 00000100:00100000:0.0:1716999786.952048:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45199 00000100:00100000:0.0:1716999786.952052:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480656320:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.952062:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.952064:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1716999786.952081:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ead lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651d6 expref: 579 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.952091:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999786.952094:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999786.952101:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3f1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65200 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.952183:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3f24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952191:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3f24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952198:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3f24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952205:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3f2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952210:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952214:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:0.0:1716999786.952574:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5fb:0x0], index 0: 0 00000040:00080000:0.0:1716999786.952631:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11368, 184 off2033040 00010000:00010000:0.0:1716999786.952706:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3f32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952712:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952717:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3f32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952734:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3f24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952739:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3f24 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952743:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3f24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952747:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdeac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.952749:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3f24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952753:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3f24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952759:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999786.952761:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.952762:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3f24 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999786.952766:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3f24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999786.952772:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131c3c000 reply state ffff880134aef000 transno 4294985857 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999786.952777:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999786.952790:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3f1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65200 expref: 581 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.952801:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3f32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65200 expref: 580 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.952806:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2e:0x0].0x0 (ffff88009330d700) 00010000:00010000:0.0:1716999786.952808:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999786.952810:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdef40, rc 0) 00000100:00100000:0.0:1716999786.952845:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+581:11420:x1800404480656320:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 791us (875us total) trans 4294985857 rc 0/0 00000100:00100000:0.0:1716999786.952850:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45199 00000100:00100000:3.0:1716999786.954128:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.955068:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480656384 00000100:00100000:2.0:1716999786.955075:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480656384 00000100:00100000:2.0:1716999786.955101:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45200 00000100:00100000:2.0:1716999786.955106:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+581:11419:x1800404480656384:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.955118:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.955130:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3f40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65207 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.955165:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3f47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955174:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3f47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955182:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3f47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955191:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3f4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955195:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3f4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955200:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3f4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955241:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3f47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955246:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3f47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955252:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3f47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955256:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.955258:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3f47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955263:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3f47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955272:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999786.955274:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.955277:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3f47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955281:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc3f47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955291:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3f4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955301:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3f4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955305:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3f4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.955309:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.955311:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3f4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.955315:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3f2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.955319:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3f4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.955320:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3f2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.955324:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff880134241700) 00010000:00010000:1.0:1716999786.955325:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3f2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.955326:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.955328:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3f4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.955329:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.955331:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3f2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.955332:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc3f4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.955335:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3f2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.955341:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009330d200) 00010000:00010000:1.0:1716999786.955342:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.955344:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3f2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.955348:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc3f2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999786.955360:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3f40 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65207 expref: 581 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.955366:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc3f40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65207 expref: 581 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.955373:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9680, rc 0) 00000100:00100000:2.0:1716999786.955404:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+580:11419:x1800404480656384:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 293us (1274us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999786.955410:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45200 00000100:00100000:3.0:1716999786.955587:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.955636:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480656448 00000100:00100000:1.0:1716999786.955640:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480656448 00000100:00100000:1.0:1716999786.955657:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9915 00000100:00100000:1.0:1716999786.955662:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b87e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480656448:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.955668:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.955678:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3f55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6520e expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1716999786.955693:0:15837:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1716999786.955702:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.955703:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.955707:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3f55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6520e expref: 75 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999786.955716:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3f55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6520e expref: 75 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999786.955723:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132640, rc 0) 00000100:00100000:1.0:1716999786.955747:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b87e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+75:1959:x1800404480656448:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 84us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.955752:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9915 00000100:00100000:3.0:1716999786.956900:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.956964:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480656512 00000100:00100000:0.0:1716999786.956969:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480656512 00000100:00100000:0.0:1716999786.956986:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45201 00000100:00100000:0.0:1716999786.956990:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+580:11419:x1800404480656512:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.957000:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.957009:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3f5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65215 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.957024:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3f5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65215 expref: 581 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.957031:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3f5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65215 expref: 581 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.957036:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.957038:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.957040:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc000, rc 0) 00000100:00100000:0.0:1716999786.957056:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+581:11419:x1800404480656512:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 65us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.957060:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45201 00000100:00100000:0.0:1716999786.957701:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.957875:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480656640 00000100:00100000:1.0:1716999786.957901:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480656640 00000100:00100000:1.0:1716999786.957922:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9009 00000100:00100000:1.0:1716999786.957927:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+581:11420:x1800404480656640:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999786.958277:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11369, 168 off2033208 00000001:00080000:1.0:1716999786.958282:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985858 00000100:00100000:1.0:1716999786.958447:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+583:11420:x1800404480656640:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 518us (745us total) trans 4294985859 rc 0/0 00000100:00100000:2.0:1716999786.958516:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.958530:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480656704 00000100:00100000:0.0:1716999786.958533:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480656704 00000100:00100000:0.0:1716999786.958554:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9010 00000100:00100000:0.0:1716999786.958558:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+584:11419:x1800404480656704:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999786.958568:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9009 00000020:00080000:1.0:1716999786.958571:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999786.960260:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.960356:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480656832 00000100:00100000:3.0:1716999786.960361:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480656832 00000100:00100000:3.0:1716999786.960621:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45202 00000100:00100000:3.0:1716999786.960627:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+584:11420:x1800404480656832:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:0.0:1716999786.960641:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+584:11419:x1800404480656704:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2081us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.960647:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9010 00010000:00010000:3.0:1716999786.960655:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999786.960672:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3f32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65200 expref: 583 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999786.960690:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2e:0x0].0x0 (ffff88009330d700) 00010000:00010000:3.0:1716999786.960697:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999786.960786:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3f63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.960797:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3f63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.960803:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3f63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.960813:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3f6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.960818:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3f6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.960834:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3f6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.960932:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3f71 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.960939:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3f71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.960944:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3f71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:3.0:1716999786.961314:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1473, 64 off102528 00000004:00080000:3.0:1716999786.961318:0:7785:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 306160438017ns, next at 307160436847ns, rc = 0 00000040:00080000:3.0:1716999786.961334:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11370, 184 off2033392 00010000:00010000:3.0:1716999786.961377:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3f78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961383:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3f78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961388:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3f78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961393:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3f78 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961397:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3f78 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961401:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3f78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961406:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3f78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961411:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c973c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999786.961413:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3f78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961418:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3f78 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961424:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2e:0x0].0x0 (ffff88009439cc00) 00010000:00010000:3.0:1716999786.961426:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999786.961428:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3f78 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961431:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc3f78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961445:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3f71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961449:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3f71 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961453:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3f71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961456:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.961457:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3f71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961461:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3f71 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961465:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2e:0x0].0x0 (ffff88009439cc00) 00010000:00010000:3.0:1716999786.961467:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999786.961469:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3f71 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961473:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc3f71 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961505:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3f63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961508:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3f63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961512:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3f63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961515:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.961517:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3f63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961520:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3f63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961525:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999786.961526:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.961528:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3f63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.961532:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc3f63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999786.961539:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131c3e300 reply state ffff880133933000 transno 4294985860 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3f6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999786.961544:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999786.961585:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+584:11420:x1800404480656832:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 958us (1327us total) trans 4294985860 rc 0/0 00000100:00100000:3.0:1716999786.961591:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45202 00010000:00010000:3.0:1716999786.962436:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3f6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.962443:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3f6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.962448:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3f6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.962452:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999786.962454:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3f6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.962459:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3f6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.962467:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009439c500) 00010000:00010000:3.0:1716999786.962469:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999786.962471:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3f6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999786.962475:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc3f6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999786.962751:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.962977:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480656896 00000100:00100000:1.0:1716999786.962984:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480656896 00000100:00100000:1.0:1716999786.963019:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9916 00000100:00100000:1.0:1716999786.963025:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+73:11419:x1800404480656896:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.963035:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.963045:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6521c expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.963063:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c131680/0x6d188eabd8dc3f16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651f9 expref: 74 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999786.963070:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.963072:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999786.963074:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6521c expref: 74 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.963204:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c131680/0x6d188eabd8dc3f16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651f9 expref: 74 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999786.963218:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c131680/0x6d188eabd8dc3f16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651f9 expref: 74 pid: 15837 timeout: 406 lvb_type: 1 00000100:00100000:1.0:1716999786.963229:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135029500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15837:1800404483007744:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999786.963274:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930ef240 going to sleep for 11 seconds 00000100:00100000:2.0:1716999786.963294:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.963358:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480656960 00000100:00100000:0.0:1716999786.963362:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480656960 00000100:00100000:0.0:1716999786.963385:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45203 00000100:00100000:0.0:1716999786.963389:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+583:11420:x1800404480656960:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.963399:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.963407:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3f86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65223 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.963519:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3f8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963528:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3f8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963534:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3f8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963544:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3f94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963549:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963558:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963603:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3f8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963608:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3f8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963612:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3f8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963616:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.963618:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3f8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963623:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3f8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963630:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999786.963632:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.963634:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3f8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963639:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3f8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963647:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3f94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963651:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3f94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963655:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3f94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963658:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.963660:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3f94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963664:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3f94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963670:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009330d300) 00010000:00010000:0.0:1716999786.963671:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.963673:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3f94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963677:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3f94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.963710:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3f86 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65223 expref: 584 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.963717:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3f86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65223 expref: 584 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.963723:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:0.0:1716999786.963754:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+583:11420:x1800404480656960:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 363us (459us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.963760:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45203 00000100:00100000:1.0:1716999786.964460:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880135029500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15837:1800404483007744:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999786.964476:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6521c expref: 74 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.964484:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132880, rc 0) 00000100:00100000:1.0:1716999786.964560:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+74:11419:x1800404480656896:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1534us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.964565:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9916 00000100:00100000:2.0:1716999786.965662:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.965711:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480657024 00000100:00100000:0.0:1716999786.965719:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480657024 00010000:00010000:0.0:1716999786.965737:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c131680/0x6d188eabd8dc3f16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651f9 expref: 74 pid: 15837 timeout: 406 lvb_type: 1 00000100:00100000:0.0:1716999786.965770:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4502 00000100:00100000:0.0:1716999786.965776:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480657024:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999786.965784:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999786.965799:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c131680/0x6d188eabd8dc3f16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651f9 expref: 74 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:0.0:1716999786.965807:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c131680/0x6d188eabd8dc3f16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651f9 expref: 74 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:0.0:1716999786.965831:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c131680/0x6d188eabd8dc3f16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651f9 expref: 74 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:0.0:1716999786.965925:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999786.965927:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999786.965932:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6521c expref: 73 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.965939:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6521c expref: 73 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.965961:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6521c expref: 73 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999786.965971:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483007808:192.168.203.3@tcp:105: 00000100:00100000:0.0:1716999786.965998:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff880131d17e40 going to sleep for 11 seconds 00000100:00100000:2.0:1716999786.966085:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.966194:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480657088 00000100:00100000:1.0:1716999786.966198:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480657088 00000100:00100000:1.0:1716999786.966217:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45204 00000100:00100000:1.0:1716999786.966222:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+583:11420:x1800404480657088:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.966237:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.966248:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3f9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6522a expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.966265:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6522a expref: 584 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.966274:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3f9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6522a expref: 584 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.966280:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999786.966282:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.966284:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133840, rc 0) 00000100:00100000:1.0:1716999786.966303:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+584:11420:x1800404480657088:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 80us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.966308:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45204 00000100:00100000:2.0:1716999786.968471:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.968541:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483007808:192.168.203.3@tcp:105: 00010000:00010000:0.0:1716999786.968555:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999786.968589:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480657024:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2813us (2928us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.968597:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4502 00000100:00100000:1.0:1716999786.968651:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480657152 00000100:00100000:1.0:1716999786.968656:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480657152 00000100:00100000:1.0:1716999786.968677:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9011 00000100:00100000:1.0:1716999786.968682:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+584:11420:x1800404480657152:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999786.970167:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.970185:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480657280 00000100:00100000:0.0:1716999786.970189:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480657280 00000100:00100000:0.0:1716999786.970218:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9012 00000100:00100000:0.0:1716999786.970223:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+586:11419:x1800404480657280:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999786.970713:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+586:11420:x1800404480657152:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2030us (2244us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.970719:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9011 00000040:00080000:0.0:1716999786.970730:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11371, 168 off2033560 00000001:00080000:0.0:1716999786.970735:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985861 00000100:00100000:0.0:1716999786.970784:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+586:11419:x1800404480657280:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 560us (618us total) trans 4294985862 rc 0/0 00000100:00100000:0.0:1716999786.970790:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9012 00000020:00080000:0.0:1716999786.970792:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999786.973677:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.974590:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.974779:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480657344 00000100:00100000:1.0:1716999786.974787:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480657344 00000100:00100000:1.0:1716999786.974813:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480657472 00000100:00100000:1.0:1716999786.974815:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480657472 00000100:00100000:1.0:1716999786.974837:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45205 00000100:00100000:1.0:1716999786.974843:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+587:11420:x1800404480657344:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.974856:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.974870:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3fa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65231 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.974924:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3fa9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.974934:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3fa9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.974942:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3fa9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.974952:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3fb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.974957:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.974961:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999786.974964:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45206 00000100:00100000:2.0:1716999786.974970:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+588:11419:x1800404480657472:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.974982:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.974991:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc3fb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65238 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.975016:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3fa9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.975022:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3fa9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.975027:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3fa9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.975032:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.975035:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3fa9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.975041:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3fa9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.975046:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc3fbe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.975049:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999786.975052:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.975054:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc3fbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc2d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.975055:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3fa9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999786.975060:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc3fbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc2d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999786.975060:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc3fa9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00200000:2.0:1716999786.975067:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2d:0x0]: returning size 15360 00010000:00010000:1.0:1716999786.975070:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3fb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.975074:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3fb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.975078:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.975085:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.975087:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3fb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.975092:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3fb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.975098:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009240e500) 00010000:00010000:1.0:1716999786.975100:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.975102:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3fb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.975106:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc3fb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.975137:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3fa2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65231 expref: 590 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.975143:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc3fa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65231 expref: 590 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.975149:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130480, rc 0) 00010000:00010000:2.0:1716999786.975161:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc3fb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65238 expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.975172:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc3fbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc2d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65238 expref: 589 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.975177:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:2.0:1716999786.975180:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999786.975181:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9f80, rc 0) 00000100:00100000:1.0:1716999786.975185:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480657344:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 342us (1513us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999786.975190:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45205 00000100:00100000:2.0:1716999786.975199:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+588:11419:x1800404480657472:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 229us (611us total) trans 4294985863 rc 0/0 00000100:00100000:2.0:1716999786.975205:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45206 00000100:00100000:3.0:1716999786.977245:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.977313:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480657600 00000100:00100000:0.0:1716999786.977319:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480657600 00000100:00100000:0.0:1716999786.977354:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45207 00000100:00100000:0.0:1716999786.977360:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+588:11419:x1800404480657600:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999786.977391:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999786.977406:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc3ef3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651eb expref: 588 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.977416:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:0.0:1716999786.977420:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999786.977455:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3fcc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.977467:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3fcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.977473:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3fcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999786.977695:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008927f100 reply state ffff8800926fd000 transno 4294985864 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3fcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999786.977701:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999786.978981:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+589:11419:x1800404480657600:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1617us (1737us total) trans 4294985864 rc 0/0 00000100:00100000:0.0:1716999786.978987:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45207 00000100:00100000:3.0:1716999786.979217:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.979265:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480657664 00000100:00100000:0.0:1716999786.979271:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480657664 00000100:00100000:0.0:1716999786.979376:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45208 00000100:00100000:0.0:1716999786.979382:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480657664:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.979392:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.979403:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3fd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6523f expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.979435:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3fda lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979443:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979451:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979460:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3fe1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979465:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979470:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979511:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3fda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979517:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3fda lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979522:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3fda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979527:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.979530:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3fda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979535:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3fda lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979544:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999786.979547:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.979550:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3fda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979554:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc3fda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979561:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3fe1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979565:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3fe1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979569:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979573:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.979574:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3fe1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979578:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3fe1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979583:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x68e4194e (ffff88009330d300) 00010000:00010000:0.0:1716999786.979584:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.979586:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3fe1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979590:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc3fe1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.979614:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3fd3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6523f expref: 590 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.979689:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc3fd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6523f expref: 590 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.979698:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:0.0:1716999786.979729:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480657664:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 347us (513us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.979734:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45208 00010000:00010000:1.0:1716999786.980052:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3fcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.980059:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3fcc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.980067:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3fcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.980071:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.980073:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3fcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.980078:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3fcc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.980085:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:1.0:1716999786.980087:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.980089:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3fcc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.980093:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc3fcc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999786.980229:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.980256:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480657728 00000100:00100000:0.0:1716999786.980260:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480657728 00000100:00100000:0.0:1716999786.980283:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45209 00000100:00100000:0.0:1716999786.980286:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+588:11419:x1800404480657728:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.980294:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.980299:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3fe8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65246 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.980320:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65246 expref: 589 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.980327:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3fe8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc2d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65246 expref: 589 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.980338:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:0.0:1716999786.980340:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1716999786.980341:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcd80, rc 0) 00000100:00100000:0.0:1716999786.980368:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+589:11419:x1800404480657728:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 79us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.980373:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45209 00000100:00100000:2.0:1716999786.981389:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.981853:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480657792 00000100:00100000:0.0:1716999786.981938:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480657792 00000100:00100000:3.0:1716999786.982104:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.982189:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480657856 00000100:00100000:1.0:1716999786.982192:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480657856 00000100:00100000:1.0:1716999786.982211:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9917 00000100:00100000:1.0:1716999786.982215:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480657856:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:1.0:1716999786.982396:0:15837:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1716999786.982399:0:15837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb mtime from disk: 0 -> 1716999775 00002000:00010000:1.0:1716999786.982401:0:15837:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb atime from disk: 0 -> 1716999777 00002000:00010000:1.0:1716999786.982403:0:15837:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb ctime from disk: 0 -> 1716999787 00002000:00010000:1.0:1716999786.982405:0:15837:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1716999786.982429:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480657856:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 213us (325us total) trans 4294970162 rc 0/0 00000100:00100000:1.0:1716999786.982438:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9917 00000100:00100000:0.0:1716999786.982552:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45210 00000100:00100000:0.0:1716999786.982557:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480657792:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.982565:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.982575:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3fef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6524d expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.982606:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ff6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982619:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982626:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982636:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3ffd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982641:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982645:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982684:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ff6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982689:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ff6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982694:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982698:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdfcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.982701:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ff6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982706:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ff6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982714:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999786.982716:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.982719:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ff6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982723:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc3ff6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982730:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3ffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982734:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3ffd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982738:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3ffd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982742:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddb00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.982744:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3ffd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982748:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3ffd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982753:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x68e4194e (ffff88009330d200) 00010000:00010000:0.0:1716999786.982755:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.982756:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3ffd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982760:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc3ffd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.982788:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3fef lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6524d expref: 590 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.982795:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc3fef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6524d expref: 590 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.982802:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdeac0, rc 0) 00000100:00100000:0.0:1716999786.982832:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480657792:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 274us (1444us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.982837:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45210 00000100:00100000:3.0:1716999786.983849:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.984391:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480657920 00000100:00100000:2.0:1716999786.984397:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480657920 00000100:00100000:3.0:1716999786.984498:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999786.984651:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658048 00000100:00100000:2.0:1716999786.984654:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658048 00000100:00100000:2.0:1716999786.984684:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45211 00000100:00100000:2.0:1716999786.984690:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+590:11419:x1800404480657920:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.984701:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.984711:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4004 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65254 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.984741:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc400b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.984749:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc400b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.984756:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc400b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:2.0:1716999786.984778:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2d:0x0]: returning size 15360 00000004:00200000:2.0:1716999786.984782:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999786.984793:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc400b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.984807:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4004 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65254 expref: 592 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.984829:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc400b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65254 expref: 591 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.984835:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:2.0:1716999786.984837:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1716999786.984839:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8240, rc 0) 00000100:00100000:2.0:1716999786.984864:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480657920:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 175us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999786.984869:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45211 00000100:00100000:2.0:1716999786.984900:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45212 00000100:00100000:2.0:1716999786.984904:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+590:11420:x1800404480658048:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999786.984910:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999786.984912:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1716999786.984921:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc3f9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6522a expref: 590 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.984930:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999786.984933:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999786.984937:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4012 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6525b expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.985008:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4019 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985014:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4019 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985019:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4019 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985029:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4020 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985033:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985041:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:2.0:1716999786.985398:0:11055:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5fc:0x0], index 1: 0 00000040:00080000:2.0:1716999786.985457:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11372, 184 off2033744 00010000:00010000:2.0:1716999786.985539:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc4027 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985545:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc4027 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985550:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc4027 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985568:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4019 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985573:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4019 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985577:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4019 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985581:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999786.985583:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4019 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985588:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4019 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985594:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999786.985596:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999786.985599:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4019 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999786.985603:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4019 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999786.985610:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012ea9f800 reply state ffff880089363000 transno 4294985865 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999786.985615:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999786.985628:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4012 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6525b expref: 592 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.985635:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc4027 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6525b expref: 591 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999786.985639:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:2.0:1716999786.985641:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999786.985642:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ebcc0, rc 0) 00000100:00100000:2.0:1716999786.985662:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480658048:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 757us (1164us total) trans 4294985865 rc 0/0 00000100:00100000:2.0:1716999786.985667:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45212 00010000:00010000:0.0:1716999786.987078:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.987087:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4020 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.987092:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4020 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.987096:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.987099:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4020 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.987104:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4020 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.987113:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x68e4194e (ffff880134241100) 00010000:00010000:0.0:1716999786.987115:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.987118:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4020 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999786.987122:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4020 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999786.987490:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.987557:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658112 00000100:00100000:0.0:1716999786.987563:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658112 00000100:00100000:0.0:1716999786.987586:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45213 00000100:00100000:0.0:1716999786.987591:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480658112:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.987603:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.987614:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4035 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65262 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.987649:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc403c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987657:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc403c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987663:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc403c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987672:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4043 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987676:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987681:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987751:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc404a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987757:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc404a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987763:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc404a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:0.0:1716999786.987782:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2d:0x0]: returning size 15360 00000004:00200000:0.0:1716999786.987786:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999786.987795:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc404a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987802:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc404a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987807:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc403c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987811:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc403c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987816:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc403c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987830:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.987833:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc403c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987838:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc403c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987844:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999786.987846:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.987849:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc403c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987853:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc403c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987861:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4043 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987865:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4043 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987870:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4043 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987873:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.987875:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4043 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987897:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4043 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987904:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x68e4194e (ffff88009330d600) 00010000:00010000:0.0:1716999786.987906:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.987908:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4043 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987912:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4043 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.987931:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4035 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65262 expref: 593 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.987941:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc404a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65262 expref: 592 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.987947:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:0.0:1716999786.987948:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999786.988001:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcfc0, rc 0) 00000100:00100000:0.0:1716999786.988028:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480658112:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 437us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999786.988034:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45213 00000100:00100000:3.0:1716999786.988105:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999786.988122:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658176 00000100:00100000:3.0:1716999786.988125:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658176 00000100:00100000:3.0:1716999786.988144:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9918 00000100:00100000:3.0:1716999786.988148:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+74:1958:x1800404480658176:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999786.988155:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999786.988164:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090c961c0/0x6d188eabd8dc4051 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65269 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999786.988179:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x5fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999786.988189:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.988191:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999786.988196:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c961c0/0x6d188eabd8dc4051 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65269 expref: 75 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.988205:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090c961c0/0x6d188eabd8dc4051 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65269 expref: 75 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999786.988212:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c961c0, rc 0) 00000100:00100000:3.0:1716999786.988226:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+75:1958:x1800404480658176:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 77us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999786.988231:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9918 00000100:00100000:3.0:1716999786.989396:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.990218:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658240 00000100:00100000:1.0:1716999786.990224:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658240 00000100:00100000:3.0:1716999786.990238:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.990286:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658368 00000100:00100000:1.0:1716999786.990292:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658368 00000100:00100000:0.0:1716999786.990296:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45214 00000100:00100000:0.0:1716999786.990306:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+593:11420:x1800404480658240:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999786.990318:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999786.990330:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4058 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65270 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999786.990354:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45215 00000100:00100000:1.0:1716999786.990359:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480658368:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999786.990365:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc405f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990375:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc405f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.990381:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999786.990381:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc405f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990391:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4066 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.990393:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc404a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65262 expref: 594 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.990396:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990400:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.990411:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc400b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65254 expref: 593 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.990418:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:1.0:1716999786.990422:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999786.990441:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc406d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.990446:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc405f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.990448:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc406d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.990451:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc405f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999786.990454:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc406d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999786.990455:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc405f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990459:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.990462:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc405f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990468:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc405f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990474:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999786.990476:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.990479:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc405f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990483:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc405f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990490:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990494:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4066 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990498:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4066 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990502:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999786.990503:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4066 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990508:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4066 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990513:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009330dd00) 00010000:00010000:0.0:1716999786.990515:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999786.990516:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4066 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990524:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4066 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999786.990553:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4058 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65270 expref: 592 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.990561:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4058 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65270 expref: 592 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999786.990567:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde640, rc 0) 00000100:00100000:0.0:1716999786.990641:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480658240:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 334us (1246us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999786.990646:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45214 00000004:00010000:1.0:1716999786.990753:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012ea9fb80 reply state ffff8800935b5000 transno 4294985866 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc406d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999786.990760:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999786.990808:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480658368:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 448us (571us total) trans 4294985866 rc 0/0 00000100:00100000:1.0:1716999786.990815:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45215 00010000:00010000:1.0:1716999786.992299:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc406d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.992306:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc406d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.992311:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc406d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.992314:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.992317:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc406d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.992321:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc406d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.992328:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:1.0:1716999786.992331:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.992333:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc406d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.992337:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc406d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999786.993106:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.993409:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658432 00000100:00100000:0.0:1716999786.993415:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658432 00000100:00100000:0.0:1716999786.993452:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9919 00000100:00100000:0.0:1716999786.993458:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+75:1957:x1800404480658432:12345-192.168.203.3@tcp:2:dbench.0 00000100:00100000:3.0:1716999786.993496:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.993628:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658496 00000100:00100000:1.0:1716999786.993631:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658496 00000100:00100000:1.0:1716999786.993661:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45216 00000100:00100000:1.0:1716999786.993666:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480658496:12345-192.168.203.3@tcp:101:dbench.0 00002000:00010000:0.0:1716999786.993671:0:15837:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999786.993675:0:15837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb mtime from disk: 1716999775 -> 1716999763 00010000:00010000:1.0:1716999786.993677:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1716999786.993677:0:15837:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb atime from disk: 1716999777 -> 1716999767 00010000:00010000:1.0:1716999786.993688:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4074 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65277 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1716999786.993756:0:15837:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:0.0:1716999786.993758:0:15837:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1716999786.993792:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+76:1957:x1800404480658432:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 334us (687us total) trans 4294970163 rc 0/0 00000100:00100000:0.0:1716999786.993798:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9919 00010000:00010000:1.0:1716999786.993995:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4074 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65277 expref: 592 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.994128:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4074 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65277 expref: 592 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.994135:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999786.994138:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.994140:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133840, rc 0) 00000100:00100000:1.0:1716999786.994267:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480658496:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 599us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999786.994273:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45216 00000100:00100000:3.0:1716999786.996971:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999786.997080:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658560 00000100:00100000:0.0:1716999786.997086:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658560 00000100:00100000:0.0:1716999786.997122:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9013 00000100:00100000:0.0:1716999786.997127:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480658560:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999786.997842:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999786.998732:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658624 00000100:00100000:1.0:1716999786.998738:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658624 00000100:00100000:1.0:1716999786.999122:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45217 00000100:00100000:1.0:1716999786.999128:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480658624:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999786.999143:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999786.999236:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc407b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6527e expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999786.999424:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4082 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999436:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4082 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999445:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4082 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999457:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4089 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999462:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4089 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999466:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4089 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999777:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4090 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999785:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999791:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:1.0:1716999786.999812:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2d:0x0]: returning size 15360 00000004:00200000:1.0:1716999786.999815:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999786.999836:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999844:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999850:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4082 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999858:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4082 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999863:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4082 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999871:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999786.999874:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4082 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999965:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4082 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999975:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999786.999977:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999786.999980:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4082 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999786.999985:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4082 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.000110:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4089 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.000115:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4089 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.000119:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4089 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.000123:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.000125:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4089 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.000130:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4089 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.000136:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x68e4194e (ffff88009240e200) 00010000:00010000:1.0:1716999787.000139:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.000141:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4089 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.000145:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4089 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.000167:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc407b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6527e expref: 596 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.000176:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4090 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6527e expref: 595 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.000180:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:1.0:1716999787.000182:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.000184:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131440, rc 0) 00000100:00100000:1.0:1716999787.000232:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+595:11419:x1800404480658624:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1103us (2393us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.000238:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45217 00000100:00100000:0.0:1716999787.007671:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+593:11420:x1800404480658560:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 10533us (10694us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.007682:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9013 00000100:00100000:3.0:1716999787.009020:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.009986:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658688 00000100:00100000:1.0:1716999787.009994:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658688 00000100:00100000:1.0:1716999787.010257:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45218 00000100:00100000:1.0:1716999787.010263:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480658688:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.010277:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.010291:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4097 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65285 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.010333:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc409e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010346:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc409e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010355:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc409e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010364:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc40a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010369:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc40a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010373:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc40a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010424:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc409e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010429:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc409e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010434:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc409e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010438:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.010441:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc409e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010447:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc409e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010455:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.010457:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.010460:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc409e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010465:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc409e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010477:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc40a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010482:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc40a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010486:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc40a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010489:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.010491:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc40a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010496:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc40a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010502:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff88009240e800) 00010000:00010000:1.0:1716999787.010504:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.010506:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc40a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010510:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc40a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.010541:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4097 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65285 expref: 594 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.010548:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4097 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65285 expref: 594 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.010555:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130fc0, rc 0) 00000100:00080000:3.0:1716999787.010748:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1716999757 00000100:00100000:1.0:1716999787.011257:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480658688:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 991us (2238us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.011263:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45218 00000100:00100000:2.0:1716999787.012408:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.012464:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658752 00000100:00100000:0.0:1716999787.012470:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658752 00000100:00100000:0.0:1716999787.012504:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9920 00000100:00100000:0.0:1716999787.012509:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+76:11420:x1800404480658752:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.012518:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.012530:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6528c expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.012548:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c961c0/0x6d188eabd8dc4051 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65269 expref: 77 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999787.012554:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.012556:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.012558:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6528c expref: 77 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.012581:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090c961c0/0x6d188eabd8dc4051 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65269 expref: 77 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999787.012591:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090c961c0/0x6d188eabd8dc4051 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65269 expref: 77 pid: 17864 timeout: 406 lvb_type: 1 00000100:00100000:0.0:1716999787.012608:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15837:1800404483007872:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999787.012662:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff880131d17180 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.013748:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15837:1800404483007872:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999787.013767:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6528c expref: 77 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.013778:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc900, rc 0) 00000100:00100000:0.0:1716999787.013811:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+77:11420:x1800404480658752:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1301us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.013816:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9920 00000100:00100000:3.0:1716999787.016443:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.016724:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.016795:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658816 00000100:00100000:0.0:1716999787.016801:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658816 00010000:00010000:0.0:1716999787.016835:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090c961c0/0x6d188eabd8dc4051 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65269 expref: 77 pid: 17864 timeout: 406 lvb_type: 1 00000100:00100000:0.0:1716999787.016868:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4503 00000100:00100000:0.0:1716999787.016874:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480658816:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999787.016903:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999787.016933:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090c961c0/0x6d188eabd8dc4051 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65269 expref: 77 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:0.0:1716999787.016944:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090c961c0/0x6d188eabd8dc4051 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65269 expref: 77 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:0.0:1716999787.016965:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090c961c0/0x6d188eabd8dc4051 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65269 expref: 77 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:0.0:1716999787.016980:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.016982:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.016987:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6528c expref: 76 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.016994:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6528c expref: 76 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.017018:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6528c expref: 76 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999787.017029:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483007936:192.168.203.3@tcp:105: 00000100:00100000:0.0:1716999787.017064:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff880131d17180 going to sleep for 11 seconds 00000100:00100000:1.0:1716999787.017519:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480658880 00000100:00100000:1.0:1716999787.017524:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480658880 00000100:00100000:1.0:1716999787.017546:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45219 00000100:00100000:1.0:1716999787.017551:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480658880:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.017564:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.017576:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65293 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.017613:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc40ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.017622:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc40ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.017975:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc40ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.017988:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.017994:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018000:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018055:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc40ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018060:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc40ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018065:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc40ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018069:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.018072:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc40ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018077:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc40ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018085:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.018087:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.018090:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc40ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018094:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc40ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018114:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018120:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018124:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018131:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.018133:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018137:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018143:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff88009240ea00) 00010000:00010000:1.0:1716999787.018145:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.018147:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018151:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.018181:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40b3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65293 expref: 594 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.018187:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65293 expref: 594 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.018194:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131b00, rc 0) 00000100:00100000:1.0:1716999787.018232:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480658880:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 680us (1507us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.018238:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45219 00000100:00100000:3.0:1716999787.021977:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.024942:0:6836:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480659008 00000100:00100000:1.0:1716999787.024953:0:6836:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480659008 00000100:00100000:0.0:1716999787.025565:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483007936:192.168.203.3@tcp:105: 00010000:00010000:0.0:1716999787.025581:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999787.025616:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+76:1959:x1800404480658816:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 8742us (9177us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.025624:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4503 00000100:00100000:3.0:1716999787.026499:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.026980:0:6836:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 602 00000100:00100000:1.0:1716999787.026989:0:6836:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480659008:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.027026:0:6836:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999787.027045:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4090 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6527e expref: 593 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.027057:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:1.0:1716999787.027066:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc3f5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65215 expref: 592 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.027075:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.027077:0:6836:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.027130:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc40c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027140:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc40c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027146:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc40c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027155:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc40cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027160:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc40cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027165:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc40cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027180:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc40d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027185:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc40d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027190:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc40d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027260:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc40dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027266:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc40dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027271:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc40dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000040:00080000:1.0:1716999787.027578:0:6836:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11373, 224 off2033968 00000004:00010000:1.0:1716999787.027651:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012ea9ca80 reply state ffff88009944a000 transno 4294985867 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc40dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999787.027657:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999787.027660:0:6836:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc40c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027666:0:6836:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc40c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027671:0:6836:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc40c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027675:0:6836:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.027678:0:6836:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc40c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027684:0:6836:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc40c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027690:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.027693:0:6836:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.027696:0:6836:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc40c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.027700:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc40c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000004:00010000:1.0:1716999787.027708:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012ea9ca80 reply state ffff88009944a000 transno 4294985867 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc40cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999787.027712:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00010000:1.0:1716999787.027714:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012ea9ca80 reply state ffff88009944a000 transno 4294985867 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc40d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999787.027717:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1716999787.027723:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480659136 00000100:00100000:0.0:1716999787.027729:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480659136 00000100:00100000:0.0:1716999787.027763:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9014 00000100:00100000:0.0:1716999787.027768:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+594:11420:x1800404480659136:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999787.027770:0:6836:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480659008:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 783us (5799us total) trans 4294985867 rc 0/0 00000100:00100000:1.0:1716999787.027777:0:6836:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 602 00000040:00080000:0.0:1716999787.028032:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11374, 168 off2034136 00000001:00080000:0.0:1716999787.028036:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985868 00000100:00100000:0.0:1716999787.028083:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+595:11420:x1800404480659136:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 314us (1586us total) trans 4294985869 rc 0/0 00000100:00100000:0.0:1716999787.028088:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9014 00000020:00080000:0.0:1716999787.028090:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1716999787.030424:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc40d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030434:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc40d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030439:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc40d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030443:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.030446:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc40d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030451:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc40d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030462:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x68e4194e (ffff88009240e300) 00000100:00100000:3.0:1716999787.030463:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999787.030464:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.030467:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc40d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030471:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc40d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030484:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc40cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030493:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc40cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030497:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc40cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030501:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.030503:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc40cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030507:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc40cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030513:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff88009240e500) 00010000:00010000:0.0:1716999787.030515:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.030517:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc40cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030521:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc40cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999787.030528:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480659200 00010000:00010000:0.0:1716999787.030529:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc40dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030533:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc40dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999787.030534:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480659200 00010000:00010000:0.0:1716999787.030536:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc40dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030539:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.030541:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc40dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030546:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc40dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030551:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:0.0:1716999787.030553:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1716999787.030555:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc40dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.030559:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc40dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999787.031346:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45220 00000100:00100000:1.0:1716999787.031353:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480659200:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.031369:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.031381:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc40e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6529a expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.031504:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc40eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.031514:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc40eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.031524:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc40eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.031534:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.031539:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.031543:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.031620:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.031626:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.031631:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:1.0:1716999787.031652:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2d:0x0]: returning size 15360 00000004:00200000:1.0:1716999787.032626:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.032645:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.032654:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999787.032735:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.033800:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480659328 00000100:00100000:2.0:1716999787.033805:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480659328 00010000:00010000:1.0:1716999787.033833:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc40eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.033840:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc40eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999787.033862:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45221 00000100:00100000:2.0:1716999787.033867:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+596:11420:x1800404480659328:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.033893:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.033904:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4100 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652a1 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.033960:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4107 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.033968:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4107 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc2f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.033974:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4107 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc2f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:2.0:1716999787.033982:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2f:0x0]: returning size 15360 00010000:00010000:1.0:1716999787.033990:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc40eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.033994:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.033997:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc40eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.034001:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc40eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.034010:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.034012:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.034014:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc40eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.034018:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc40eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.034027:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.034032:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.034035:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.034038:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.034040:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.034044:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.034052:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff88009240e200) 00010000:00010000:1.0:1716999787.034053:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.034055:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.034058:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc40f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.034063:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4100 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652a1 expref: 599 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.034075:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc40e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6529a expref: 599 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.034076:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4107 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc2f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652a1 expref: 599 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.034081:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:2.0:1716999787.034083:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999787.034085:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9200, rc 0) 00010000:00010000:1.0:1716999787.034085:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6529a expref: 598 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.034089:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:1.0:1716999787.034090:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.034091:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131680, rc 0) 00000100:00100000:1.0:1716999787.034311:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480659200:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2957us (3848us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.034317:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45220 00000100:00100000:2.0:1716999787.034693:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+597:11420:x1800404480659328:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 824us (1958us total) trans 4294985870 rc 0/0 00000100:00100000:2.0:1716999787.034698:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45221 00000100:00100000:3.0:1716999787.040060:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.040765:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480659456 00000100:00100000:2.0:1716999787.040772:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480659456 00000100:00100000:2.0:1716999787.040817:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45222 00000100:00100000:2.0:1716999787.040832:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+597:11420:x1800404480659456:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999787.040871:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999787.040916:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc4027 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6525b expref: 597 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.040937:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:2.0:1716999787.040941:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.040980:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4115 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.040989:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.040997:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999787.041814:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.041909:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480659584 00000100:00100000:1.0:1716999787.041914:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480659584 00000100:00100000:1.0:1716999787.041947:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45223 00000100:00100000:1.0:1716999787.041953:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+597:11419:x1800404480659584:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.041962:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.041973:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc411c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652a8 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.042026:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4123 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.042034:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.042040:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4123 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:1.0:1716999787.042260:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2a:0x0]: returning size 53 00000004:00010000:2.0:1716999787.042296:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099445880 reply state ffff88009ee1e000 transno 4294985871 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.042302:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999787.042337:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc411c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652a8 expref: 602 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.042350:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4123 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652a8 expref: 601 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.042356:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2a:0x0].0x0 (ffff880131c40b00) 00010000:00010000:1.0:1716999787.042358:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1716999787.042360:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130fc0, rc 0) 00000100:00100000:2.0:1716999787.042371:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+601:11420:x1800404480659456:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1539us (2316us total) trans 4294985871 rc 0/0 00000100:00100000:2.0:1716999787.042377:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45222 00000100:00100000:1.0:1716999787.042379:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480659584:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 427us (567us total) trans 4294985872 rc 0/0 00000100:00100000:1.0:1716999787.042385:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45223 00000100:00100000:3.0:1716999787.045449:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.045480:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.045519:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999787.045640:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.045648:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4115 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.045653:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4115 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.045662:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.045665:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4115 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.045670:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4115 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.045682:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:1.0:1716999787.045685:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.045688:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4115 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.045692:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4115 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.045728:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480659648 00000100:00100000:1.0:1716999787.045735:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480659648 00000100:00100000:1.0:1716999787.045771:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 699 00000100:00100000:1.0:1716999787.045776:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+599:1956:x1800404480659648:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999787.045787:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999787.045798:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4123 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652a8 expref: 599 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.045806:0:6809:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2a:0x0].0x0 (ffff880131c40b00) 00010000:00010000:1.0:1716999787.045808:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999787.045845:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+598:1956:x1800404480659648:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 69us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.045851:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 699 00000100:00100000:0.0:1716999787.045957:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480659840 00000100:00100000:2.0:1716999787.045959:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480659776 00000100:00100000:0.0:1716999787.045960:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480659840 00000100:00100000:2.0:1716999787.045962:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480659776 00000100:00100000:2.0:1716999787.045978:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9015 00000100:00100000:2.0:1716999787.045982:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+599:11419:x1800404480659776:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999787.045988:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45224 00000100:00100000:0.0:1716999787.045992:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+599:11420:x1800404480659840:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.046001:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.046011:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc4131 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652af expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.046038:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc4131 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652af expref: 600 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.046046:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc4131 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652af expref: 600 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.046057:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:0.0:1716999787.046059:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1716999787.046060:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc000, rc 0) 00000100:00100000:0.0:1716999787.046076:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+600:11420:x1800404480659840:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 84us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.046081:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45224 00000040:00080000:2.0:1716999787.046218:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11375, 168 off2034304 00000100:00100000:2.0:1716999787.046284:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+600:11419:x1800404480659776:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 300us (840us total) trans 4294985873 rc 0/0 00000100:00100000:2.0:1716999787.046290:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9015 00000100:00100000:3.0:1716999787.051279:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.051301:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480659968 00000100:00100000:0.0:1716999787.051308:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480659968 00000100:00100000:0.0:1716999787.051344:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45225 00000100:00100000:0.0:1716999787.051350:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+600:11419:x1800404480659968:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:3.0:1716999787.051358:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.051379:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660032 00000100:00100000:0.0:1716999787.051382:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660032 00000100:00100000:0.0:1716999787.051402:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9921 00000100:00100000:0.0:1716999787.051406:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+76:1958:x1800404480660032:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999787.051566:0:15837:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999787.051569:0:15837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb mtime from disk: 0 -> 1716999775 00002000:00010000:0.0:1716999787.051571:0:15837:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb atime from disk: 0 -> 1716999777 00002000:00010000:0.0:1716999787.051573:0:15837:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb ctime from disk: 0 -> 1716999787 00002000:00010000:0.0:1716999787.051575:0:15837:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1716999787.051614:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+77:1958:x1800404480660032:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 207us (256us total) trans 4294970164 rc 0/0 00000100:00100000:0.0:1716999787.051620:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9921 00010000:00010000:0.0:1716999787.051644:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999787.051659:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc3d33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65143 expref: 600 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.051680:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2a:0x0].0x0 (ffff880131c40b00) 00010000:00010000:0.0:1716999787.051686:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.051702:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4138 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.051712:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4138 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.051720:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4138 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.051729:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc413f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.051734:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc413f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.051739:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc413f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.051802:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4146 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.051807:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4146 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.051812:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4146 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:0.0:1716999787.052172:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1474, 64 off102592 00000040:00080000:0.0:1716999787.052188:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11376, 184 off2034488 00010000:00010000:0.0:1716999787.052228:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc414d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052235:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc414d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052240:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc414d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052246:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc414d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052255:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc414d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052261:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc414d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052266:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc414d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052270:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcfc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999787.052273:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc414d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052278:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc414d lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052284:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2a:0x0].0x0 (ffff88009330de00) 00010000:00010000:0.0:1716999787.052287:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999787.052289:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc414d lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052294:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc414d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052312:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4146 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052317:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4146 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052322:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4146 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052327:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.052330:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4146 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052335:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4146 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052341:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2a:0x0].0x0 (ffff88009330de00) 00010000:00010000:0.0:1716999787.052342:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999787.052344:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4146 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052348:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4146 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052375:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4138 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052380:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4138 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052385:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4138 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052389:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.052391:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4138 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052395:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4138 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052400:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.052401:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.052403:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4138 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.052412:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4138 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999787.052418:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099445c00 reply state ffff880089075000 transno 4294985874 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc413f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.052424:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.052456:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480659968:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1105us (1188us total) trans 4294985874 rc 0/0 00000100:00100000:0.0:1716999787.052462:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45225 00000100:00100000:3.0:1716999787.057964:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.058030:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999787.058039:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc413f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.058048:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc413f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.058055:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc413f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.058059:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.058062:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc413f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.058068:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc413f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.058080:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7f675ee7 (ffff88009330d300) 00010000:00010000:1.0:1716999787.058083:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.058086:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc413f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.058090:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc413f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.058363:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660096 00000100:00100000:0.0:1716999787.058371:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660096 00000100:00100000:0.0:1716999787.058398:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660160 00000100:00100000:0.0:1716999787.058401:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660160 00000100:00100000:0.0:1716999787.058427:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45226 00000100:00100000:0.0:1716999787.058434:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480660096:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.058452:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.058464:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4154 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652b6 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.058501:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc415b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.058511:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc415b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.058515:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45227 00010000:00010000:0.0:1716999787.058518:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc415b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.058520:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480660160:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.058530:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.058538:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4162 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652bd expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1716999787.058542:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2f:0x0]: returning size 15360 00000004:00200000:0.0:1716999787.058546:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.058557:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc415b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.058562:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4169 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.058569:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4169 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.058572:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4154 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652b6 expref: 604 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.058575:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4169 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.058584:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4170 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.058589:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.058594:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059351:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4169 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059356:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4169 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059361:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4169 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059364:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.059366:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4169 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059371:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4169 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059378:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.059380:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.059382:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4169 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059385:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4169 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059393:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4170 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059397:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4170 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059401:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4170 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059404:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.059405:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4170 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059409:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4170 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059412:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4f4f46 (ffff88009240e500) 00010000:00010000:1.0:1716999787.059414:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.059415:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4170 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059418:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4170 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.059442:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4162 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652bd expref: 603 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.059447:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4162 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652bd expref: 603 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.059453:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130900, rc 0) 00000100:00100000:1.0:1716999787.059758:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480660160:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1235us (1726us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.059764:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45227 00010000:00010000:0.0:1716999787.060026:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc415b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652b6 expref: 601 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.060033:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:0.0:1716999787.060035:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1716999787.060036:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde1c0, rc 0) 00000100:00100000:0.0:1716999787.060055:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+601:11420:x1800404480660096:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1622us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.060060:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45226 00000100:00100000:1.0:1716999787.063598:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.063698:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660224 00000100:00100000:0.0:1716999787.063705:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660224 00000100:00100000:0.0:1716999787.063730:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45228 00000100:00100000:0.0:1716999787.063735:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480660224:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.063748:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.063761:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4177 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652c4 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.063788:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4177 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652c4 expref: 602 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.063797:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4177 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652c4 expref: 602 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.063807:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.063809:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.063811:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf3c0, rc 0) 00000100:00100000:0.0:1716999787.063898:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480660224:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 141us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.063904:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45228 00000100:00100000:3.0:1716999787.064005:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.064108:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660288 00000100:00100000:1.0:1716999787.064111:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660288 00000100:00100000:1.0:1716999787.064134:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45229 00000100:00100000:1.0:1716999787.064138:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480660288:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.064144:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.064151:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc417e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652cb expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.064182:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4185 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064189:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4185 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064195:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4185 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064204:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc418c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064208:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc418c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064213:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc418c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064283:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4193 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064292:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064296:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:1.0:1716999787.064315:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2f:0x0]: returning size 15360 00000004:00200000:1.0:1716999787.064318:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.064327:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064333:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4193 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064338:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4185 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064342:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4185 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064347:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4185 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064352:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.064354:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4185 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064361:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4185 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064368:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.064370:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.064372:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4185 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064376:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4185 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064385:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc418c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064389:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc418c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064393:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc418c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064396:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.064398:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc418c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064402:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc418c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064407:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x68e4194e (ffff88009240e800) 00010000:00010000:1.0:1716999787.064409:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.064410:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc418c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064414:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc418c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.064434:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc417e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652cb expref: 604 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.064441:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4193 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652cb expref: 603 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.064450:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:1.0:1716999787.064452:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.064454:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131d40, rc 0) 00000100:00100000:1.0:1716999787.064476:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480660288:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 336us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.064481:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45229 00000100:00100000:3.0:1716999787.066943:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.067129:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.067192:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660352 00000100:00100000:2.0:1716999787.067199:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660352 00000100:00100000:2.0:1716999787.067229:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9016 00000100:00100000:2.0:1716999787.067235:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480660352:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999787.067818:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660480 00000100:00100000:1.0:1716999787.067831:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660480 00000100:00100000:1.0:1716999787.067862:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45230 00000100:00100000:1.0:1716999787.067867:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480660480:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.067911:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999787.067928:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4193 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652cb expref: 605 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.067943:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc415b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652b6 expref: 604 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.067951:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:1.0:1716999787.067954:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.067974:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc419a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.067983:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc419a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.067990:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc419a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:1.0:1716999787.068236:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099447480 reply state ffff880091863000 transno 4294985875 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc419a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.068242:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999787.068284:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480660480:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 416us (1154us total) trans 4294985875 rc 0/0 00000100:00100000:1.0:1716999787.068289:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45230 00010000:00010000:1.0:1716999787.073330:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc419a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.073341:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc419a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.073346:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc419a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.073351:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.073354:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc419a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.073360:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc419a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.073372:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:1.0:1716999787.073374:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.073377:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc419a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.073381:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc419a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999787.074093:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.075234:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660544 00000100:00100000:0.0:1716999787.075241:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660544 00000100:00100000:0.0:1716999787.075283:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9922 00000100:00100000:0.0:1716999787.075290:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+77:1956:x1800404480660544:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999787.075443:0:15837:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999787.075446:0:15837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb mtime from disk: 1716999775 -> 1716999763 00002000:00010000:0.0:1716999787.075448:0:15837:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb atime from disk: 1716999777 -> 1716999767 00002000:00010000:0.0:1716999787.075450:0:15837:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:0.0:1716999787.075451:0:15837:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1716999787.075545:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480660352:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 8308us (8605us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.075553:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9016 00000100:00100000:0.0:1716999787.075630:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+78:1956:x1800404480660544:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 340us (1540us total) trans 4294970165 rc 0/0 00000100:00100000:0.0:1716999787.075635:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9922 00000100:00100000:3.0:1716999787.079594:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.080172:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660608 00000100:00100000:2.0:1716999787.080180:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660608 00000100:00100000:2.0:1716999787.080506:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45231 00000100:00100000:2.0:1716999787.080514:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480660608:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.080533:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.080547:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc41a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652d2 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.080588:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc41a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.080599:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc41a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.080607:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc41a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.080617:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc41af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.080622:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc41af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.080626:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc41af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.080673:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc41a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.080678:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc41a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.080682:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc41a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.080686:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.080688:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc41a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.080693:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc41a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.080700:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.080703:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.080706:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc41a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.080710:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc41a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.081847:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc41af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.081855:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc41af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.081860:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc41af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.081867:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.081869:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc41af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.081874:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc41af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.081894:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4f4f46 (ffff880134241000) 00010000:00010000:2.0:1716999787.081896:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.081899:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc41af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.081903:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc41af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.081952:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc41a1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652d2 expref: 603 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.081959:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc41a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652d2 expref: 603 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.081966:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8900, rc 0) 00000100:00100000:2.0:1716999787.082036:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480660608:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1522us (2445us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.082043:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45231 00000100:00100000:2.0:1716999787.083998:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.084456:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660672 00000100:00100000:0.0:1716999787.084464:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660672 00000100:00100000:0.0:1716999787.084646:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45232 00000100:00100000:0.0:1716999787.084653:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480660672:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.084667:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.084680:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc41b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652d9 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.084725:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc41bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084735:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc41bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084743:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc41bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084753:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084759:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084764:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084851:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc41cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084857:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc41cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084863:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc41cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:0.0:1716999787.084903:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2f:0x0]: returning size 15360 00000004:00200000:0.0:1716999787.084906:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.084930:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc41cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084938:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc41cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084944:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc41bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084949:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc41bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084953:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc41bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084958:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdeac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.084961:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc41bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084966:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc41bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084975:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.084977:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.084980:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc41bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.084985:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc41bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.085009:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.085014:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.085018:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.085022:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddb00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.085024:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.085028:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.085035:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x68e4194e (ffff88009330da00) 00010000:00010000:0.0:1716999787.085037:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.085039:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.085043:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.085064:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc41b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652d9 expref: 604 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.085073:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc41cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652d9 expref: 603 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.085078:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:0.0:1716999787.085080:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.085082:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdfcc0, rc 0) 00000100:00100000:0.0:1716999787.085125:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480660672:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 472us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.086298:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45232 00000100:00100000:3.0:1716999787.086415:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.086461:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660736 00000100:00100000:0.0:1716999787.086466:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660736 00000100:00100000:0.0:1716999787.087023:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45233 00000100:00100000:0.0:1716999787.087029:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480660736:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.087043:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.087055:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc41d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652e0 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.087087:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc41d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087097:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc41d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087104:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc41d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087114:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc41e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa12eb2e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087119:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc41e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087123:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc41e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087166:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc41d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087171:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc41d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087175:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc41d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087180:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.087182:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc41d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087188:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc41d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087195:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.087197:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.087200:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc41d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087204:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc41d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087211:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc41e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087216:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc41e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087220:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc41e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087223:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.087225:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc41e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087229:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc41e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087234:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xa12eb2e9 (ffff88009330d200) 00010000:00010000:0.0:1716999787.087236:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.087238:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc41e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087241:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc41e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.087270:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc41d2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652e0 expref: 604 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.087276:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc41d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652e0 expref: 604 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.087282:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:0.0:1716999787.087418:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480660736:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 388us (1003us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.087424:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45233 00010000:00010000:0.0:1716999787.089250:0:6810:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1716999787.089632:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.089674:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.089725:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660800 00000100:00100000:0.0:1716999787.089731:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660800 00000100:00100000:0.0:1716999787.089765:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660864 00000100:00100000:0.0:1716999787.089768:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660864 00000100:00100000:0.0:1716999787.089788:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45234 00000100:00100000:0.0:1716999787.089794:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+604:11419:x1800404480660800:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.089807:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.089830:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc41e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652e7 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.089869:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc41ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.089896:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc41ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.089905:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc41ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.089915:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc41f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.089920:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc41f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.089924:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc41f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.089969:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc41ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.089974:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc41ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.089979:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc41ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.089983:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.089986:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc41ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.089991:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc41ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.089999:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.090001:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.090004:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc41ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090008:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc41ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090018:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc41f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090022:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc41f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090026:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc41f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090030:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.090031:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc41f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090036:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc41f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090041:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x83e4194e (ffff88009330d300) 00010000:00010000:0.0:1716999787.090042:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.090044:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc41f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090048:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc41f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090077:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc41e7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652e7 expref: 605 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.090083:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc41e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652e7 expref: 605 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.090090:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf600, rc 0) 00000100:00100000:0.0:1716999787.090122:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+604:11419:x1800404480660800:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 328us (494us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.090128:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45234 00000100:00100000:0.0:1716999787.090141:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45235 00000100:00100000:0.0:1716999787.090145:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480660864:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.090151:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.090158:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652ee expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.090177:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4203 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090184:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4203 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090189:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4203 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090197:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc420a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090202:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc420a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090207:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc420a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090238:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4203 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090243:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4203 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090251:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4203 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090255:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdeac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.090257:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4203 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090261:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4203 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090267:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.090269:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.090271:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4203 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090275:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4203 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090281:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc420a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090285:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc420a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090289:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc420a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090292:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.090294:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc420a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090298:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc420a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090303:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009330d700) 00010000:00010000:0.0:1716999787.090305:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.090306:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc420a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090310:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc420a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.090334:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41fc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652ee expref: 604 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.090339:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc41fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652ee expref: 604 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.090345:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bddb00, rc 0) 00000100:00100000:0.0:1716999787.090360:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480660864:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 215us (686us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.090365:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45235 00000100:00100000:2.0:1716999787.092517:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.092624:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660928 00000100:00100000:3.0:1716999787.092630:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660928 00000100:00100000:3.0:1716999787.092666:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45236 00000100:00100000:3.0:1716999787.092671:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480660928:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.092683:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.092694:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4211 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652f5 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.092728:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4218 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092737:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4218 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092745:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4218 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092755:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc421f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092760:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc421f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092765:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc421f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092809:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4218 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092814:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4218 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092833:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4218 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092841:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.092843:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4218 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092849:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4218 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092857:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.092859:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.092862:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4218 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092866:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4218 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092913:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc421f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092918:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc421f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092922:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc421f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092926:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.092927:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc421f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092931:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc421f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092941:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x83e4194e (ffff88009439c200) 00010000:00010000:3.0:1716999787.092943:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.092945:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc421f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092949:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc421f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.092979:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4211 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652f5 expref: 604 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.092985:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4211 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652f5 expref: 604 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.092992:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95b00, rc 0) 00000100:00100000:3.0:1716999787.094216:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480660928:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1539us (1698us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.094223:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45236 00000100:00100000:0.0:1716999787.094437:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.094449:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480660992 00000100:00100000:3.0:1716999787.094454:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480660992 00000100:00100000:3.0:1716999787.094649:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45237 00000100:00100000:3.0:1716999787.094655:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480660992:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.094665:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.094675:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4226 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f652fc expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.094706:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc422d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094715:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc422d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094725:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc422d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094734:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4234 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094738:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094742:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094783:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc422d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094788:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc422d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094793:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc422d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094796:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.094799:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc422d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094803:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc422d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094810:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.094813:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.094815:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc422d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094831:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc422d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094841:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4234 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094845:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4234 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094849:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4234 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094853:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.094855:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4234 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094858:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4234 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094863:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009439cc00) 00010000:00010000:3.0:1716999787.094865:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.094867:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4234 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094871:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4234 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.094924:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4226 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652fc expref: 604 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.094930:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4226 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652fc expref: 604 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.094941:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94480, rc 0) 00000100:00100000:3.0:1716999787.094969:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480660992:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 314us (532us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.094974:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45237 00000100:00100000:3.0:1716999787.096227:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.096324:0:6836:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480661120 00000100:00100000:0.0:1716999787.096329:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.096330:0:6836:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480661120 00000100:00100000:1.0:1716999787.096364:0:6836:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 603 00000100:00100000:1.0:1716999787.096369:0:6836:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480661120:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.096394:0:6836:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999787.096406:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc41cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652d9 expref: 603 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.096420:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:1.0:1716999787.096427:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4074 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65277 expref: 602 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.096436:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.096438:0:6836:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.096472:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc423b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.096479:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc423b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.096485:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc423b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.096494:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4242 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.096499:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00000100:00100000:3.0:1716999787.096520:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480661248 00000100:00100000:3.0:1716999787.096526:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480661248 00000100:00100000:3.0:1716999787.096546:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45238 00000100:00100000:3.0:1716999787.096551:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480661248:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.096557:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.096559:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1716999787.096568:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4177 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652c4 expref: 602 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.096576:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.096578:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999787.096585:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc4249 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65303 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.096649:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc4250 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.096656:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc4250 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.096661:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc4250 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.096669:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4257 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.096674:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4257 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.096679:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4257 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.096782:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.096795:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc425e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.096800:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc425e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.096804:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc425e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.096906:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4265 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.096913:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4265 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.096918:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4265 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000004:00080000:3.0:1716999787.097094:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5fc:0x0], index 0: 0 00000040:00080000:1.0:1716999787.097202:0:6836:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11377, 224 off2034712 00000040:00080000:3.0:1716999787.097213:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11378, 184 off2034896 00000004:00010000:1.0:1716999787.097285:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f778e00 reply state ffff880091860000 transno 4294985876 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4265 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999787.097291:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999787.097294:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc426c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.097294:0:6836:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc423b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.097299:0:6836:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc423b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.097300:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc426c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.097304:0:6836:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc423b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.097306:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc426c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.097308:0:6836:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.097310:0:6836:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc423b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.097314:0:6836:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc423b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.097321:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.097322:0:6836:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.097324:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc4250 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.097325:0:6836:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc423b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.097328:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc4250 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.097329:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc423b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.097332:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc4250 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.097335:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96640 already unused, calling callback (ffffffffa1389790) 00000004:00010000:1.0:1716999787.097336:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f778e00 reply state ffff880091860000 transno 4294985876 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.097337:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc4250 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999787.097340:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:3.0:1716999787.097342:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc4250 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999787.097342:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f778e00 reply state ffff880091860000 transno 4294985876 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc425e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999787.097346:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:3.0:1716999787.097347:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.097348:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.097350:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc4250 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.097354:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc4250 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:3.0:1716999787.097361:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800996fbb80 reply state ffff880134a75000 transno 4294985877 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4257 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999787.097365:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999787.097379:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96400/0x6d188eabd8dc4249 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65303 expref: 606 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.097388:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc426c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65303 expref: 605 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.097393:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:3.0:1716999787.097395:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999787.097396:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94b40, rc 0) 00000100:00100000:3.0:1716999787.097574:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+606:11419:x1800404480661248:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1022us (1244us total) trans 4294985877 rc 0/0 00000100:00100000:1.0:1716999787.097574:0:6836:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+606:11420:x1800404480661120:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1204us (1349us total) trans 4294985876 rc 0/0 00000100:00100000:3.0:1716999787.097580:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45238 00000100:00100000:1.0:1716999787.097580:0:6836:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 603 00010000:00010000:1.0:1716999787.098506:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc425e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098513:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc425e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098517:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc425e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098521:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.098524:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc425e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098533:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc425e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098540:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x68e4194e (ffff88009240e500) 00010000:00010000:1.0:1716999787.098542:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.098544:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc425e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098548:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc425e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x68e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098557:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098561:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4242 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098565:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098569:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.098571:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.098574:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4257 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.098575:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4242 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.098580:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4257 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.098581:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009240e800) 00010000:00010000:1.0:1716999787.098582:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.098584:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4242 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.098584:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4257 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.098588:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4242 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.098588:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c973c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.098591:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4257 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.098595:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4257 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.098596:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4265 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098600:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4265 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.098601:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x83e4194e (ffff88009439ce00) 00010000:00010000:0.0:1716999787.098602:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.098604:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4265 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.098604:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4257 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.098608:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.098608:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4257 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.098610:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4265 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098613:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4265 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098618:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:1.0:1716999787.098619:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1716999787.098621:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4265 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.098625:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4265 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999787.099221:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.099261:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480661312 00000100:00100000:2.0:1716999787.099266:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480661312 00000100:00100000:2.0:1716999787.099297:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9923 00000100:00100000:2.0:1716999787.099302:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+75:1958:x1800404480661312:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.099313:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.099325:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc427a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6530a expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999787.099341:0:15837:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999787.099354:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.099356:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.099362:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc427a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6530a expref: 76 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.099371:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc427a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6530a expref: 76 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.099378:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8900, rc 0) 00000100:00100000:2.0:1716999787.099410:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+76:1958:x1800404480661312:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 106us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.099415:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9923 00000100:00100000:3.0:1716999787.101030:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.101209:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480661376 00000100:00100000:0.0:1716999787.101214:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480661376 00000100:00100000:0.0:1716999787.101255:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45239 00000100:00100000:0.0:1716999787.101261:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480661376:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.101275:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.101288:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4281 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65311 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.101326:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4288 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101335:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4288 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101342:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4288 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101351:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc428f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101357:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc428f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101361:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc428f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101435:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc4296 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101442:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc4296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101447:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc4296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:0.0:1716999787.101470:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2f:0x0]: returning size 15360 00000004:00200000:0.0:1716999787.101474:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.101485:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc4296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101492:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc4296 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101497:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4288 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101502:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4288 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101506:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4288 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101511:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.101514:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4288 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101520:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4288 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101528:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.101530:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.101533:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4288 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101538:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4288 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101547:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc428f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101552:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc428f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101555:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc428f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101559:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.101561:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc428f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101565:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc428f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101570:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009330da00) 00010000:00010000:0.0:1716999787.101572:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.101574:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc428f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101578:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc428f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.101597:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4281 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65311 expref: 605 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.101605:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc4296 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65311 expref: 604 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.101610:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:0.0:1716999787.101612:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.101676:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcfc0, rc 0) 00000100:00100000:0.0:1716999787.101712:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+604:11420:x1800404480661376:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 451us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.101718:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45239 00000100:00100000:1.0:1716999787.101785:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.102006:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480661440 00000100:00100000:3.0:1716999787.102010:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480661440 00000100:00100000:3.0:1716999787.102027:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9924 00000100:00100000:3.0:1716999787.102031:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+76:11419:x1800404480661440:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.102038:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.102046:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65318 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.102064:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc427a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6530a expref: 77 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.102070:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.102071:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.102074:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65318 expref: 77 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.102096:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc427a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6530a expref: 77 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.102105:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc427a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6530a expref: 77 pid: 15837 timeout: 406 lvb_type: 1 00000100:00100000:3.0:1716999787.102115:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008f779500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483008000:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999787.102143:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6900 going to sleep for 11 seconds 00000100:00100000:3.0:1716999787.108808:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008f779500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483008000:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999787.108845:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65318 expref: 77 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.108859:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94240, rc 0) 00000100:00100000:3.0:1716999787.108908:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+77:11419:x1800404480661440:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 6875us (7122us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.108915:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9924 00000100:00100000:0.0:1716999787.108953:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.109064:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480661504 00000100:00100000:3.0:1716999787.109069:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480661504 00010000:00010000:3.0:1716999787.109086:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc427a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6530a expref: 77 pid: 15837 timeout: 406 lvb_type: 1 00000100:00100000:3.0:1716999787.109111:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4504 00000100:00100000:3.0:1716999787.109115:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480661504:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999787.109124:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999787.109139:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc427a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6530a expref: 77 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:3.0:1716999787.109147:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc427a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6530a expref: 77 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:3.0:1716999787.109163:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc427a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6530a expref: 77 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:3.0:1716999787.109182:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.109184:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.109189:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65318 expref: 76 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.109197:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65318 expref: 76 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.109218:0:25864:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65318 expref: 76 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999787.109229:0:25864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008f779500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:25864:1800404483008064:192.168.203.3@tcp:105: 00000100:00100000:3.0:1716999787.109268:0:25864:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6900 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.112649:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.112706:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480661632 00000100:00100000:2.0:1716999787.112713:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480661632 00000100:00100000:2.0:1716999787.112754:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45240 00000100:00100000:2.0:1716999787.112760:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+604:11420:x1800404480661632:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.112779:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.112794:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc42a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6531f expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.112874:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc42ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.112902:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc42ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.112910:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc42ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:2.0:1716999787.112919:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2c:0x0]: returning size 53 00010000:00010000:2.0:1716999787.113023:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc42a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6531f expref: 607 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.113053:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc42ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2c:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6531f expref: 606 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.113060:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2c:0x0].0x0 (ffff88009240e400) 00010000:00010000:2.0:1716999787.113063:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1716999787.113065:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb180, rc 0) 00000100:00100000:2.0:1716999787.113692:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+606:11420:x1800404480661632:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 931us (1048us total) trans 4294985878 rc 0/0 00000100:00100000:2.0:1716999787.113699:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45240 00000100:00100000:0.0:1716999787.117552:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.117582:0:25864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008f779500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_006:lustre-OST0000_UUID:25864:1800404483008064:192.168.203.3@tcp:105: 00000100:00100000:0.0:1716999787.117585:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999787.117600:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999787.117632:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+76:1959:x1800404480661504:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 8515us (8678us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.117641:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4504 00000100:00100000:0.0:1716999787.118152:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.118216:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480661824 00000100:00100000:3.0:1716999787.118221:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480661824 00000100:00100000:3.0:1716999787.118250:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 700 00000100:00100000:3.0:1716999787.118255:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+606:1957:x1800404480661824:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999787.118266:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1716999787.118272:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480661760 00000100:00100000:2.0:1716999787.118275:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480661760 00010000:00010000:3.0:1716999787.118283:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc42ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2c:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6531f expref: 607 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.118297:0:25864:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2c:0x0].0x0 (ffff88009240e400) 00010000:00010000:3.0:1716999787.118300:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999787.118319:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+606:1957:x1800404480661824:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 63us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.118324:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 700 00000100:00100000:2.0:1716999787.118775:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480661952 00000100:00100000:2.0:1716999787.118778:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480661952 00000100:00100000:0.0:1716999787.118846:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9017 00000100:00100000:0.0:1716999787.118851:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+606:11420:x1800404480661760:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999787.119058:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9018 00000100:00100000:2.0:1716999787.119062:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+606:11419:x1800404480661952:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999787.119383:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11379, 168 off2035064 00000001:00080000:2.0:1716999787.119389:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985879 00000100:00100000:2.0:1716999787.119461:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+608:11419:x1800404480661952:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 397us (1308us total) trans 4294985880 rc 0/0 00000100:00100000:2.0:1716999787.119467:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9018 00000020:00080000:2.0:1716999787.119470:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1716999787.119786:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11380, 168 off2035232 00000100:00100000:0.0:1716999787.119858:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+608:11420:x1800404480661760:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1006us (2312us total) trans 4294985881 rc 0/0 00000100:00100000:0.0:1716999787.119864:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9017 00000100:00100000:3.0:1716999787.122156:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.122205:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480662080 00000100:00100000:2.0:1716999787.122210:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480662080 00000100:00100000:2.0:1716999787.122243:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45241 00000100:00100000:2.0:1716999787.122248:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+608:11419:x1800404480662080:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.122262:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.122276:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc42b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65326 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.122338:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc42c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.122348:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc42c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc30:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.122356:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc42c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc30:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:2.0:1716999787.122365:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc30:0x0]: returning size 15360 00010000:00010000:2.0:1716999787.122442:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc42b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65326 expref: 611 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.122454:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc42c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc30:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65326 expref: 610 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.122465:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:2.0:1716999787.122467:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999787.122469:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ebcc0, rc 0) 00000100:00100000:2.0:1716999787.122508:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+610:11419:x1800404480662080:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 258us (354us total) trans 4294985882 rc 0/0 00000100:00100000:2.0:1716999787.122513:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45241 00000100:00100000:0.0:1716999787.123283:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.123342:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480662208 00000100:00100000:1.0:1716999787.123346:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480662208 00000100:00100000:1.0:1716999787.123372:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45242 00000100:00100000:1.0:1716999787.123377:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+610:11420:x1800404480662208:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.123400:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999787.123412:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc3e2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651a5 expref: 610 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.123425:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2c:0x0].0x0 (ffff88009240e400) 00010000:00010000:1.0:1716999787.123431:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.123445:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc42ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.123453:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc42ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.123459:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc42ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.123468:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc42d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.123473:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc42d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.123478:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc42d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.123553:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc42dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.123560:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc42dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.123565:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc42dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:1.0:1716999787.123939:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1475, 64 off102656 00000040:00080000:1.0:1716999787.123956:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11381, 184 off2035416 00010000:00010000:1.0:1716999787.123997:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc42e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124004:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc42e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124009:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc42e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124014:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc42e3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124019:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc42e3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124023:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc42e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124027:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc42e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124031:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999787.124034:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc42e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124038:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc42e3 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124043:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2c:0x0].0x0 (ffff88009240e800) 00010000:00010000:1.0:1716999787.124045:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999787.124048:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc42e3 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124051:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc42e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124065:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc42dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124069:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc42dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124073:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc42dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124076:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.124078:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc42dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124082:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc42dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124087:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2c:0x0].0x0 (ffff88009240e800) 00010000:00010000:1.0:1716999787.124089:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999787.124091:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc42dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124095:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc42dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc2c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124124:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc42ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124129:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc42ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124133:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc42ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124137:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.124139:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc42ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124146:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc42ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124151:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.124153:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.124155:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc42ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.124159:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc42ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999787.124166:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800996f9880 reply state ffff880134b8e000 transno 4294985883 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc42d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.124171:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999787.124206:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+611:11420:x1800404480662208:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 828us (924us total) trans 4294985883 rc 0/0 00000100:00100000:1.0:1716999787.124212:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45242 00000100:00100000:3.0:1716999787.127226:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.127300:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999787.127560:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc42d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.127569:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc42d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.127574:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc42d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.127578:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.127581:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc42d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.127586:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc42d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.127598:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7f675ee7 (ffff88009240e200) 00010000:00010000:1.0:1716999787.127600:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.127602:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc42d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.127606:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc42d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7f675ee7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.127632:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480662336 00000100:00100000:1.0:1716999787.127638:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480662336 00000100:00100000:1.0:1716999787.128430:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480662400 00000100:00100000:1.0:1716999787.128433:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480662400 00000100:00100000:0.0:1716999787.128545:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45243 00000100:00100000:0.0:1716999787.128552:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+611:11419:x1800404480662336:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.128590:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999787.128604:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc426c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65303 expref: 611 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.128630:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:0.0:1716999787.128633:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.128674:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc42ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.128684:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc42ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.128691:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc42ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999787.128961:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f77b800 reply state ffff88008f849000 transno 4294985884 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc42ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.128967:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.129023:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+612:11419:x1800404480662336:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 471us (1802us total) trans 4294985884 rc 0/0 00000100:00100000:0.0:1716999787.129030:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45243 00000100:00100000:0.0:1716999787.129045:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45244 00000100:00100000:0.0:1716999787.129049:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+611:11420:x1800404480662400:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.129058:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.129067:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc42f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6532d expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.129094:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc42f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129101:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc42f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129107:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc42f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129115:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc42ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129120:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc42ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129124:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc42ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129160:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc42f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129166:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc42f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129170:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc42f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129174:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.129176:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc42f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129181:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc42f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129187:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.129189:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.129192:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc42f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129196:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc42f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129202:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc42ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129207:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc42ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129211:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc42ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129214:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.129216:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc42ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129220:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc42ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129224:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4f4f46 (ffff88009330d300) 00010000:00010000:0.0:1716999787.129226:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.129228:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc42ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129232:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc42ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.129256:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc42f1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6532d expref: 612 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.129262:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc42f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6532d expref: 612 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.129270:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde400, rc 0) 00000100:00100000:0.0:1716999787.129285:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+611:11420:x1800404480662400:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 235us (1985us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.129290:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45244 00000100:00100000:3.0:1716999787.131875:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999787.132035:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc42ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.132043:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc42ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.132048:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc42ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.132052:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdfcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.132055:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc42ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.132060:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc42ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.132070:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:0.0:1716999787.132072:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.132074:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc42ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.132078:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc42ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.132337:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480662464 00000100:00100000:0.0:1716999787.132343:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480662464 00000100:00100000:3.0:1716999787.133085:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.133339:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480662528 00000100:00100000:2.0:1716999787.133344:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480662528 00000100:00100000:2.0:1716999787.133371:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45245 00000100:00100000:2.0:1716999787.133377:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+611:11419:x1800404480662464:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.133394:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.133405:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc4306 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65334 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.133444:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc4306 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65334 expref: 612 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.133453:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc4306 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc30:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65334 expref: 612 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.133465:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:2.0:1716999787.133467:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1716999787.133469:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb180, rc 0) 00000100:00100000:2.0:1716999787.133499:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+612:11419:x1800404480662464:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 122us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.133504:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45245 00000100:00100000:2.0:1716999787.133516:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45246 00000100:00100000:2.0:1716999787.133520:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+611:11420:x1800404480662528:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.133526:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.133532:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc430d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6533b expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.133542:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc430d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6533b expref: 612 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.133549:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc430d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6533b expref: 612 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.133554:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.133555:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.133557:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8240, rc 0) 00000100:00100000:2.0:1716999787.133567:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+612:11420:x1800404480662528:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 47us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.133571:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45246 00000100:00100000:0.0:1716999787.135366:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.135465:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.135522:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480662592 00000100:00100000:3.0:1716999787.135529:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480662592 00000100:00100000:3.0:1716999787.135564:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9925 00000100:00100000:3.0:1716999787.135571:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+76:1959:x1800404480662592:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:3.0:1716999787.135761:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1716999787.135764:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb mtime from disk: 0 -> 1716999775 00002000:00010000:3.0:1716999787.135766:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb atime from disk: 0 -> 1716999777 00002000:00010000:3.0:1716999787.135767:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb ctime from disk: 0 -> 1716999787 00002000:00010000:3.0:1716999787.135769:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1716999787.135812:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480662592:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 239us (449us total) trans 4294970125 rc 0/0 00000100:00100000:3.0:1716999787.135825:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9925 00000100:00100000:1.0:1716999787.136231:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480662656 00000100:00100000:1.0:1716999787.136236:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480662656 00000100:00100000:1.0:1716999787.136259:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9019 00000100:00100000:1.0:1716999787.136264:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+612:11420:x1800404480662656:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999787.138687:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.139482:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480662720 00000100:00100000:2.0:1716999787.139488:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480662720 00000100:00100000:2.0:1716999787.139521:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45247 00000100:00100000:2.0:1716999787.139527:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+613:11419:x1800404480662720:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.139541:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.139556:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4314 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65342 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.139598:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc431b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.139608:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc431b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.139615:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc431b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:2.0:1716999787.139639:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc30:0x0]: returning size 15360 00000004:00200000:2.0:1716999787.139643:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999787.139654:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc431b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.139670:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4314 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65342 expref: 615 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.139690:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc431b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65342 expref: 614 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.139697:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:2.0:1716999787.139699:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1716999787.139701:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb840, rc 0) 00000100:00100000:2.0:1716999787.141186:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480662720:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1655us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.141193:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45247 00000100:00100000:1.0:1716999787.141344:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+613:11420:x1800404480662656:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4614us (5413us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.141351:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9019 00000100:00100000:3.0:1716999787.144053:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.144128:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480662784 00000100:00100000:2.0:1716999787.144134:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480662784 00000100:00100000:2.0:1716999787.144175:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45248 00000100:00100000:2.0:1716999787.144181:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+613:11419:x1800404480662784:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.144196:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.144211:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4322 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65349 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.144252:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4329 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144262:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4329 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144270:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4329 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144282:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4330 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144288:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4330 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144293:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4330 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144373:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4337 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144380:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144385:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:2.0:1716999787.144407:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc30:0x0]: returning size 15360 00000004:00200000:2.0:1716999787.144410:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999787.144421:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144428:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144434:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4329 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144439:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4329 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144444:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4329 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144449:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.144452:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4329 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144457:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4329 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144465:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.144467:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.144470:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4329 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144474:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4329 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144483:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4330 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144488:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4330 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144493:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4330 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144497:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.144500:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4330 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144504:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4330 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144509:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x83e4194e (ffff880134241e00) 00010000:00010000:2.0:1716999787.144511:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.144513:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4330 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144517:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4330 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.144537:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4322 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65349 expref: 615 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.144546:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4337 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65349 expref: 614 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.144552:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:2.0:1716999787.144554:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999787.144556:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb3c0, rc 0) 00000100:00100000:2.0:1716999787.144604:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480662784:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 422us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.144610:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45248 00000100:00100000:3.0:1716999787.146081:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.146301:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480662848 00000100:00100000:0.0:1716999787.146308:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480662848 00000100:00100000:0.0:1716999787.146338:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45249 00000100:00100000:0.0:1716999787.146344:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+614:11420:x1800404480662848:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.146356:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.146365:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc433e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65350 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.146397:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4345 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146405:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4345 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146411:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4345 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146421:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc434c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146426:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc434c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146430:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc434c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146472:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4345 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146477:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4345 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146484:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4345 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146489:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddb00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.146491:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4345 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146496:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4345 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146504:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.146506:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.146509:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4345 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146513:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4345 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146521:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc434c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146525:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc434c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146529:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc434c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146533:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.146535:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc434c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146539:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc434c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146548:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4f4f46 (ffff88009330d600) 00010000:00010000:0.0:1716999787.146549:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.146551:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc434c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146555:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc434c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.146584:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc433e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65350 expref: 615 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.146591:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc433e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65350 expref: 615 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.146597:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf3c0, rc 0) 00000100:00100000:0.0:1716999787.146634:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+614:11420:x1800404480662848:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 289us (556us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.146640:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45249 00000100:00100000:1.0:1716999787.148491:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.148551:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480662976 00000100:00100000:0.0:1716999787.148556:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480662976 00000100:00100000:0.0:1716999787.148589:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45250 00000100:00100000:0.0:1716999787.148594:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480662976:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.148621:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999787.148634:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4337 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65349 expref: 614 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.148647:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc431b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65342 expref: 613 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.148659:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:0.0:1716999787.148662:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.148685:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4353 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.148693:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.148699:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999787.149454:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88013502b100 reply state ffff8800933d4000 transno 4294985885 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.149461:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.149525:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480662976:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 929us (1038us total) trans 4294985885 rc 0/0 00000100:00100000:0.0:1716999787.149530:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45250 00000100:00100000:2.0:1716999787.153417:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.153447:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.153526:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663040 00000100:00100000:0.0:1716999787.153533:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663040 00000100:00100000:1.0:1716999787.153754:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663104 00000100:00100000:1.0:1716999787.153759:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663104 00000100:00100000:0.0:1716999787.153918:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45251 00000100:00100000:0.0:1716999787.153925:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+614:11420:x1800404480663040:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.153940:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.153954:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc435a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65357 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999787.154150:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9926 00000100:00100000:3.0:1716999787.154155:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480663104:12345-192.168.203.3@tcp:2:dbench.0 00010000:00010000:1.0:1716999787.154162:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4353 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.154171:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4353 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.154177:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.154185:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdeac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.154188:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4353 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.154194:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4353 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.154204:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:1.0:1716999787.154206:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.154210:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4353 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.154214:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4353 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00002000:00010000:3.0:1716999787.154281:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1716999787.154284:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb mtime from disk: 1716999775 -> 1716999763 00002000:00010000:3.0:1716999787.154286:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb atime from disk: 1716999777 -> 1716999767 00002000:00010000:3.0:1716999787.154288:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:3.0:1716999787.154289:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1716999787.154323:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480663104:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 167us (874us total) trans 4294970126 rc 0/0 00000100:00100000:3.0:1716999787.154329:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9926 00010000:00010000:0.0:1716999787.154372:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4361 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154382:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154390:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154400:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4368 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa12eb2e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154405:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154410:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154523:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4361 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154529:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4361 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154533:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4361 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154536:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.154761:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4361 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154766:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4361 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154772:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.154774:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.154776:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4361 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154780:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4361 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154798:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154803:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4368 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154807:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154810:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.154812:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154816:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4368 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154832:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xa12eb2e9 (ffff88009330da00) 00010000:00010000:0.0:1716999787.154834:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.154875:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4368 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154894:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4368 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.154928:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc435a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65357 expref: 614 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.154935:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc435a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65357 expref: 614 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.154940:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf600, rc 0) 00000100:00100000:0.0:1716999787.155279:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+613:11420:x1800404480663040:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1353us (1866us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.155285:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45251 00000100:00100000:2.0:1716999787.156169:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.156561:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663168 00000100:00100000:0.0:1716999787.156566:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663168 00000100:00100000:0.0:1716999787.156779:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45252 00000100:00100000:0.0:1716999787.156785:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+613:11419:x1800404480663168:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.156799:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.156810:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc436f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6535e expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.156857:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4376 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.156866:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4376 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.156872:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4376 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.156916:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc437d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.156922:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc437d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.156927:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc437d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.156967:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4376 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.156971:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4376 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.156976:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4376 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.156980:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.156982:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4376 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.156987:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4376 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.156994:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.156996:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.156999:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4376 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.157003:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4376 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.157010:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc437d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.157014:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc437d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.157018:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc437d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.157022:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.157024:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc437d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.157028:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc437d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.157033:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xd4e4194e (ffff88009330d300) 00010000:00010000:0.0:1716999787.157035:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.157037:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc437d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.157040:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc437d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.157067:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc436f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6535e expref: 614 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.157072:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc436f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6535e expref: 614 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.157079:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:0.0:1716999787.157108:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+613:11419:x1800404480663168:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 323us (940us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.157114:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45252 00000100:00100000:3.0:1716999787.158341:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.158550:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663232 00000100:00100000:2.0:1716999787.158554:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663232 00000100:00100000:2.0:1716999787.158587:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45253 00000100:00100000:2.0:1716999787.158593:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+613:11420:x1800404480663232:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.158602:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.158612:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4384 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65365 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.158639:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc438b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158646:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc438b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158653:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc438b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158662:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4392 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158667:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158672:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158709:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc438b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158714:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc438b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158718:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc438b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158722:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.158725:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc438b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158730:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc438b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158737:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.158739:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.158741:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc438b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158746:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc438b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158765:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158769:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4392 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158774:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4392 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158778:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.158780:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4392 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158784:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4392 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158790:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x83e4194e (ffff880134241300) 00010000:00010000:2.0:1716999787.158792:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.158794:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4392 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158801:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4392 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.158843:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4384 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65365 expref: 614 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.158850:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4384 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65365 expref: 614 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.158856:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb840, rc 0) 00000100:00100000:2.0:1716999787.158897:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+613:11420:x1800404480663232:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 304us (558us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.158903:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45253 00000100:00100000:1.0:1716999787.159954:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.160055:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663296 00000100:00100000:0.0:1716999787.160060:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663296 00000100:00100000:0.0:1716999787.160169:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45254 00000100:00100000:0.0:1716999787.160174:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+613:11419:x1800404480663296:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.160182:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.160191:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4399 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6536c expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.160206:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4399 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6536c expref: 614 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.160218:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4399 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6536c expref: 614 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.160223:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.160225:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.160227:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdeac0, rc 0) 00000100:00100000:0.0:1716999787.160258:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480663296:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 83us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.160262:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45254 00000100:00100000:1.0:1716999787.162538:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.162606:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663360 00000100:00100000:2.0:1716999787.162614:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663360 00000100:00100000:2.0:1716999787.162648:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9020 00000100:00100000:2.0:1716999787.162654:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480663360:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999787.165626:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.166080:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663424 00000100:00100000:2.0:1716999787.166087:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663424 00000100:00100000:2.0:1716999787.166113:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45255 00000100:00100000:2.0:1716999787.166119:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+616:11420:x1800404480663424:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.166133:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.166145:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc43a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65373 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.166186:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc43a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166196:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc43a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166205:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc43a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166221:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc43ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166227:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc43ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166232:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc43ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166277:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc43a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166282:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc43a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166287:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc43a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166294:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.166297:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc43a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166303:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc43a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166310:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.166313:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.166316:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc43a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166320:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc43a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166327:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc43ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166331:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc43ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166335:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc43ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166338:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaf40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.166340:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc43ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166344:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc43ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166348:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x83e4194e (ffff880134241200) 00010000:00010000:2.0:1716999787.166349:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.166351:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc43ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166354:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc43ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.166378:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc43a0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65373 expref: 617 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.166384:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc43a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65373 expref: 617 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.166390:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ead00, rc 0) 00000100:00100000:2.0:1716999787.166424:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+616:11420:x1800404480663424:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 305us (804us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.166429:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45255 00000100:00100000:2.0:1716999787.167389:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480663360:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4732us (4853us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.167396:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9020 00000100:00100000:1.0:1716999787.169474:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.169594:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663552 00000100:00100000:0.0:1716999787.169600:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663552 00000100:00100000:0.0:1716999787.169638:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45256 00000100:00100000:0.0:1716999787.169643:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+614:11420:x1800404480663552:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.169656:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.169658:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1716999787.169675:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc430d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6533b expref: 614 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999787.169679:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999787.169687:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.169690:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.169698:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc43b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6537a expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999787.169736:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663616 00000100:00100000:2.0:1716999787.169739:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663616 00000100:00100000:2.0:1716999787.169765:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45257 00000100:00100000:2.0:1716999787.169769:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480663616:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.169775:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.169783:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc43bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65381 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.169803:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc43c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169811:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc43c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169827:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc43c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.169830:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc43ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.169837:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc43d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.169839:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc43ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.169842:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc43d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.169845:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc43ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.169847:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc43d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.169853:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc43d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.169856:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc43d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.169861:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc43d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.169892:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc43c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169897:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc43c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169901:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc43c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169906:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.169909:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc43c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169913:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc43c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169919:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.169921:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.169924:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc43c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169928:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc43c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169934:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc43d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169937:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc43d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169943:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc43d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169946:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.169948:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc43d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169951:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc43d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169955:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xd4e4194e (ffff880134241e00) 00010000:00010000:2.0:1716999787.169957:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.169959:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc43d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169962:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc43d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.169987:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc43bc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65381 expref: 616 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.169993:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc43bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65381 expref: 616 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.169998:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9440, rc 0) 00000100:00100000:2.0:1716999787.170039:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480663616:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 269us (360us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.170045:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45257 00000004:00080000:0.0:1716999787.170246:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5fd:0x0], index 1: 0 00000040:00080000:0.0:1716999787.170304:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11382, 184 off2035600 00010000:00010000:0.0:1716999787.170390:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc43df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.170397:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc43df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.170402:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc43df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.170423:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc43ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.170428:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc43ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.170432:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc43ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.170436:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.170438:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc43ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.170443:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc43ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.170449:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.170451:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.170453:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc43ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.170457:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc43ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999787.170464:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135028700 reply state ffff88009a7ba000 transno 4294985886 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc43d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.170469:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999787.170484:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc43b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6537a expref: 616 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.170492:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc43df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6537a expref: 615 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.170498:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:0.0:1716999787.170499:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.170501:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdfcc0, rc 0) 00000100:00100000:0.0:1716999787.170535:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+616:11420:x1800404480663552:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 891us (1070us total) trans 4294985886 rc 0/0 00000100:00100000:0.0:1716999787.170543:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45256 00010000:00010000:0.0:1716999787.172234:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc43d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.172243:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc43d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.172249:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc43d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.172253:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddb00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.172256:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc43d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.172261:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc43d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.172270:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x83e4194e (ffff88009330d700) 00010000:00010000:0.0:1716999787.172272:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.172274:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc43d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.172278:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc43d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.172725:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.172945:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663680 00000100:00100000:0.0:1716999787.172950:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663680 00000100:00100000:0.0:1716999787.172980:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45258 00000100:00100000:0.0:1716999787.172985:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480663680:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.172998:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.173008:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc43ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65388 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.173040:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc43f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173048:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc43f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173055:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc43f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173063:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc43fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173068:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc43fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173072:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc43fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173114:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc43f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173119:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc43f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173124:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc43f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173127:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.173130:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc43f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173134:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc43f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173144:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.173146:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.173148:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc43f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173153:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc43f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173159:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc43fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173164:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc43fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173168:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc43fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173172:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.173174:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc43fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173178:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc43fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173183:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xd4e4194e (ffff88009330da00) 00010000:00010000:0.0:1716999787.173185:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.173187:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc43fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173190:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc43fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.173216:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc43ed lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65388 expref: 616 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.173223:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc43ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65388 expref: 616 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.173230:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:0.0:1716999787.173270:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480663680:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 284us (547us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.173276:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45258 00000100:00100000:3.0:1716999787.174806:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.174974:0:6836:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663808 00000100:00100000:1.0:1716999787.174979:0:6836:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663808 00000100:00100000:1.0:1716999787.175012:0:6836:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 604 00000100:00100000:1.0:1716999787.175018:0:6836:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480663808:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.175044:0:6836:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999787.175058:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc40f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6529a expref: 615 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.175076:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:1.0:1716999787.175084:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4399 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6536c expref: 614 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.175091:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.175093:0:6836:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.175128:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4402 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.175136:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4402 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.175142:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4402 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.175152:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4409 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.175157:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4409 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.175290:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.175374:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663872 00000100:00100000:3.0:1716999787.175378:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663872 00000100:00100000:0.0:1716999787.175648:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9927 00000100:00100000:0.0:1716999787.175653:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480663872:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.175662:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.175673:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc4410 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6538f expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1716999787.175688:0:15837:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x5fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1716999787.175698:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.175700:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.175705:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc4410 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6538f expref: 79 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999787.175715:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc4410 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6538f expref: 79 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999787.175723:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf600, rc 0) 00000100:00100000:0.0:1716999787.175749:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480663872:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 95us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.175758:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9927 00010000:00010000:1.0:1716999787.175925:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4409 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.175942:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc4417 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.175948:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc4417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.175953:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc4417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.176028:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc441e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.176034:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc441e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.176040:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc441e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000040:00080000:1.0:1716999787.176355:0:6836:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11383, 224 off2035824 00000004:00010000:1.0:1716999787.176427:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f77a680 reply state ffff880134b8d000 transno 4294985887 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc441e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999787.176434:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1716999787.176436:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f77a680 reply state ffff880134b8d000 transno 4294985887 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc4417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999787.176439:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:1.0:1716999787.176442:0:6836:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4402 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.176447:0:6836:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4402 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.176453:0:6836:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4402 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.176458:0:6836:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.176461:0:6836:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4402 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.176465:0:6836:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4402 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.176473:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.176475:0:6836:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.176478:0:6836:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4402 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.176484:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4402 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000004:00010000:1.0:1716999787.176490:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f77a680 reply state ffff880134b8d000 transno 4294985887 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4409 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:1.0:1716999787.176494:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:1.0:1716999787.176521:0:6836:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480663808:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1503us (1716us total) trans 4294985887 rc 0/0 00000100:00100000:1.0:1716999787.176526:0:6836:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 604 00010000:00010000:0.0:1716999787.179164:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4409 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179174:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4409 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179179:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4409 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179184:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.179187:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4409 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179192:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4409 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179202:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff88009240ea00) 00010000:00010000:0.0:1716999787.179204:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.179207:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4409 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179210:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4409 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179223:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc4417 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179228:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc4417 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179232:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc4417 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179238:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.179240:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc4417 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179244:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc4417 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179249:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xd4e4194e (ffff88009240e300) 00010000:00010000:0.0:1716999787.179250:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.179252:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc4417 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179255:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc4417 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179262:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc441e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179268:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc441e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179272:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc441e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179275:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.179277:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc441e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179281:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc441e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179285:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:0.0:1716999787.179287:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1716999787.179289:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc441e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.179293:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc441e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.179496:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.179785:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480663936 00000100:00100000:0.0:1716999787.179790:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480663936 00000100:00100000:3.0:1716999787.179873:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.179902:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480664000 00000100:00100000:3.0:1716999787.179905:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480664000 00000100:00100000:3.0:1716999787.179934:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9928 00000100:00100000:3.0:1716999787.179940:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+79:11420:x1800404480664000:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.179952:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.179962:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6539d expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.179979:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc4410 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6538f expref: 80 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.179984:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.179986:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.179988:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6539d expref: 80 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.180010:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc4410 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6538f expref: 80 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.180020:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc4410 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6538f expref: 80 pid: 15837 timeout: 406 lvb_type: 1 00000100:00100000:3.0:1716999787.180031:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008f77b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483008128:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999787.180065:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6900 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.180249:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45259 00000100:00100000:0.0:1716999787.180253:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480663936:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.180263:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.180270:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc442c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65396 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.180303:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4433 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180312:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4433 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180318:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4433 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180326:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc443a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180330:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc443a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180334:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc443a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180406:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4441 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180414:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180419:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:0.0:1716999787.180439:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2d:0x0]: returning size 15360 00000004:00200000:0.0:1716999787.180442:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.180453:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180460:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4441 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180465:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4433 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180470:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4433 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180474:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4433 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180478:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.180480:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4433 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180485:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4433 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180491:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.180493:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.180495:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4433 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180500:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc4433 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180508:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc443a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180512:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc443a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180517:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc443a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180520:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.180522:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc443a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180526:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc443a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180530:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xd4e4194e (ffff88009330d900) 00010000:00010000:0.0:1716999787.180532:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.180534:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc443a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180537:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc443a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.180554:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc442c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65396 expref: 616 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.180562:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4441 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65396 expref: 615 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.180571:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:0.0:1716999787.180573:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.180575:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bded00, rc 0) 00000100:00100000:0.0:1716999787.180603:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480663936:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 349us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.180609:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45259 00000100:00100000:0.0:1716999787.181425:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008f77b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483008128:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999787.181442:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [12288->16383] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6539d expref: 80 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.181452:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96400, rc 0) 00000100:00100000:0.0:1716999787.181800:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+80:11420:x1800404480664000:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1858us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.181806:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9928 00000100:00100000:3.0:1716999787.183112:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.183178:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.183233:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480664064 00000100:00100000:1.0:1716999787.183238:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480664064 00010000:00010000:1.0:1716999787.183257:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc4410 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6538f expref: 80 pid: 15837 timeout: 406 lvb_type: 1 00000100:00100000:0.0:1716999787.183319:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480664192 00000100:00100000:0.0:1716999787.183323:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480664192 00000100:00100000:0.0:1716999787.183351:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45260 00000100:00100000:0.0:1716999787.183356:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480664192:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.183387:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999787.183400:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4441 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65396 expref: 615 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.183410:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:0.0:1716999787.183413:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.183434:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4448 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.183443:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.183448:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999787.183677:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f778700 reply state ffff8800a6adc000 transno 4294985888 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.183683:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.183725:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+616:11419:x1800404480664192:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 368us (546us total) trans 4294985888 rc 0/0 00000100:00100000:0.0:1716999787.183731:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45260 00000100:00100000:1.0:1716999787.184093:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4505 00000100:00100000:1.0:1716999787.184099:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+80:1958:x1800404480664064:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999787.184107:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999787.184121:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc4410 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6538f expref: 80 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999787.184130:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc4410 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6538f expref: 80 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999787.184142:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc4410 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6538f expref: 80 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999787.184155:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.184157:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.184162:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6539d expref: 79 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.184169:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6539d expref: 79 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.184190:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6539d expref: 79 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999787.184201:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013502bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483008192:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999787.184229:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930ef6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.185703:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.185721:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480664256 00000100:00100000:0.0:1716999787.185725:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480664256 00000100:00100000:0.0:1716999787.185746:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9929 00000100:00100000:0.0:1716999787.185751:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+80:1959:x1800404480664256:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999787.185892:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999787.185895:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb mtime from disk: 1716999763 -> 1716999775 00002000:00010000:0.0:1716999787.185897:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb atime from disk: 1716999767 -> 1716999777 00002000:00010000:0.0:1716999787.185899:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:0.0:1716999787.185901:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5fb:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:1.0:1716999787.185978:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4448 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.185985:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4448 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.185991:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4448 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.185995:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdeac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.185999:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4448 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.186004:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4448 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.186017:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:1.0:1716999787.186019:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.186022:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4448 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.186027:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc4448 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.187110:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+81:1959:x1800404480664256:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 1354us (1407us total) trans 4294970166 rc 0/0 00000100:00100000:0.0:1716999787.187118:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9929 00000100:00100000:1.0:1716999787.187278:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013502bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483008192:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999787.187293:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999787.187435:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+80:1958:x1800404480664064:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3336us (4325us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.187442:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4505 00000100:00100000:0.0:1716999787.189788:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.190506:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.190795:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480664384 00000100:00100000:2.0:1716999787.190803:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480664384 00000100:00100000:2.0:1716999787.190845:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9021 00000100:00100000:2.0:1716999787.190851:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+615:11420:x1800404480664384:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999787.191208:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11384, 168 off2035992 00000001:00080000:2.0:1716999787.191213:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985889 00000100:00100000:3.0:1716999787.191411:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480664512 00000100:00100000:3.0:1716999787.191416:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480664512 00000100:00100000:3.0:1716999787.191445:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45261 00000100:00100000:3.0:1716999787.191450:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+618:11419:x1800404480664512:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:3.0:1716999787.191479:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc444f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.191491:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc444f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.191499:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc444f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.191510:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc444f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.191514:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc444f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.191519:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc444f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.191523:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.191526:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc444f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.191531:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc444f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.191538:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:3.0:1716999787.191540:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999787.191543:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc444f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.191551:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc444f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.192051:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+618:11420:x1800404480664384:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1199us (2266us total) trans 4294985890 rc 0/0 00000100:00100000:2.0:1716999787.192059:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9021 00000020:00080000:2.0:1716999787.192062:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999787.192204:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+617:11419:x1800404480664512:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 752us (1697us total) trans 0 rc -22/-22 00000100:00100000:3.0:1716999787.192211:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45261 00000100:00100000:0.0:1716999787.193727:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.193767:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.194008:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480664576 00000100:00100000:3.0:1716999787.194014:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480664576 00000100:00100000:3.0:1716999787.194043:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480664704 00000100:00100000:3.0:1716999787.194045:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480664704 00000100:00100000:3.0:1716999787.194146:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45262 00000100:00100000:3.0:1716999787.194152:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+618:11419:x1800404480664576:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.194167:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.194180:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4456 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653a4 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.194216:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc445d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194225:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc445d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194233:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc445d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194243:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4464 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194248:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194256:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194326:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc446b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194331:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc446b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194337:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc446b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:3.0:1716999787.194355:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc30:0x0]: returning size 15360 00000004:00200000:3.0:1716999787.194358:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999787.194368:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc446b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194375:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc446b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194379:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc445d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194384:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc445d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194389:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc445d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194394:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.194397:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc445d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194402:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc445d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194411:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.194413:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.194416:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc445d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194420:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc445d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194429:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4464 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194433:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4464 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194438:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194441:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.194442:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4464 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194446:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4464 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194451:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x83e4194e (ffff8800a660c300) 00010000:00010000:3.0:1716999787.194453:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.194454:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4464 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194458:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194475:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4456 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653a4 expref: 620 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.194484:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc446b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653a4 expref: 619 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.194489:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:3.0:1716999787.194491:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999787.194492:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95d40, rc 0) 00000100:00100000:3.0:1716999787.194523:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+619:11419:x1800404480664576:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 371us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.194528:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45262 00000100:00100000:3.0:1716999787.194541:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45263 00000100:00100000:3.0:1716999787.194545:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+618:11420:x1800404480664704:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.194551:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.194557:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4472 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653ab expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.194592:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc4479 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194599:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc4479 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc31:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.194604:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc4479 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc31:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:3.0:1716999787.194610:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc31:0x0]: returning size 15360 00010000:00010000:3.0:1716999787.194684:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4472 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653ab expref: 621 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.194696:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc4479 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc31:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653ab expref: 620 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.194700:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:3.0:1716999787.194702:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1716999787.194704:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97180, rc 0) 00000100:00100000:3.0:1716999787.194719:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+620:11420:x1800404480664704:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 173us (952us total) trans 4294985891 rc 0/0 00000100:00100000:3.0:1716999787.194723:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45263 00000100:00100000:0.0:1716999787.196237:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.197559:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480664832 00000100:00100000:2.0:1716999787.197566:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480664832 00000100:00100000:2.0:1716999787.198111:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45264 00000100:00100000:2.0:1716999787.198118:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+620:11420:x1800404480664832:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999787.198155:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999787.198172:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc43df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6537a expref: 620 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.198184:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:2.0:1716999787.198187:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.198225:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4487 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.198234:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.198241:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999787.198476:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800996f9f80 reply state ffff88008e488000 transno 4294985892 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999787.198483:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999787.199141:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+621:11420:x1800404480664832:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1021us (2904us total) trans 4294985892 rc 0/0 00000100:00100000:2.0:1716999787.199147:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45264 00000100:00100000:3.0:1716999787.200371:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.200428:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480664896 00000100:00100000:2.0:1716999787.200433:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480664896 00000100:00100000:2.0:1716999787.200464:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45265 00000100:00100000:2.0:1716999787.200469:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+621:11419:x1800404480664896:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.200479:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.200491:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc448e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653b2 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.200523:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4495 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200532:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4495 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200539:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4495 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200550:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc449c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200555:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc449c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200560:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc449c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200602:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4495 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200608:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4495 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200613:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4495 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200617:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.200620:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4495 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200625:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4495 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200633:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.200635:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.200637:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4495 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200642:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4495 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200649:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc449c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200653:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc449c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200658:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc449c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200661:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.200663:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc449c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200671:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc449c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200676:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff880134241000) 00010000:00010000:2.0:1716999787.200677:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.200679:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc449c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200683:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc449c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.200707:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc448e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653b2 expref: 622 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.200714:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc448e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653b2 expref: 622 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.200720:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb600, rc 0) 00000100:00100000:2.0:1716999787.200744:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+621:11419:x1800404480664896:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 275us (376us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.200749:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45265 00000100:00100000:1.0:1716999787.206139:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.206234:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999787.206301:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4487 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.206310:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4487 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.206316:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.206321:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.206325:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4487 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.206331:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4487 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.206343:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:0.0:1716999787.206346:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.206349:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4487 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.206353:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4487 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.207099:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480664960 00000100:00100000:0.0:1716999787.207107:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480664960 00000100:00100000:0.0:1716999787.207133:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665024 00000100:00100000:0.0:1716999787.207136:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665024 00000100:00100000:0.0:1716999787.207149:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45266 00000100:00100000:0.0:1716999787.207155:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+621:11420:x1800404480664960:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.207174:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.207186:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc44a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653b9 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.207223:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc44a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653b9 expref: 622 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.207237:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc44a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653b9 expref: 622 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.207248:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:0.0:1716999787.207250:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1716999787.207252:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdeac0, rc 0) 00000100:00100000:0.0:1716999787.207288:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+622:11420:x1800404480664960:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 132us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.207294:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45266 00000100:00100000:0.0:1716999787.207308:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45267 00000100:00100000:0.0:1716999787.207312:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+621:11419:x1800404480665024:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.207318:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.207325:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc44aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653c0 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.207338:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc44aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653c0 expref: 622 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.207345:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc44aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653c0 expref: 622 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.207355:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.207357:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.207359:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf600, rc 0) 00000100:00100000:0.0:1716999787.207374:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+622:11419:x1800404480665024:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 61us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.207378:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45267 00000100:00100000:0.0:1716999787.212787:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.213703:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665088 00000100:00100000:2.0:1716999787.213712:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665088 00000100:00100000:2.0:1716999787.213750:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9930 00000100:00100000:2.0:1716999787.213755:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+80:1958:x1800404480665088:12345-192.168.203.3@tcp:2:dbench.0 00000100:00100000:0.0:1716999787.213931:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.213973:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665152 00000100:00100000:3.0:1716999787.213977:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665152 00000100:00100000:3.0:1716999787.214008:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9022 00000100:00100000:3.0:1716999787.214012:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+622:11419:x1800404480665152:12345-192.168.203.3@tcp:37:dbench.0 00002000:00010000:2.0:1716999787.214139:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1716999787.214142:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb mtime from disk: 0 -> 1716999775 00002000:00010000:2.0:1716999787.214144:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb atime from disk: 0 -> 1716999777 00002000:00010000:2.0:1716999787.214146:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb ctime from disk: 0 -> 1716999787 00002000:00010000:2.0:1716999787.214147:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1716999787.214182:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+81:1958:x1800404480665088:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 426us (1402us total) trans 4294970167 rc 0/0 00000100:00100000:2.0:1716999787.214188:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9930 00000100:00100000:0.0:1716999787.218597:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.218768:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665216 00000100:00100000:2.0:1716999787.218775:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665216 00000100:00100000:2.0:1716999787.218863:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45268 00000100:00100000:2.0:1716999787.218870:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+623:11420:x1800404480665216:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.218902:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.218918:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc44b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653c7 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.218962:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc44b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.218972:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc44b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.218980:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc44b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:2.0:1716999787.219005:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc31:0x0]: returning size 15360 00000004:00200000:2.0:1716999787.219008:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999787.219020:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc44b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.219035:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc44b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653c7 expref: 625 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.219051:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc44b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653c7 expref: 624 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999787.219188:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+624:11419:x1800404480665152:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5172us (5255us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.219197:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9022 00010000:00010000:2.0:1716999787.219791:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:2.0:1716999787.219795:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1716999787.219798:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea880, rc 0) 00000100:00100000:2.0:1716999787.219835:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+623:11420:x1800404480665216:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 965us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.219841:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45268 00000100:00100000:0.0:1716999787.221064:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.221301:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665280 00000100:00100000:2.0:1716999787.221307:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665280 00000100:00100000:2.0:1716999787.221471:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45269 00000100:00100000:2.0:1716999787.221477:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+623:11419:x1800404480665280:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.221490:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.221500:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc44bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653ce expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.221529:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc44c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221538:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc44c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221544:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc44c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221552:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc44cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221556:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc44cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221564:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc44cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221612:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc44c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221616:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc44c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221621:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc44c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221626:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.221629:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc44c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221634:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc44c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221642:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.221645:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.221647:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc44c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221652:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc44c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221659:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc44cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221664:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc44cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221667:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc44cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221671:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ead00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.221673:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc44cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221677:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc44cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221681:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff880134241200) 00010000:00010000:2.0:1716999787.221683:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.221685:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc44cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221688:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc44cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.221714:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc44bf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653ce expref: 624 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.221720:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc44bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653ce expref: 624 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.221725:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea1c0, rc 0) 00000100:00100000:2.0:1716999787.221761:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+623:11419:x1800404480665280:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 284us (700us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.221766:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45269 00000100:00100000:0.0:1716999787.226584:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.226632:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.226645:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665344 00000100:00100000:1.0:1716999787.226652:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665344 00000100:00100000:1.0:1716999787.226702:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45270 00000100:00100000:1.0:1716999787.226709:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+623:11420:x1800404480665344:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.226723:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.226741:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc44d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653d5 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.226781:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc44db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.226790:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc44db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.226801:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc44db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.226826:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc44e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.226832:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc44e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.226837:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc44e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227626:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc44e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227635:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc44e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227641:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc44e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:1.0:1716999787.227663:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc31:0x0]: returning size 15360 00000004:00200000:1.0:1716999787.227667:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.227678:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc44e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227685:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc44e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227691:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc44db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227695:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc44db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227704:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc44db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227708:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.227712:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc44db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227718:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc44db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227727:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.227729:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.227733:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc44db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227737:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc44db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227763:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc44e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227769:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc44e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227773:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc44e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227777:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.227779:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc44e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227783:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc44e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227791:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x83e4194e (ffff88009240ea00) 00010000:00010000:1.0:1716999787.227792:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.227794:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc44e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.227799:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc44e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999787.227862:0:6836:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665472 00000100:00100000:2.0:1716999787.227866:0:6836:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665472 00000100:00100000:2.0:1716999787.227910:0:6836:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 605 00000100:00100000:2.0:1716999787.227916:0:6836:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+626:11419:x1800404480665472:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999787.227937:0:6836:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999787.227947:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc446b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653a4 expref: 626 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.227973:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:2.0:1716999787.227981:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc44aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653c0 expref: 625 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.227988:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.227990:0:6836:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.228023:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc44f0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.228030:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc44f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.228035:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc44f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.228044:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc44f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.228049:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc44f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.228054:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc44f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.228067:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc44fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.228072:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc44fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.228077:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc44fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.228133:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4505 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.228139:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4505 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.228143:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4505 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.228605:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc44d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653d5 expref: 624 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.228615:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc44e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653d5 expref: 623 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.228620:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:1.0:1716999787.228621:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.228623:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130240, rc 0) 00000100:00100000:1.0:1716999787.228669:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+623:11420:x1800404480665344:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1960us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.228675:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45270 00000040:00080000:2.0:1716999787.229691:0:6836:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11385, 224 off2036216 00000004:00010000:2.0:1716999787.229769:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131cab480 reply state ffff8801310da000 transno 4294985893 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4505 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.229776:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999787.229780:0:6836:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc44f0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.229785:0:6836:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc44f0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.229790:0:6836:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc44f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.229794:0:6836:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaf40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.229797:0:6836:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc44f0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.229803:0:6836:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc44f0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.229811:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.229814:0:6836:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.229816:0:6836:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc44f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.229834:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc44f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000004:00010000:2.0:1716999787.229842:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131cab480 reply state ffff8801310da000 transno 4294985893 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc44f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.229846:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00010000:2.0:1716999787.229848:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131cab480 reply state ffff8801310da000 transno 4294985893 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc44fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.229852:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1716999787.229912:0:6836:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+624:11419:x1800404480665472:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1995us (3279us total) trans 4294985893 rc 0/0 00000100:00100000:2.0:1716999787.229918:0:6836:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 605 00000100:00100000:0.0:1716999787.231320:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.231395:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665600 00000100:00100000:1.0:1716999787.231402:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665600 00000100:00100000:1.0:1716999787.231441:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45271 00000100:00100000:1.0:1716999787.231447:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+624:11420:x1800404480665600:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.231477:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999787.231491:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc44e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653d5 expref: 624 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.231509:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc44b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653c7 expref: 623 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.231517:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:1.0:1716999787.231519:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.231542:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc450c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.231550:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc450c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.231556:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc450c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999787.231755:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca8a80 reply state ffff880134b88000 transno 4294985894 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc450c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.231761:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999787.231803:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+624:11420:x1800404480665600:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 355us (484us total) trans 4294985894 rc 0/0 00000100:00100000:1.0:1716999787.231808:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45271 00010000:00010000:1.0:1716999787.234005:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc44fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234015:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc44fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234020:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc44fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234025:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.234029:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc44fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234035:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc44fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234046:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x83e4194e (ffff880134241100) 00010000:00010000:1.0:1716999787.234049:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.234052:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc44fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234056:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc44fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234068:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc44f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234073:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc44f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234077:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc44f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234081:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.234083:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc44f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234087:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc44f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234092:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff880134241200) 00010000:00010000:1.0:1716999787.234093:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.234096:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc44f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234103:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc44f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234112:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4505 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234116:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4505 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234120:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4505 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234125:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.234127:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4505 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234130:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4505 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.234136:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:1.0:1716999787.234138:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1716999787.234140:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4505 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.234142:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc450c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.234144:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4505 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.234149:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc450c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.234154:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc450c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.234158:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.234161:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc450c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.234165:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc450c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.234182:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:0.0:1716999787.234184:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.234186:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc450c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.234190:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc450c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999787.234293:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.234336:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665664 00000100:00100000:1.0:1716999787.234342:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665664 00000100:00100000:0.0:1716999787.234511:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.234638:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665728 00000100:00100000:2.0:1716999787.234642:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665728 00000100:00100000:2.0:1716999787.234675:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9931 00000100:00100000:2.0:1716999787.234680:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+81:1958:x1800404480665728:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:2.0:1716999787.234831:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1716999787.234834:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb mtime from disk: 1716999775 -> 1716999763 00002000:00010000:2.0:1716999787.234836:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb atime from disk: 1716999777 -> 1716999767 00002000:00010000:2.0:1716999787.234838:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:2.0:1716999787.234839:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1716999787.234871:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+82:1958:x1800404480665728:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 190us (359us total) trans 4294970168 rc 0/0 00000100:00100000:2.0:1716999787.234902:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9931 00000100:00100000:1.0:1716999787.234935:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45272 00000100:00100000:1.0:1716999787.234940:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+622:11419:x1800404480665664:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.234953:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.234963:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4513 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653dc expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.235188:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc451a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235197:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc451a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235204:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc451a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235213:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4521 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235218:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235222:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235288:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4528 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235294:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235298:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:1.0:1716999787.235314:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc30:0x0]: returning size 15360 00000004:00200000:1.0:1716999787.235318:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.235326:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235332:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4528 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235337:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc451a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235341:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc451a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235345:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc451a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235348:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.235349:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc451a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235353:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc451a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235358:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.235360:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.235362:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc451a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235366:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc451a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235373:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4521 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235377:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4521 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235381:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235385:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.235387:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4521 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235391:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4521 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235395:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff88009240e300) 00010000:00010000:1.0:1716999787.235397:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.235399:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4521 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235402:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4521 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.235419:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4513 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653dc expref: 624 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.235428:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4528 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653dc expref: 623 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.235432:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:1.0:1716999787.235434:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.235436:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133cc0, rc 0) 00000100:00100000:1.0:1716999787.235455:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+623:11419:x1800404480665664:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 515us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.235460:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45272 00000100:00100000:0.0:1716999787.237476:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.237672:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665792 00000100:00100000:1.0:1716999787.237678:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665792 00000100:00100000:1.0:1716999787.237712:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45273 00000100:00100000:1.0:1716999787.237720:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+623:11420:x1800404480665792:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.237737:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.237747:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc452f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653e3 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.237776:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4536 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237784:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4536 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237790:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4536 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237798:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc453d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237802:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc453d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237807:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc453d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237860:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4536 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237866:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4536 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237870:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4536 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237875:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.237877:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4536 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237907:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4536 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237915:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.237918:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.237920:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4536 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237924:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4536 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237932:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc453d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237936:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc453d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237940:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc453d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237943:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.237945:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc453d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237949:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc453d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237955:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xd4e4194e (ffff88009240e800) 00010000:00010000:1.0:1716999787.237957:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.237959:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc453d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237963:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc453d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.237994:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc452f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653e3 expref: 624 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.238000:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc452f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653e3 expref: 624 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.238008:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c1318c0, rc 0) 00000100:00100000:1.0:1716999787.238048:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+623:11420:x1800404480665792:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 329us (574us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.238053:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45273 00000100:00100000:0.0:1716999787.238245:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.238279:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665920 00000100:00100000:3.0:1716999787.238284:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665920 00000100:00100000:3.0:1716999787.238300:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45274 00000100:00100000:3.0:1716999787.238304:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+623:11419:x1800404480665920:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999787.238322:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999787.238331:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4528 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653dc expref: 623 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.238349:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:3.0:1716999787.238352:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999787.238373:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4544 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.238379:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4544 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.238385:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4544 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999787.238598:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca9f80 reply state ffff880134a73000 transno 4294985895 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4544 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999787.238604:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999787.238638:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+624:11419:x1800404480665920:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 332us (392us total) trans 4294985895 rc 0/0 00000100:00100000:3.0:1716999787.238643:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45274 00010000:00010000:1.0:1716999787.239445:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4544 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.239452:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4544 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.239457:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4544 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.239461:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.239463:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4544 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.239467:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4544 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.239475:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:1.0:1716999787.239477:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.239479:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4544 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.239486:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4544 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.240970:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.241062:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480665984 00000100:00100000:2.0:1716999787.241068:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480665984 00000100:00100000:2.0:1716999787.241094:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9932 00000100:00100000:2.0:1716999787.241099:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480665984:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:2.0:1716999787.241221:0:15837:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1716999787.241224:0:15837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb mtime from disk: 1716999763 -> 1716999775 00002000:00010000:2.0:1716999787.241226:0:15837:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb atime from disk: 1716999767 -> 1716999777 00002000:00010000:2.0:1716999787.241228:0:15837:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:2.0:1716999787.241230:0:15837:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1716999787.241270:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480665984:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 170us (302us total) trans 4294970127 rc 0/0 00000100:00100000:2.0:1716999787.241276:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9932 00000100:00100000:0.0:1716999787.242011:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.242045:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480666112 00000100:00100000:1.0:1716999787.242050:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480666112 00000100:00100000:1.0:1716999787.242072:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45275 00000100:00100000:1.0:1716999787.242076:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+623:11419:x1800404480666112:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:1.0:1716999787.242099:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc454b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.242107:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc454b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.242113:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc454b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.242124:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc454b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.242127:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc454b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.242130:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc454b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.242133:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.242134:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc454b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.242138:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc454b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.242144:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:1.0:1716999787.242146:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1716999787.242148:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc454b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.242151:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc454b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.242178:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+623:11419:x1800404480666112:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 101us (167us total) trans 0 rc -22/-22 00000100:00100000:1.0:1716999787.242184:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45275 00000100:00100000:3.0:1716999787.242926:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.242961:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480666176 00000100:00100000:1.0:1716999787.242964:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480666176 00000100:00100000:1.0:1716999787.242981:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45276 00000100:00100000:1.0:1716999787.242984:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+623:11419:x1800404480666176:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.242991:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.242998:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4552 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653ea expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.243019:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4559 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.243024:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.243027:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:1.0:1716999787.243041:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc30:0x0]: returning size 15360 00000004:00200000:1.0:1716999787.243043:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.243051:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4559 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.243060:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4552 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653ea expref: 625 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.243067:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4559 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653ea expref: 624 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.243071:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:1.0:1716999787.243072:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1716999787.243074:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133840, rc 0) 00000100:00100000:1.0:1716999787.243096:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+624:11419:x1800404480666176:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 111us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.243101:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45276 00000100:00100000:0.0:1716999787.243399:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.243436:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480666240 00000100:00100000:3.0:1716999787.243440:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480666240 00000100:00100000:3.0:1716999787.243468:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45277 00000100:00100000:3.0:1716999787.243473:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+624:11420:x1800404480666240:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.243484:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.243492:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4560 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653f1 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.243507:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653f1 expref: 625 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.243519:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4560 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653f1 expref: 625 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.243525:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.243527:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.243529:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94480, rc 0) 00000100:00100000:3.0:1716999787.243559:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+625:11420:x1800404480666240:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 85us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.243654:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45277 00000100:00100000:0.0:1716999787.244356:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.244411:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480666304 00000100:00100000:3.0:1716999787.244416:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480666304 00000100:00100000:3.0:1716999787.244477:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45278 00000100:00100000:3.0:1716999787.244481:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+625:11419:x1800404480666304:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.244488:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.244496:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4567 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653f8 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.244520:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc456e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244527:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc456e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244532:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc456e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244540:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4575 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244549:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244554:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244630:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc457c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244637:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc457c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244643:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc457c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:3.0:1716999787.244659:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc30:0x0]: returning size 15360 00000004:00200000:3.0:1716999787.244661:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999787.244669:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc457c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244676:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc457c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244681:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc456e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244686:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc456e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244690:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc456e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244695:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.244698:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc456e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244703:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc456e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244716:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.244718:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.244720:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc456e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244724:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc456e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244733:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244737:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4575 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244742:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244746:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.244751:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244755:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4575 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244761:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff8800a660c900) 00010000:00010000:3.0:1716999787.244763:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.244765:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4575 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244769:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4575 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.244788:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4567 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653f8 expref: 627 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.244796:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc457c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653f8 expref: 626 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.244802:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:3.0:1716999787.244803:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999787.244805:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94900, rc 0) 00000100:00100000:3.0:1716999787.244850:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+626:11419:x1800404480666304:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 367us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.244855:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45278 00000100:00100000:0.0:1716999787.245140:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.245172:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480666368 00000100:00100000:3.0:1716999787.245254:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480666368 00000100:00100000:3.0:1716999787.245285:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9023 00000100:00100000:3.0:1716999787.245289:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+626:11420:x1800404480666368:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999787.247143:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.247412:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480666496 00000100:00100000:2.0:1716999787.247418:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480666496 00000100:00100000:2.0:1716999787.247847:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45279 00000100:00100000:2.0:1716999787.247853:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+627:11419:x1800404480666496:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999787.247897:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999787.247919:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc457c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653f8 expref: 627 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.248446:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4559 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653ea expref: 627 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.248456:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:2.0:1716999787.248460:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.248688:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4583 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.248699:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4583 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.248782:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4583 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999787.249052:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca8380 reply state ffff8801310dd000 transno 4294985896 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4583 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.249058:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999787.249584:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+628:11419:x1800404480666496:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1728us (2441us total) trans 4294985896 rc 0/0 00000100:00100000:2.0:1716999787.250092:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45279 00010000:00010000:1.0:1716999787.251218:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4583 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.251227:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4583 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.251233:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4583 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.251238:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.251241:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4583 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.251247:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4583 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.251257:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:1.0:1716999787.251260:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.251263:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4583 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.251268:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4583 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999787.251706:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+625:11420:x1800404480666368:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 6413us (6563us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.251714:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9023 00000100:00100000:2.0:1716999787.252376:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.252413:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480666560 00000100:00100000:1.0:1716999787.252420:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480666560 00000100:00100000:1.0:1716999787.252447:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9933 00000100:00100000:1.0:1716999787.252452:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+79:1956:x1800404480666560:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:1.0:1716999787.252587:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1716999787.252589:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb mtime from disk: 1716999775 -> 1716999763 00002000:00010000:1.0:1716999787.252592:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb atime from disk: 1716999777 -> 1716999767 00002000:00010000:1.0:1716999787.252593:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:1.0:1716999787.252595:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5fc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1716999787.252631:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+80:1956:x1800404480666560:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 179us (256us total) trans 4294970128 rc 0/0 00000100:00100000:1.0:1716999787.252636:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9933 00000100:00100000:2.0:1716999787.255337:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.255377:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480666624 00000100:00100000:2.0:1716999787.255383:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.255383:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480666624 00000100:00100000:0.0:1716999787.255416:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480666688 00000100:00100000:0.0:1716999787.255418:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480666688 00000100:00100000:0.0:1716999787.255435:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45280 00000100:00100000:0.0:1716999787.255441:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+626:11419:x1800404480666624:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.255456:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.255471:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc458a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f653ff expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.255513:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4591 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255526:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4591 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255535:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4591 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255545:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4598 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255550:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255555:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255600:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4591 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255605:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4591 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255609:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4591 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255614:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.255616:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4591 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255621:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4591 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255629:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.255631:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.255634:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4591 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255638:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4591 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255656:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4598 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255661:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4598 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255664:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255668:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.255669:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4598 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255673:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4598 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255677:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4f4f46 (ffff88009330d300) 00010000:00010000:0.0:1716999787.255679:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.255681:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4598 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255684:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4598 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.255713:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc458a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653ff expref: 627 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.255718:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc458a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653ff expref: 627 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.255724:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf600, rc 0) 00000100:00100000:0.0:1716999787.255762:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+626:11419:x1800404480666624:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 321us (432us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.255768:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45280 00000100:00100000:3.0:1716999787.255783:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45281 00000100:00100000:3.0:1716999787.255790:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+625:11420:x1800404480666688:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.255797:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.255805:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc459f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65406 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.255840:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc45a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255848:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc45a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255854:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc45a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255862:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc45ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255867:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc45ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255872:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc45ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255925:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc45a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255930:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc45a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255934:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc45a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255938:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.255941:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc45a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255945:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc45a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255951:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.255953:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.255956:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc45a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255960:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc45a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255980:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc45ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255985:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc45ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255989:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc45ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255993:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.255995:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc45ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.255999:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc45ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.256005:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xd4e4194e (ffff8800a660c900) 00010000:00010000:3.0:1716999787.256006:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.256008:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc45ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.256012:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc45ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.256040:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc459f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65406 expref: 626 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.256047:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc459f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65406 expref: 626 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.256054:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96ac0, rc 0) 00000100:00100000:3.0:1716999787.256085:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+625:11420:x1800404480666688:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 295us (702us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.256091:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45281 00000100:00100000:2.0:1716999787.258801:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.258847:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.259513:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480666752 00000100:00100000:3.0:1716999787.259519:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480666752 00000100:00100000:3.0:1716999787.259541:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480666816 00000100:00100000:3.0:1716999787.259542:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480666816 00000100:00100000:3.0:1716999787.259553:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45282 00000100:00100000:3.0:1716999787.259558:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+626:11419:x1800404480666752:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.259570:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.259582:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc45b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6540d expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.259601:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc45b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6540d expref: 627 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.259610:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc45b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6540d expref: 627 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.259626:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.259629:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.259631:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c961c0, rc 0) 00000100:00100000:3.0:1716999787.259658:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+627:11419:x1800404480666752:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 100us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.259663:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45282 00000100:00100000:3.0:1716999787.259676:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45283 00000100:00100000:3.0:1716999787.259679:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+626:11420:x1800404480666816:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.259685:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.259691:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc45bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65414 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.259721:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc45c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259728:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc45c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259734:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc45c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259744:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc45c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259748:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc45c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259753:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc45c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259801:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc45c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259806:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc45c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259810:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc45c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259815:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.259828:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc45c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259834:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc45c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259841:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.259844:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.259846:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc45c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259850:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc45c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259857:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc45c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259861:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc45c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259865:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc45c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259868:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.259870:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc45c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259874:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc45c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259891:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xd4e4194e (ffff8800a660cf00) 00010000:00010000:3.0:1716999787.259893:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.259895:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc45c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259902:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc45c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.259929:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc45bb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65414 expref: 627 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.259934:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc45bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65414 expref: 627 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.259939:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97cc0, rc 0) 00000100:00100000:3.0:1716999787.259953:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+626:11420:x1800404480666816:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 274us (1107us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.259958:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45283 00000100:00100000:0.0:1716999787.263270:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.263322:0:6836:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480666944 00000100:00100000:2.0:1716999787.263330:0:6836:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480666944 00000100:00100000:2.0:1716999787.263382:0:6836:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 606 00000100:00100000:2.0:1716999787.263388:0:6836:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+626:11420:x1800404480666944:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999787.263420:0:6836:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999787.263437:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc4296 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65311 expref: 626 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.263468:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:2.0:1716999787.263479:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4560 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653f1 expref: 625 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.263487:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.263489:0:6836:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.263538:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc45d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.263547:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc45d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.263554:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc45d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.263562:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc45d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.263566:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc45d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.263570:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc45d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.263582:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.263586:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.263590:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.263661:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc45e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.263671:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc45e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.263676:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc45e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000040:00080000:2.0:1716999787.264023:0:6836:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11386, 224 off2036440 00000004:00010000:2.0:1716999787.264094:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca9180 reply state ffff8801310db000 transno 4294985897 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc45e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.264100:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:2.0:1716999787.264102:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca9180 reply state ffff8801310db000 transno 4294985897 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.264106:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:2.0:1716999787.264108:0:6836:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc45d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.264113:0:6836:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc45d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.264118:0:6836:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc45d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.264122:0:6836:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.264124:0:6836:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc45d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.264129:0:6836:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc45d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.264135:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.264137:0:6836:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.264140:0:6836:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc45d0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.264144:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc45d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000004:00010000:2.0:1716999787.264149:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca9180 reply state ffff8801310db000 transno 4294985897 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc45d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.264153:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1716999787.264196:0:6836:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+626:11420:x1800404480666944:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 808us (931us total) trans 4294985897 rc 0/0 00000100:00100000:2.0:1716999787.264202:0:6836:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 606 00000100:00100000:2.0:1716999787.264543:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.265350:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667008 00000100:00100000:3.0:1716999787.265357:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667008 00000100:00100000:3.0:1716999787.265754:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9024 00000100:00100000:3.0:1716999787.265759:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+626:11419:x1800404480667008:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999787.266490:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.266508:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667072 00000100:00100000:0.0:1716999787.266512:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667072 00000100:00100000:0.0:1716999787.266534:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45284 00000100:00100000:0.0:1716999787.266538:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+627:11420:x1800404480667072:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.266547:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.266558:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc45ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6541b expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.266589:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc45f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.266598:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc45f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.266604:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc45f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.266611:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.266616:0:11055:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.266624:0:11055:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 4/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.266636:0:11055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.266642:0:11055:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.266691:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc45d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266697:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc45d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266702:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc45d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266706:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.266709:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc45d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266714:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc45d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266723:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff880134241200) 00010000:00010000:1.0:1716999787.266725:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.266728:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc45d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266732:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc45d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266746:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266751:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266755:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266758:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.266760:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266764:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266770:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xd4e4194e (ffff880134241100) 00010000:00010000:1.0:1716999787.266772:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.266774:0:3203:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.266779:0:3203:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.266784:0:3203:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.266795:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266799:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc45de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266806:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc45e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266810:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc45e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266814:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc45e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266826:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.266828:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc45e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266832:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc45e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266837:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:1.0:1716999787.266838:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1716999787.266840:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc45e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.266844:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc45e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.267011:0:11055:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267016:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267081:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4601 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267087:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267092:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:0.0:1716999787.267110:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2f:0x0]: returning size 15360 00000004:00200000:0.0:1716999787.267112:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.267123:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267129:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267135:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc45f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267139:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc45f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267143:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc45f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267146:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.267149:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc45f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267153:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc45f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267159:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.267160:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.267163:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc45f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267166:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc45f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267174:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267178:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267182:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267186:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.267188:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267195:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267200:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xd4e4194e (ffff880134241100) 00010000:00010000:0.0:1716999787.267202:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.267204:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267208:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc45fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.267226:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc45ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6541b expref: 628 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.267236:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4601 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6541b expref: 627 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.267242:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:0.0:1716999787.267243:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.267245:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd8c0, rc 0) 00000100:00100000:0.0:1716999787.267274:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+627:11420:x1800404480667072:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 734us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.267280:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45284 00000100:00100000:0.0:1716999787.271374:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.271557:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667200 00000100:00100000:1.0:1716999787.271564:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667200 00000100:00100000:1.0:1716999787.271589:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45285 00000100:00100000:1.0:1716999787.271594:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+627:11420:x1800404480667200:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.271626:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999787.271645:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc4601 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6541b expref: 627 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.271658:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:1.0:1716999787.271661:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.271689:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4608 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.271699:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.271707:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999787.271972:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca9c00 reply state ffff8800941db000 transno 4294985898 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999787.271977:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999787.272025:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+628:11420:x1800404480667200:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 429us (656us total) trans 4294985898 rc 0/0 00000100:00100000:1.0:1716999787.272030:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45285 00010000:00010000:1.0:1716999787.272711:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4608 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.272718:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4608 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.272723:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4608 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.272726:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.272729:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4608 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.272732:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4608 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.272738:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:1.0:1716999787.272740:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.272741:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4608 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.272744:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4608 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999787.274413:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+626:11419:x1800404480667008:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 8649us (9865us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.274421:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9024 00000100:00100000:3.0:1716999787.277136:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.277167:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.277248:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667328 00000100:00100000:1.0:1716999787.277256:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667328 00000100:00100000:1.0:1716999787.277298:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45286 00000100:00100000:1.0:1716999787.277303:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+626:11419:x1800404480667328:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.277320:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.277333:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc460f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65422 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.277373:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4616 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277382:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4616 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277390:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4616 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277402:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc461d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x54434199 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277407:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc461d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277411:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc461d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277460:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4616 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277465:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4616 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277471:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4616 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277475:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.277477:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4616 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277482:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4616 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277489:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.277491:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.277494:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4616 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277497:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4616 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277505:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc461d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277509:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc461d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277513:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc461d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277516:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.277518:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc461d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277522:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc461d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277526:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x54434199 (ffff88009240e500) 00010000:00010000:1.0:1716999787.277527:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.277529:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc461d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277532:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc461d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.277556:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc460f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65422 expref: 627 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.277562:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc460f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65422 expref: 627 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.277567:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131f80, rc 0) 00000100:00100000:0.0:1716999787.277597:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667264 00000100:00100000:0.0:1716999787.277600:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667264 00000100:00100000:0.0:1716999787.277629:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9934 00000100:00100000:0.0:1716999787.277633:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+82:1959:x1800404480667264:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999787.277776:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999787.277779:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb mtime from disk: 1716999763 -> 1716999775 00002000:00010000:0.0:1716999787.277781:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb atime from disk: 1716999767 -> 1716999777 00002000:00010000:0.0:1716999787.277782:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:0.0:1716999787.277784:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5fc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1716999787.277830:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+83:1959:x1800404480667264:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 195us (698us total) trans 4294970169 rc 0/0 00000100:00100000:0.0:1716999787.277836:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9934 00000100:00100000:1.0:1716999787.277978:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+626:11419:x1800404480667328:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 673us (808us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.277985:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45286 00000100:00100000:0.0:1716999787.280476:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.280873:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667456 00000100:00100000:1.0:1716999787.280907:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667456 00000100:00100000:1.0:1716999787.281134:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45287 00000100:00100000:3.0:1716999787.281158:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.281228:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667520 00000100:00100000:0.0:1716999787.281231:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667520 00000100:00100000:0.0:1716999787.281250:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45288 00000100:00100000:0.0:1716999787.281254:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+627:11419:x1800404480667520:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.281270:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.281286:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc4624 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65429 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999787.281360:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+628:11420:x1800404480667456:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:1.0:1716999787.281382:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4632 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.281393:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.281401:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.281424:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4632 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.281429:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4632 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.281435:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.281439:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.281443:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4632 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.281536:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc462b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281544:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc462b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281550:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc462b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281561:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281569:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281573:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281618:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc462b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281623:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc462b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281626:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc462b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281631:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.281633:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc462b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.281639:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4632 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.281639:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc462b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.281647:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:0.0:1716999787.281647:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.281649:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1716999787.281649:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.281652:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc462b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281656:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc462b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281664:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281669:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4639 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281674:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281677:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddb00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.281679:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281683:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4639 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281688:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xeca88e0f (ffff88009330d300) 00010000:00010000:0.0:1716999787.281690:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.281692:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4639 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281696:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc4639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.281727:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc4624 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65429 expref: 628 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.281734:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc4624 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65429 expref: 628 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.281745:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcfc0, rc 0) 00010000:00010000:1.0:1716999787.282469:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4632 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.282476:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4632 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.282538:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+627:11420:x1800404480667456:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 1397us (2068us total) trans 0 rc -22/-22 00000100:00100000:0.0:1716999787.282538:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+627:11419:x1800404480667520:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1282us (1379us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.282544:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45288 00000100:00100000:1.0:1716999787.282547:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45287 00000100:00100000:0.0:1716999787.285993:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.286041:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.286119:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667648 00000100:00100000:1.0:1716999787.286125:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667648 00000100:00100000:1.0:1716999787.286160:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667712 00000100:00100000:1.0:1716999787.286163:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667712 00000100:00100000:1.0:1716999787.286176:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45289 00000100:00100000:1.0:1716999787.286182:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+627:11419:x1800404480667648:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.286195:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.286197:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999787.286215:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc45b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6540d expref: 627 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.286227:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.286230:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.286240:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4640 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65430 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.286334:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4647 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.286344:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.286351:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.286360:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc464e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.286364:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc464e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.286368:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc464e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:1.0:1716999787.286779:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5fd:0x0], index 0: 0 00000040:00080000:1.0:1716999787.286852:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11387, 184 off2036624 00010000:00010000:1.0:1716999787.286974:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4655 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.286981:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.286988:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4655 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287012:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287017:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4647 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287022:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4647 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287027:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.287029:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4647 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287037:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4647 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287044:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.287046:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.287048:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4647 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287051:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4647 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:1.0:1716999787.287059:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131cab800 reply state ffff8800941df000 transno 4294985899 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc464e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.287064:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999787.287080:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4640 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65430 expref: 629 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.287090:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4655 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65430 expref: 628 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.287095:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc32:0x0].0x0 (ffff88009240e200) 00010000:00010000:1.0:1716999787.287097:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.287099:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132d00, rc 0) 00000100:00100000:1.0:1716999787.287135:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+629:11419:x1800404480667648:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 953us (1147us total) trans 4294985899 rc 0/0 00000100:00100000:1.0:1716999787.287141:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45289 00000100:00100000:1.0:1716999787.287156:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45290 00000100:00100000:1.0:1716999787.287160:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+628:11420:x1800404480667712:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.287170:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.287176:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4663 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65437 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.287199:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc466a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287206:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc466a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287211:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc466a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287219:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287223:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287227:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287277:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4678 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287282:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287286:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:1.0:1716999787.287300:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc31:0x0]: returning size 15360 00000004:00200000:1.0:1716999787.287303:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.287309:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287315:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287319:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc466a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287323:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc466a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287327:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc466a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287919:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.287924:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc466a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287931:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc466a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287938:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.287940:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.287942:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc466a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287946:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc466a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287954:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287958:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4671 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287963:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287967:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.287969:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287972:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4671 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287977:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x83e4194e (ffff88009240e800) 00010000:00010000:1.0:1716999787.287978:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.287979:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4671 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.287983:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.288002:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4663 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65437 expref: 630 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.288012:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4678 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65437 expref: 629 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.288022:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:1.0:1716999787.288024:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.288025:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133180, rc 0) 00000100:00100000:0.0:1716999787.288566:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+629:11420:x1800404480667712:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1402us (2522us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.288573:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45290 00010000:00010000:0.0:1716999787.288844:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc464e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.288850:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc464e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.288854:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc464e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.288858:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.288860:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc464e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.288864:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc464e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.288871:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xeca88e0f (ffff88009240e300) 00010000:00010000:0.0:1716999787.288874:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.288876:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc464e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.288896:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc464e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999787.289215:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.289256:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667776 00000100:00100000:0.0:1716999787.289262:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667776 00000100:00100000:2.0:1716999787.290090:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9935 00000100:00100000:2.0:1716999787.290097:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+80:1959:x1800404480667776:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.290108:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.290122:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc467f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6543e expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999787.290140:0:15837:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999787.290153:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.290155:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.290160:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc467f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6543e expref: 81 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.290172:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc467f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6543e expref: 81 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.290181:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8900, rc 0) 00000100:00100000:2.0:1716999787.290207:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+81:1959:x1800404480667776:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 111us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.290213:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9935 00000100:00100000:3.0:1716999787.291572:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.291641:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667840 00000100:00100000:0.0:1716999787.291646:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667840 00000100:00100000:0.0:1716999787.291716:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45291 00000100:00100000:0.0:1716999787.291722:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+628:11420:x1800404480667840:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.291734:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.291743:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4686 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65445 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.291776:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc468d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.291784:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc468d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.291791:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc468d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.291799:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4694 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.291804:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.291808:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.291864:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc468d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.291870:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc468d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.291874:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc468d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.291993:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.291996:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc468d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.292001:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc468d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.292010:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.292012:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.292014:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc468d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.292018:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc468d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.292026:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4694 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.292030:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4694 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.292034:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.292038:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.292039:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4694 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.292043:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4694 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.292047:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009330da00) 00010000:00010000:0.0:1716999787.292049:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.292050:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4694 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.292054:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4694 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.292081:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4686 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65445 expref: 629 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.292086:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4686 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65445 expref: 629 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.292092:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf3c0, rc 0) 00000100:00100000:0.0:1716999787.292158:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+628:11420:x1800404480667840:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 435us (588us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.292163:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45291 00000100:00100000:1.0:1716999787.292558:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.292596:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667904 00000100:00100000:0.0:1716999787.292600:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667904 00000100:00100000:0.0:1716999787.292626:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9936 00000100:00100000:0.0:1716999787.292631:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+81:11419:x1800404480667904:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.292638:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.292647:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6544c expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.292662:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc467f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6543e expref: 82 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999787.292668:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.292669:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.292671:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6544c expref: 82 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.292692:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc467f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6543e expref: 82 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999787.292702:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc467f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6543e expref: 82 pid: 15837 timeout: 406 lvb_type: 1 00000100:00100000:0.0:1716999787.292714:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483008256:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999787.292754:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093549cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1716999787.293965:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.294035:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480667968 00000100:00100000:0.0:1716999787.294041:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480667968 00000100:00100000:0.0:1716999787.294072:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45292 00000100:00100000:0.0:1716999787.294078:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+628:11420:x1800404480667968:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.294088:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.294099:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc46a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65453 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.294117:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc46a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65453 expref: 629 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.294126:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc46a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65453 expref: 629 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.294131:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.294134:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.294136:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde640, rc 0) 00000100:00100000:0.0:1716999787.294168:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+629:11420:x1800404480667968:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 90us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.294174:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45292 00000100:00100000:0.0:1716999787.294669:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483008256:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999787.294680:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999787.294687:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6544c expref: 82 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.294699:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd8c0, rc 0) 00000100:00100000:1.0:1716999787.294739:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480668032 00000100:00100000:1.0:1716999787.294742:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480668032 00010000:00010000:1.0:1716999787.294756:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc467f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6543e expref: 83 pid: 15837 timeout: 406 lvb_type: 1 00000100:00100000:1.0:1716999787.294790:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4506 00000100:00100000:1.0:1716999787.294794:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+83:1959:x1800404480668032:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999787.294802:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999787.295047:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc467f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6543e expref: 83 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999787.295057:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc467f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6543e expref: 83 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999787.295071:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc467f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6543e expref: 83 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999787.295080:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.295081:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.295086:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6544c expref: 82 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.295092:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6544c expref: 82 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.295115:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6544c expref: 82 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999787.295124:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013502a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483008320:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999787.295160:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930ef6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.295267:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+82:11419:x1800404480667904:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2570us (2646us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.295381:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9936 00000100:00100000:3.0:1716999787.298809:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.299016:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480668096 00000100:00100000:2.0:1716999787.299024:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480668096 00000100:00100000:2.0:1716999787.299069:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9025 00000100:00100000:2.0:1716999787.299076:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec25450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+629:11420:x1800404480668096:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999787.299344:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.299490:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013502a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483008320:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999787.299509:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999787.299540:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+81:1959:x1800404480668032:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 4745us (4860us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.299548:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4506 00000100:00100000:0.0:1716999787.299840:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480668224 00000100:00100000:0.0:1716999787.299844:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480668224 00000100:00100000:0.0:1716999787.299860:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9026 00000100:00100000:0.0:1716999787.299864:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11419:x1800404480668224:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999787.300207:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11388, 168 off2036792 00000001:00080000:0.0:1716999787.300211:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985900 00000100:00100000:0.0:1716999787.300266:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+632:11419:x1800404480668224:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 400us (922us total) trans 4294985901 rc 0/0 00000100:00100000:0.0:1716999787.300272:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9026 00000020:00080000:0.0:1716999787.300275:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999787.302596:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec25450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+631:11420:x1800404480668096:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3515us (3786us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.302606:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9025 00000100:00100000:3.0:1716999787.304229:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.304382:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480668288 00000100:00100000:0.0:1716999787.304388:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480668288 00000100:00100000:0.0:1716999787.304456:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45293 00000100:00100000:0.0:1716999787.304462:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+631:11419:x1800404480668288:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.304478:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.304492:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc46a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6545a expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.304534:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc46b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304545:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc46b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304554:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc46b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304564:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc46b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304568:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc46b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304572:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc46b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304620:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc46b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304625:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc46b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304630:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc46b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304635:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.304638:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc46b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304642:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc46b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304651:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.304653:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.304656:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc46b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304661:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc46b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304669:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc46b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304674:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc46b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304678:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc46b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304682:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.304684:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc46b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304688:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc46b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304693:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x53504954 (ffff88009330da00) 00010000:00010000:0.0:1716999787.304695:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.304696:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc46b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304700:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc46b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.304727:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc46a9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6545a expref: 632 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.304733:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc46a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6545a expref: 632 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.304739:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:0.0:1716999787.304762:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+631:11419:x1800404480668288:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 300us (535us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.304768:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45293 00000100:00100000:3.0:1716999787.306069:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.306748:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.306851:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480668352 00000100:00100000:0.0:1716999787.306856:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480668352 00000100:00100000:0.0:1716999787.307224:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480668416 00000100:00100000:0.0:1716999787.307227:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480668416 00000100:00100000:0.0:1716999787.307437:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45294 00000100:00100000:0.0:1716999787.307443:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+632:11420:x1800404480668352:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.307459:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.307471:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc46be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65461 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.307510:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc46c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.307519:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc46c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.307527:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc46c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.307537:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.307542:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.307546:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.307592:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc46c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.307598:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc46c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.307602:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc46c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.307607:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.307610:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc46c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999787.307771:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45295 00000100:00100000:3.0:1716999787.307776:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+633:11419:x1800404480668416:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.307784:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.307791:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc46d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65468 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.307808:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc46d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65468 expref: 634 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.307825:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc46d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65468 expref: 634 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.307831:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.307834:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.307836:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94fc0, rc 0) 00000100:00100000:3.0:1716999787.307866:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+634:11419:x1800404480668416:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 90us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.307872:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45295 00010000:00010000:0.0:1716999787.308021:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc46c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.308030:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.308032:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.308034:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc46c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.308039:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc46c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.308048:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.308052:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.308057:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.308064:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdfcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.308066:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.308071:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.308076:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009330d900) 00010000:00010000:0.0:1716999787.308078:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.308080:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.308084:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.308114:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc46be lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65461 expref: 633 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.308120:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc46be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65461 expref: 633 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.308127:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdef40, rc 0) 00000100:00100000:0.0:1716999787.308146:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+632:11420:x1800404480668352:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 704us (2078us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.308151:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45294 00000100:00100000:3.0:1716999787.311031:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.311263:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480668480 00000100:00100000:2.0:1716999787.311270:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480668480 00000100:00100000:2.0:1716999787.311310:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9027 00000100:00100000:2.0:1716999787.311316:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+632:11419:x1800404480668480:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999787.312787:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.312856:0:4162:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480668608 00000100:00100000:0.0:1716999787.312861:0:4162:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480668608 00000100:00100000:0.0:1716999787.312943:0:4162:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 607 00000100:00100000:0.0:1716999787.312948:0:4162:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+634:11420:x1800404480668608:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.312978:0:4162:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999787.312995:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4678 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65437 expref: 634 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.313010:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:0.0:1716999787.313019:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc46a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65453 expref: 633 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.313026:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.313028:0:4162:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.313070:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc46da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313080:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc46da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313087:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc46da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313096:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc46e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313101:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc46e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313106:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc46e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313119:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc46e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313124:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc46e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313129:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc46e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313197:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc46ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313203:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc46ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313208:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc46ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000040:00080000:0.0:1716999787.313511:0:4162:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11389, 224 off2037016 00000004:00010000:0.0:1716999787.313585:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008b9fdc00 reply state ffff880089b4b000 transno 4294985902 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc46ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:0.0:1716999787.313590:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999787.313593:0:4162:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc46da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313598:0:4162:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc46da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313603:0:4162:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc46da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313608:0:4162:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.313610:0:4162:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc46da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313615:0:4162:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc46da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313622:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.313625:0:4162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.313627:0:4162:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc46da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.313631:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc46da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00000004:00010000:0.0:1716999787.313638:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008b9fdc00 reply state ffff880089b4b000 transno 4294985902 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc46e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:0.0:1716999787.313642:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00010000:0.0:1716999787.313644:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008b9fdc00 reply state ffff880089b4b000 transno 4294985902 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc46e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:0.0:1716999787.313648:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1716999787.313685:0:4162:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+634:11420:x1800404480668608:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 736us (899us total) trans 4294985902 rc 0/0 00000100:00100000:0.0:1716999787.313691:0:4162:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 607 00010000:00010000:1.0:1716999787.316774:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc46e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316785:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc46e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316791:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc46e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316796:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.316800:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc46e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316805:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc46e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316814:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x83e4194e (ffff88009330d300) 00010000:00010000:1.0:1716999787.316831:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.316835:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc46e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316839:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc46e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x83e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316859:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc46e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316863:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc46e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316868:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc46e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316895:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.316897:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc46e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316902:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc46e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316908:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009330dd00) 00010000:00010000:1.0:1716999787.316910:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.316912:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc46e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316916:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc46e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316926:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc46ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316930:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc46ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316934:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc46ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316937:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcfc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.316940:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc46ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316943:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc46ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316949:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:1.0:1716999787.316951:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1716999787.316954:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc46ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999787.316957:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc46ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00000100:00100000:2.0:1716999787.318019:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+631:11419:x1800404480668480:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 6696us (6987us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.318028:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9027 00000100:00100000:3.0:1716999787.318597:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.318652:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480668672 00000100:00100000:0.0:1716999787.318658:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480668672 00000100:00100000:0.0:1716999787.318786:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45296 00000100:00100000:0.0:1716999787.318792:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+631:11420:x1800404480668672:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.318806:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.318829:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc46f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6546f expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.318869:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.318904:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.318915:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.318926:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4704 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.318932:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.318937:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319015:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc470b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319021:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc470b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319026:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc470b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:0.0:1716999787.319048:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc31:0x0]: returning size 15360 00000004:00200000:0.0:1716999787.319051:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.319062:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc470b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319069:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc470b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319075:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319079:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319088:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319092:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdfcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.319095:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319100:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319107:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.319110:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.319112:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319116:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc46fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319123:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319128:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4704 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319133:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319137:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.319139:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319144:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319153:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff88009330da00) 00010000:00010000:0.0:1716999787.319155:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.319157:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4704 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319161:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4704 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.319182:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc46f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6546f expref: 633 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.319192:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc470b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6546f expref: 632 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.319197:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:0.0:1716999787.319199:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.319201:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:0.0:1716999787.319225:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+632:11420:x1800404480668672:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 432us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.319230:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45296 00000100:00100000:3.0:1716999787.326501:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.326587:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.326652:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480668800 00000100:00100000:0.0:1716999787.326660:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480668800 00000100:00100000:0.0:1716999787.326687:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480668864 00000100:00100000:0.0:1716999787.326689:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480668864 00000100:00100000:0.0:1716999787.326704:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45297 00000100:00100000:0.0:1716999787.326710:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+633:11420:x1800404480668800:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.326751:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999787.326770:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc470b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6546f expref: 633 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.326783:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:0.0:1716999787.326786:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.326812:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc4712 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.326832:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc4712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.326840:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc4712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999787.327109:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008eb72300 reply state ffff8800b53d0000 transno 4294985903 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc4712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.327115:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.327176:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+634:11420:x1800404480668800:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 466us (682us total) trans 4294985903 rc 0/0 00000100:00100000:0.0:1716999787.327182:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45297 00000100:00100000:2.0:1716999787.328519:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45298 00000100:00100000:2.0:1716999787.328526:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+633:11419:x1800404480668864:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.328538:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.328549:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4719 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65476 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.328590:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4720 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328598:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328604:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328612:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328617:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328622:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328661:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4720 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328665:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4720 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328669:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328674:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.328677:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4720 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328681:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4720 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328691:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.328693:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.328696:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4720 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328699:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4720 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328713:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328717:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4727 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328722:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328725:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.328726:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328730:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4727 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328734:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff880134241200) 00010000:00010000:2.0:1716999787.328736:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.328737:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4727 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328741:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.328762:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4719 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65476 expref: 634 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.328768:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4719 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65476 expref: 634 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.328773:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8d80, rc 0) 00000100:00100000:2.0:1716999787.328803:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+633:11419:x1800404480668864:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 277us (2215us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.328808:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45298 00000100:00100000:3.0:1716999787.331148:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999787.331149:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc4712 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.331158:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc4712 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.331188:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480668928 00000100:00100000:1.0:1716999787.331196:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480668928 00000100:00100000:3.0:1716999787.331221:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.331229:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9937 00000100:00100000:1.0:1716999787.331234:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+83:1959:x1800404480668928:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:1.0:1716999787.331373:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1716999787.331375:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb mtime from disk: 1716999763 -> 1716999775 00002000:00010000:1.0:1716999787.331377:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb atime from disk: 1716999767 -> 1716999777 00002000:00010000:1.0:1716999787.331380:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:1.0:1716999787.331382:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1716999787.331410:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+84:1959:x1800404480668928:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 174us (267us total) trans 4294970170 rc 0/0 00000100:00100000:1.0:1716999787.331416:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9937 00000100:00100000:1.0:1716999787.331440:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480669056 00000100:00100000:1.0:1716999787.331443:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480669056 00000100:00100000:1.0:1716999787.331456:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45299 00000100:00100000:1.0:1716999787.331460:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+633:11419:x1800404480669056:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.331472:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.331474:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999787.331488:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc46d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65468 expref: 633 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.331503:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.331506:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.331515:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc472e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6547d expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.331587:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4735 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.331597:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.331604:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.331614:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc473c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.331619:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc473c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.331623:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc473c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:1.0:1716999787.332019:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5fe:0x0], index 1: 0 00000040:00080000:1.0:1716999787.332080:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11390, 176 off2037192 00010000:00010000:0.0:1716999787.332119:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc4712 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.332125:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.332127:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc4712 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.332133:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc4712 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.332141:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:0.0:1716999787.332143:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.332146:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc4712 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.332150:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc4712 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.333739:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.333784:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480669184 00000100:00100000:3.0:1716999787.333790:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480669184 00000100:00100000:3.0:1716999787.333827:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45300 00000100:00100000:3.0:1716999787.333832:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+634:11420:x1800404480669184:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:3.0:1716999787.333862:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4743 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.333871:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.333891:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.333903:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4743 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.333908:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4743 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.333913:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4743 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.333917:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.333920:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4743 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.333924:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4743 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.333931:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:3.0:1716999787.333933:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999787.333935:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4743 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.333939:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4743 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999787.333973:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+634:11420:x1800404480669184:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 141us (237us total) trans 0 rc -22/-22 00000100:00100000:3.0:1716999787.333979:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45300 00010000:00010000:0.0:1716999787.334364:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc474a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.334371:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc474a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.334377:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc474a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.334406:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.334410:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4735 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.334414:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.334418:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.334420:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.334424:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4735 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.334434:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.334436:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.334438:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4735 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.334442:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4735 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999787.334451:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008eb71500 reply state ffff8801348a7000 transno 4294985904 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc473c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.334457:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999787.334478:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc472e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6547d expref: 634 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.334488:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc474a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6547d expref: 633 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.334493:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc33:0x0].0x0 (ffff88009240e800) 00010000:00010000:0.0:1716999787.334495:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.334496:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131b00, rc 0) 00000100:00100000:0.0:1716999787.334943:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+634:11419:x1800404480669056:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 3480us (3720us total) trans 4294985904 rc 0/0 00000100:00100000:0.0:1716999787.334949:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45299 00000100:00100000:0.0:1716999787.335578:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999787.336591:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc473c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.336596:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc473c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.336600:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc473c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.336603:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.336606:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc473c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.336609:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc473c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.336616:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff88009240e300) 00010000:00010000:1.0:1716999787.336617:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.336619:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc473c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.336622:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc473c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.336625:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.336671:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480669312 00000100:00100000:3.0:1716999787.336677:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480669312 00000100:00100000:3.0:1716999787.336706:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9938 00000100:00100000:3.0:1716999787.336712:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+84:1958:x1800404480669312:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.336723:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.336735:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090c96640/0x6d188eabd8dc4758 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6548b expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999787.336748:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480669248 00002000:00010000:3.0:1716999787.336751:0:15837:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x5fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00100000:2.0:1716999787.336753:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480669248 00010000:00010000:3.0:1716999787.336761:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.336763:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.336768:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c96640/0x6d188eabd8dc4758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6548b expref: 85 pid: 15837 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1716999787.336770:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45301 00000100:00100000:2.0:1716999787.336775:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+633:11420:x1800404480669248:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.336778:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090c96640/0x6d188eabd8dc4758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6548b expref: 85 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.336782:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.336785:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96640, rc 0) 00010000:00010000:2.0:1716999787.336791:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc475f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65484 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999787.336809:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+85:1958:x1800404480669312:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 97us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.336814:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9938 00010000:00010000:2.0:1716999787.336839:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4766 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.336847:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.336853:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:2.0:1716999787.336894:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc31:0x0]: returning size 15360 00000004:00200000:2.0:1716999787.336897:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999787.336909:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.337098:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc475f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65484 expref: 635 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.337109:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65484 expref: 634 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.337114:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:2.0:1716999787.337116:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1716999787.337118:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9680, rc 0) 00000100:00100000:2.0:1716999787.337150:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+634:11420:x1800404480669248:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 374us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.337155:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45301 00000100:00100000:0.0:1716999787.338736:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.338813:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.338905:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480669440 00000100:00100000:2.0:1716999787.338910:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480669440 00000100:00100000:2.0:1716999787.338943:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9028 00000100:00100000:2.0:1716999787.338949:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+634:11419:x1800404480669440:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999787.339279:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11391, 168 off2037360 00000001:00080000:2.0:1716999787.339285:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985905 00000100:00100000:2.0:1716999787.339346:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+636:11419:x1800404480669440:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 397us (611us total) trans 4294985906 rc 0/0 00000100:00100000:2.0:1716999787.339352:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9028 00000020:00080000:2.0:1716999787.339356:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999787.339471:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480669504 00000100:00100000:3.0:1716999787.339476:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480669504 00000100:00100000:3.0:1716999787.339494:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45302 00000100:00100000:3.0:1716999787.339498:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+636:11420:x1800404480669504:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.339505:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.339516:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc476d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65492 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.339544:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4774 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339552:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4774 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339558:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4774 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339566:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc477b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339572:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc477b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339576:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc477b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339651:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4782 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339657:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339663:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:3.0:1716999787.339676:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc31:0x0]: returning size 15360 00000004:00200000:3.0:1716999787.339679:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999787.339687:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339693:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4782 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339698:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4774 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339703:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4774 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339708:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4774 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339712:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c973c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.339715:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4774 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339721:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4774 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339728:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.339730:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.339732:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4774 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339737:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4774 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339744:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc477b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339748:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc477b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339753:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc477b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339756:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.339758:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc477b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339762:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc477b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339767:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff8800939ba500) 00010000:00010000:3.0:1716999787.339769:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.339771:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc477b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339775:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc477b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.339793:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc476d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65492 expref: 638 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.339801:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4782 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65492 expref: 637 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.339807:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:3.0:1716999787.339808:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999787.339810:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94000, rc 0) 00000100:00100000:3.0:1716999787.339844:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+637:11420:x1800404480669504:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 344us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.339849:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45302 00000100:00100000:0.0:1716999787.341209:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.341312:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480669632 00000100:00100000:3.0:1716999787.341317:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480669632 00000100:00100000:3.0:1716999787.341352:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45303 00000100:00100000:3.0:1716999787.341357:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+637:11419:x1800404480669632:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999787.341388:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999787.341401:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc474a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6547d expref: 637 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.341412:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc33:0x0].0x0 (ffff88009240e800) 00010000:00010000:3.0:1716999787.341419:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999787.341433:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4789 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.341441:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4789 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.341453:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4789 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.341462:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4790 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.341467:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.341471:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.341589:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4797 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.341598:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4797 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.341604:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4797 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.341721:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.341867:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480669760 00000100:00100000:1.0:1716999787.341872:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480669760 00000100:00100000:1.0:1716999787.341916:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45304 00000100:00100000:1.0:1716999787.341920:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+637:11420:x1800404480669760:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.341940:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999787.341949:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4782 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65492 expref: 637 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.341963:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4766 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65484 expref: 636 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.341970:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:1.0:1716999787.341972:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:3.0:1716999787.341987:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1477, 64 off102784 00010000:00010000:1.0:1716999787.341988:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc479e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00000004:00080000:3.0:1716999787.341992:0:6822:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306541111566ns, next at 307541110381ns, rc = 0 00010000:00010000:1.0:1716999787.341995:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc479e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.342000:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc479e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:3.0:1716999787.342008:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11392, 176 off2037536 00010000:00010000:3.0:1716999787.342051:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc47a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342057:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc47a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342063:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc47a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342068:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc47a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342072:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc47a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342076:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc47a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342080:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc47a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342083:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999787.342085:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc47a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342090:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc47a5 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342098:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc33:0x0].0x0 (ffff8800939ba300) 00010000:00010000:3.0:1716999787.342100:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999787.342102:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc47a5 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342106:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc47a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342119:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4797 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342123:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4797 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342127:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4797 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342130:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.342132:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4797 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342137:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4797 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342142:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc33:0x0].0x0 (ffff8800939ba300) 00010000:00010000:3.0:1716999787.342143:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999787.342145:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4797 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342149:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4797 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342179:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4789 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342184:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4789 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342188:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4789 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342192:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.342193:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4789 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342197:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4789 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342203:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.342204:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.342206:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4789 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.342211:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4789 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999787.342216:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131c59180 reply state ffff8800996aa000 transno 4294985907 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999787.342221:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999787.342255:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+637:11419:x1800404480669632:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 897us (1047us total) trans 4294985907 rc 0/0 00000100:00100000:3.0:1716999787.342261:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45303 00010000:00010000:0.0:1716999787.342991:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4790 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.343167:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4790 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.343171:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4790 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.343175:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.343177:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4790 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.343181:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4790 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.343189:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff8800939ba100) 00010000:00010000:0.0:1716999787.343191:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.343193:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4790 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.343197:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4790 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999787.343250:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092e7f800 reply state ffff8801348a0000 transno 4294985908 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc479e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.343255:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.343357:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+637:11420:x1800404480669760:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1434us (1635us total) trans 4294985908 rc 0/0 00000100:00100000:0.0:1716999787.343363:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45304 00000100:00100000:3.0:1716999787.343402:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.343540:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480669824 00000100:00100000:0.0:1716999787.343545:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480669824 00000100:00100000:0.0:1716999787.343808:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45305 00000100:00100000:0.0:1716999787.343813:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+637:11419:x1800404480669824:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.343836:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.343845:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc47ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65499 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.343873:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc47b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343896:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc47b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343902:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc47b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343910:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc47ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343916:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc47ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343920:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc47ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343953:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc47b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343958:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc47b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343961:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc47b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343966:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddb00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.343969:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc47b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343973:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc47b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343979:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.343981:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.343983:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc47b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343987:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc47b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343993:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc47ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.343997:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc47ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.344001:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc47ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.344004:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.344006:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc47ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.344011:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc47ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.344016:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff88009330dd00) 00010000:00010000:0.0:1716999787.344017:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.344019:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc47ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.344027:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc47ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.344049:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc47ac lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65499 expref: 638 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.344055:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc47ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65499 expref: 638 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.344061:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde400, rc 0) 00000100:00100000:0.0:1716999787.344093:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+637:11419:x1800404480669824:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 278us (692us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.344098:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45305 00010000:00010000:1.0:1716999787.345014:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc479e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.345021:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc479e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.345025:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc479e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.345029:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.345031:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc479e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.345035:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc479e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.345042:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:1.0:1716999787.345044:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.345045:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc479e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.345048:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc479e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999787.345163:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.345209:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480669888 00000100:00100000:1.0:1716999787.345213:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480669888 00000100:00100000:1.0:1716999787.345233:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9939 00000100:00100000:1.0:1716999787.345238:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+85:1958:x1800404480669888:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:1.0:1716999787.345350:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1716999787.345353:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb mtime from disk: 1716999775 -> 1716999763 00002000:00010000:1.0:1716999787.345355:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb atime from disk: 1716999777 -> 1716999767 00002000:00010000:1.0:1716999787.345357:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:1.0:1716999787.345358:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x5fd:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1716999787.345961:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+86:1958:x1800404480669888:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 720us (797us total) trans 4294970171 rc 0/0 00000100:00100000:1.0:1716999787.345967:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9939 00000100:00100000:3.0:1716999787.346467:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.347658:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480669952 00000100:00100000:2.0:1716999787.347665:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480669952 00000100:00100000:2.0:1716999787.347732:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45306 00000100:00100000:2.0:1716999787.347738:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+636:11419:x1800404480669952:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.347754:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.347767:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc47c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654a0 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.347789:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc47c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654a0 expref: 637 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.347798:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc47c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654a0 expref: 637 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.347804:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.347806:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.347809:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8fc0, rc 0) 00000100:00100000:2.0:1716999787.348186:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+637:11419:x1800404480669952:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 447us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.348191:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45306 00000100:00100000:2.0:1716999787.348762:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.349144:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670016 00000100:00100000:0.0:1716999787.349150:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670016 00000100:00100000:0.0:1716999787.349179:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45307 00000100:00100000:0.0:1716999787.349185:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+637:11420:x1800404480670016:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.349194:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.349205:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc47c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654a7 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.349241:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc47cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349249:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc47cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349257:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc47cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349271:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc47d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349276:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc47d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349281:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc47d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349332:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc47cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349337:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc47cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349342:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc47cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349347:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.349350:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc47cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349355:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc47cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349363:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.349365:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.349369:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc47cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349373:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc47cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349380:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc47d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349385:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc47d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349390:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc47d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349393:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.349395:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc47d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349399:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc47d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349405:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4f4f46 (ffff88009330de00) 00010000:00010000:0.0:1716999787.349407:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.349408:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc47d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349412:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc47d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4f4f46 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.349443:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc47c8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654a7 expref: 638 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.349450:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc47c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654a7 expref: 638 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.349457:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:0.0:1716999787.349478:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+637:11420:x1800404480670016:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 293us (716us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.349483:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45307 00000100:00100000:3.0:1716999787.351606:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.351670:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670080 00000100:00100000:1.0:1716999787.351676:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670080 00000100:00100000:3.0:1716999787.351685:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.351708:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45308 00000100:00100000:1.0:1716999787.351713:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+637:11420:x1800404480670080:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.351725:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.351736:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc47dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654ae expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999787.351743:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670144 00000100:00100000:0.0:1716999787.351746:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670144 00010000:00010000:1.0:1716999787.351757:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc47dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ae expref: 639 pid: 7785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999787.351773:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9029 00000100:00100000:0.0:1716999787.351778:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+639:11419:x1800404480670144:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:1.0:1716999787.351838:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc47dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ae expref: 639 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.351844:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.351846:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.351848:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131d40, rc 0) 00000100:00100000:1.0:1716999787.351875:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+639:11420:x1800404480670080:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 162us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.351976:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45308 00000100:00100000:3.0:1716999787.353967:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.354035:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670208 00000100:00100000:2.0:1716999787.354041:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670208 00000100:00100000:2.0:1716999787.354061:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9030 00000100:00100000:2.0:1716999787.354065:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec25050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+639:11420:x1800404480670208:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999787.355541:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+639:11419:x1800404480670144:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3759us (3853us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.355548:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9029 00000100:00100000:3.0:1716999787.357855:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.357999:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670272 00000100:00100000:0.0:1716999787.358006:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670272 00000100:00100000:2.0:1716999787.358144:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec25050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+639:11420:x1800404480670208:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4076us (4176us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.358153:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9030 00000100:00100000:0.0:1716999787.358280:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45309 00000100:00100000:0.0:1716999787.358286:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+638:11419:x1800404480670272:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.358299:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.358312:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc47e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654b5 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.358354:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc47eb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358365:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc47eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358374:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc47eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358384:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc47f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358389:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc47f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358394:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc47f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358440:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc47eb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358445:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc47eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358450:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc47eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358455:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcfc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.358458:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc47eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358462:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc47eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358470:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.358472:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.358475:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc47eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358479:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc47eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358490:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc47f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358495:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc47f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358499:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc47f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358506:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.358508:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc47f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358512:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc47f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358517:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff88009330da00) 00010000:00010000:0.0:1716999787.358519:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.358521:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc47f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358525:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc47f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.358553:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc47e4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654b5 expref: 639 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.358560:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc47e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654b5 expref: 639 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.358565:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdfcc0, rc 0) 00000100:00100000:0.0:1716999787.358597:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+638:11419:x1800404480670272:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 311us (746us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.358602:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45309 00000100:00100000:3.0:1716999787.360223:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.360492:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670336 00000100:00100000:1.0:1716999787.360497:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670336 00000100:00100000:1.0:1716999787.360548:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45310 00000100:00100000:1.0:1716999787.360554:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+638:11419:x1800404480670336:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.360564:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.360573:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc47f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654bc expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.360604:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4800 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360613:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4800 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360619:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4800 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360629:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360634:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360639:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360674:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4800 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360679:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4800 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360684:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4800 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360688:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.360691:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4800 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360696:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4800 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360703:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.360705:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.360708:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4800 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360712:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4800 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360719:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360724:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4807 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360728:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360732:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.360734:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360738:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4807 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360744:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xa8353d69 (ffff88009240e800) 00010000:00010000:1.0:1716999787.360746:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.360748:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4807 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360751:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4807 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.360775:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc47f9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654bc expref: 639 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.360782:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc47f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654bc expref: 639 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.360788:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131f80, rc 0) 00000100:00100000:1.0:1716999787.361315:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+638:11419:x1800404480670336:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 760us (1093us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.361321:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45310 00000100:00100000:3.0:1716999787.361909:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.362147:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670400 00000100:00100000:1.0:1716999787.362152:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670400 00000100:00100000:1.0:1716999787.362227:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45311 00000100:00100000:1.0:1716999787.362233:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+638:11420:x1800404480670400:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.362242:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.362252:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc480e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654c3 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.362279:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc4815 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362291:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc4815 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362298:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc4815 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362306:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc481c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x54434199 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362311:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc481c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362316:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc481c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362352:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc4815 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362356:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc4815 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362361:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc4815 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362365:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.362368:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc4815 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362372:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc4815 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362379:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.362382:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.362384:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc4815 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362388:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc4815 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362396:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc481c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362401:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc481c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362405:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc481c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362409:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.362411:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc481c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362415:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc481c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362420:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x54434199 (ffff88009240e400) 00010000:00010000:1.0:1716999787.362423:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.362424:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc481c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362428:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc481c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x54434199 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.362451:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc480e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654c3 expref: 639 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.362458:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc480e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654c3 expref: 639 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.362464:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130d80, rc 0) 00000100:00100000:1.0:1716999787.362498:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+638:11420:x1800404480670400:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 265us (590us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.362504:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45311 00000100:00100000:0.0:1716999787.363028:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.363119:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670464 00000100:00100000:1.0:1716999787.363123:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670464 00000100:00100000:1.0:1716999787.363140:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45312 00000100:00100000:1.0:1716999787.363144:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+638:11419:x1800404480670464:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.363152:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.363159:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4823 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654ca expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.363183:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc482a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363190:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc482a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363196:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc482a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363203:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4831 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363208:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363213:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363246:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc482a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363251:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc482a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363256:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc482a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363260:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.363262:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc482a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363267:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc482a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363273:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.363276:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.363278:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc482a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363283:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc482a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363290:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4831 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363295:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4831 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363299:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363306:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.363308:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4831 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363312:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4831 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363317:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xa8353d69 (ffff88009240e500) 00010000:00010000:1.0:1716999787.363319:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.363321:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4831 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.363324:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4831 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999787.364190:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.364246:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670528 00000100:00100000:2.0:1716999787.364250:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670528 00000100:00100000:2.0:1716999787.364269:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45313 00000100:00100000:2.0:1716999787.364274:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+640:11420:x1800404480670528:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.364281:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.364290:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4838 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654d1 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.364313:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc483f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364320:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc483f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364325:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc483f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364334:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4846 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364339:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364344:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364374:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc483f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364379:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc483f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364384:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc483f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364388:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.364390:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc483f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364396:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc483f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364402:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.364404:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.364406:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc483f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364410:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc483f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364420:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4846 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364424:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4846 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364429:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364432:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.364435:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4846 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364439:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4846 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364443:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xeca88e0f (ffff880134241d00) 00010000:00010000:2.0:1716999787.364445:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.364447:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4846 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364451:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4846 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.364474:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4838 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654d1 expref: 641 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.364481:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4838 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654d1 expref: 641 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.364487:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9680, rc 0) 00000100:00100000:2.0:1716999787.364510:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+640:11420:x1800404480670528:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 236us (322us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.364515:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45313 00010000:00010000:1.0:1716999787.364573:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4823 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ca expref: 639 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.364580:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4823 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ca expref: 639 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.364587:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130900, rc 0) 00000100:00100000:1.0:1716999787.364602:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+638:11419:x1800404480670464:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1458us (1576us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.364607:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45312 00000100:00100000:0.0:1716999787.366269:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.366301:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.366351:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670720 00000100:00100000:3.0:1716999787.366356:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670720 00000100:00100000:3.0:1716999787.366374:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670784 00000100:00100000:3.0:1716999787.366375:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670784 00000100:00100000:3.0:1716999787.366617:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45314 00000100:00100000:3.0:1716999787.366623:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+639:11420:x1800404480670720:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:1.0:1716999787.366623:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45315 00000100:00100000:1.0:1716999787.366629:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+639:11419:x1800404480670784:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.366636:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.366637:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.366638:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999787.366639:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1716999787.366653:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc47dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ae expref: 639 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.366653:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc47c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654a0 expref: 639 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.366664:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.366667:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.366675:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc484d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654df expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.366762:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4854 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.366771:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4854 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.366778:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4854 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.366786:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc485b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.366791:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc485b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.366795:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc485b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:0.0:1716999787.367227:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5fe:0x0], index 0: 0 00010000:00010000:3.0:1716999787.367273:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.367277:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999787.367285:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4862 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654d8 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00000040:00080000:0.0:1716999787.367288:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11393, 184 off2037720 00010000:00010000:3.0:1716999787.367342:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4869 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367349:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4869 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367355:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4869 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367364:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4870 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367369:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.367372:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.367373:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.367378:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.367385:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.367405:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4854 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.367411:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4854 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.367415:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4854 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.367419:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.367422:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4854 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.367427:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4854 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.367433:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.367435:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.367438:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4854 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.367442:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4854 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999787.367450:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131c59f80 reply state ffff88009ceba000 transno 4294985909 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc485b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.367455:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999787.367471:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc484d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654df expref: 641 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.367480:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654df expref: 640 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.367486:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:0.0:1716999787.367487:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.367489:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde1c0, rc 0) 00000100:00100000:0.0:1716999787.367523:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+641:11419:x1800404480670784:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 893us (1220us total) trans 4294985909 rc 0/0 00000100:00100000:0.0:1716999787.367529:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45315 00000004:00080000:3.0:1716999787.367591:0:11055:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5ff:0x0], index 1: 0 00000040:00080000:3.0:1716999787.367626:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11394, 184 off2037904 00010000:00010000:3.0:1716999787.367683:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4885 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367690:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367696:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367710:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4869 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367714:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4869 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367719:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4869 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367722:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.367724:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4869 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367732:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4869 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367738:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.367740:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.367742:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4869 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.367746:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4869 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:3.0:1716999787.367752:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131c59c00 reply state ffff8800996af000 transno 4294985910 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999787.367762:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999787.367775:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4862 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654d8 expref: 642 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.367784:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654d8 expref: 641 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.367788:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc35:0x0].0x0 (ffff8800939ba400) 00010000:00010000:3.0:1716999787.367790:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999787.367792:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96ac0, rc 0) 00000100:00100000:3.0:1716999787.367809:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+642:11420:x1800404480670720:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1187us (1543us total) trans 4294985910 rc 0/0 00000100:00100000:3.0:1716999787.367814:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45314 00010000:00010000:1.0:1716999787.370162:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.370173:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4870 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.370178:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4870 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999787.370193:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999787.370243:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc485b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.370249:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc485b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.370252:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.370254:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc485b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.370255:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4870 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.370261:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4870 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.370262:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.370264:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc485b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.370269:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc485b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.370271:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xeca88e0f (ffff8800939ba100) 00010000:00010000:1.0:1716999787.370274:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.370276:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4870 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.370277:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xa8353d69 (ffff88009240e300) 00010000:00010000:0.0:1716999787.370280:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.370281:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4870 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.370282:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc485b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.370287:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc485b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.370307:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670848 00000100:00100000:1.0:1716999787.370313:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670848 00000100:00100000:1.0:1716999787.370338:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9940 00000100:00100000:1.0:1716999787.370344:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+81:1959:x1800404480670848:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.370355:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.370367:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4893 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654e6 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1716999787.370384:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1716999787.370397:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.370399:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.370404:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654e6 expref: 82 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999787.370419:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654e6 expref: 82 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999787.370427:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130fc0, rc 0) 00000100:00100000:1.0:1716999787.370465:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+82:1959:x1800404480670848:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 120us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.370471:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9940 00000100:00100000:3.0:1716999787.371494:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.371666:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670912 00000100:00100000:1.0:1716999787.371670:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670912 00000100:00100000:1.0:1716999787.371698:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9941 00000100:00100000:1.0:1716999787.371703:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+86:1956:x1800404480670912:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.371711:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.371722:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc489a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654ed expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1716999787.371736:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x5ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1716999787.371747:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.371749:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.371753:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc489a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ed expref: 87 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999787.371762:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc489a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ed expref: 87 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999787.371769:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130d80, rc 0) 00000100:00100000:1.0:1716999787.372825:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+87:1956:x1800404480670912:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1111us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.372832:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9941 00000100:00100000:0.0:1716999787.375865:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.376047:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480670976 00000100:00100000:3.0:1716999787.376054:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480670976 00000100:00100000:3.0:1716999787.376084:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45316 00000100:00100000:3.0:1716999787.376090:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+640:11419:x1800404480670976:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.376107:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.376121:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc48a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654f4 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.376164:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376174:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376183:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376193:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376198:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376203:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376256:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376261:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376266:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376274:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.376277:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376282:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376291:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.376293:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.376296:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376300:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376312:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376316:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376321:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376324:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.376327:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376331:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376336:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff8800939ba300) 00010000:00010000:3.0:1716999787.376339:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.376341:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376344:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.376374:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc48a1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654f4 expref: 641 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.376380:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc48a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654f4 expref: 641 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.376387:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96f40, rc 0) 00000100:00100000:3.0:1716999787.377160:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+640:11419:x1800404480670976:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1067us (1298us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.377167:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45316 00000100:00100000:2.0:1716999787.377218:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.377366:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480671040 00000100:00100000:1.0:1716999787.377371:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480671040 00000100:00100000:1.0:1716999787.377392:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9942 00000100:00100000:1.0:1716999787.377396:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+87:11420:x1800404480671040:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.377404:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.377414:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f654fb expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.377430:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc489a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ed expref: 88 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999787.377435:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.377437:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.377439:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654fb expref: 88 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.377460:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc489a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ed expref: 88 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999787.377469:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc489a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ed expref: 88 pid: 17864 timeout: 406 lvb_type: 1 00000100:00100000:1.0:1716999787.377479:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013502a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483008384:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999787.377520:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1716999787.378336:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.378709:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480671104 00000100:00100000:3.0:1716999787.378713:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480671104 00000100:00100000:3.0:1716999787.378745:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45317 00000100:00100000:3.0:1716999787.378750:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+640:11419:x1800404480671104:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.378940:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.378952:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc48bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65502 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.378996:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc48bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65502 expref: 641 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.379006:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc48bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65502 expref: 641 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.379013:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.379016:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.379018:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94900, rc 0) 00000100:00100000:3.0:1716999787.379118:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+641:11419:x1800404480671104:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 367us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.379123:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45317 00000100:00100000:1.0:1716999787.379677:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013502a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483008384:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999787.379694:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654fb expref: 88 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.379704:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130480, rc 0) 00000100:00100000:1.0:1716999787.379735:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+88:11420:x1800404480671040:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2337us (2517us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.379740:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9942 00000100:00100000:0.0:1716999787.379779:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.380084:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480671168 00000100:00100000:1.0:1716999787.380088:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480671168 00010000:00010000:1.0:1716999787.380102:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc489a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ed expref: 88 pid: 17864 timeout: 406 lvb_type: 1 00000100:00100000:1.0:1716999787.380129:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4507 00000100:00100000:1.0:1716999787.380134:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+88:1959:x1800404480671168:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999787.380141:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999787.380157:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc489a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ed expref: 88 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999787.380166:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc489a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ed expref: 88 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999787.380179:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc489a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654ed expref: 88 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999787.380190:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.380192:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.380196:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654fb expref: 87 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.380203:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654fb expref: 87 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.380221:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654fb expref: 87 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999787.380231:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013502a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483008448:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999787.380254:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.380828:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.381087:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480671232 00000100:00100000:2.0:1716999787.381091:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480671232 00000100:00100000:3.0:1716999787.381340:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9031 00000100:00100000:3.0:1716999787.381345:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+641:11419:x1800404480671232:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999787.382150:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013502a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483008448:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999787.382161:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999787.382180:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+87:1959:x1800404480671168:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2046us (2401us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.382188:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4507 00000100:00100000:2.0:1716999787.383005:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.383122:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480671360 00000100:00100000:0.0:1716999787.383127:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480671360 00000100:00100000:0.0:1716999787.383157:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9032 00000100:00100000:0.0:1716999787.383163:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+643:11420:x1800404480671360:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999787.383486:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11395, 168 off2038072 00000001:00080000:0.0:1716999787.383491:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985911 00000100:00100000:0.0:1716999787.383565:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+644:11420:x1800404480671360:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 401us (637us total) trans 4294985912 rc 0/0 00000100:00100000:0.0:1716999787.383572:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9032 00000020:00080000:0.0:1716999787.383575:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999787.384230:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+643:11419:x1800404480671232:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2883us (3410us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.384237:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9031 00000100:00100000:2.0:1716999787.385776:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.386010:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480671424 00000100:00100000:3.0:1716999787.386016:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480671424 00000100:00100000:3.0:1716999787.386055:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45318 00000100:00100000:3.0:1716999787.386062:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+643:11420:x1800404480671424:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.386074:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.386089:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc48c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65509 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.386128:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc48cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386139:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc48cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386147:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc48cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386158:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc48d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386163:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc48d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386167:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc48d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386215:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc48cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386221:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc48cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386226:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc48cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386230:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.386233:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc48cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386237:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc48cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386246:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.386248:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.386251:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc48cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386255:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc48cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386267:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc48d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386271:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc48d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386275:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc48d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386278:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.386280:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc48d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386284:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc48d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386289:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x53504954 (ffff8800939ba700) 00010000:00010000:3.0:1716999787.386290:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.386292:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc48d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386295:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc48d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.386325:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc48c4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65509 expref: 644 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.386332:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc48c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65509 expref: 644 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.386338:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97a80, rc 0) 00000100:00100000:3.0:1716999787.386364:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+643:11420:x1800404480671424:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 303us (591us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.386369:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45318 00000100:00100000:0.0:1716999787.389634:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.389680:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.389740:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480671552 00000100:00100000:1.0:1716999787.389747:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480671552 00000100:00100000:1.0:1716999787.389777:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9943 00000100:00100000:1.0:1716999787.389783:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+82:11419:x1800404480671552:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.389795:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.389808:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65517 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999787.389813:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480671488 00000100:00100000:3.0:1716999787.389829:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480671488 00010000:00010000:1.0:1716999787.389842:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4893 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654e6 expref: 83 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999787.389853:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.389854:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.389857:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65517 expref: 83 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999787.389859:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45319 00000100:00100000:3.0:1716999787.389864:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+643:11420:x1800404480671488:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.389875:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.389897:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654e6 expref: 83 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.389905:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc48e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65510 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.389908:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4893 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654e6 expref: 83 pid: 17864 timeout: 406 lvb_type: 1 00000100:00100000:1.0:1716999787.389920:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013502a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483008512:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999787.389923:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc48e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65510 expref: 644 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.389933:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc48e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65510 expref: 644 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.389939:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.389941:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.389944:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96f40, rc 0) 00000100:00100000:3.0:1716999787.389983:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+644:11420:x1800404480671488:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 117us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.389989:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45319 00000100:00100000:0.0:1716999787.390160:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.391962:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013502a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483008512:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999787.391972:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999787.391981:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65517 expref: 83 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.391992:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131680, rc 0) 00000100:00100000:0.0:1716999787.392017:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+83:11419:x1800404480671552:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2234us (2337us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.392024:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9943 00000100:00100000:1.0:1716999787.392342:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480671616 00000100:00100000:1.0:1716999787.392347:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480671616 00010000:00010000:1.0:1716999787.392364:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4893 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654e6 expref: 83 pid: 17864 timeout: 406 lvb_type: 1 00000100:00100000:1.0:1716999787.392390:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4508 00000100:00100000:1.0:1716999787.392394:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+83:1958:x1800404480671616:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999787.392403:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999787.392418:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4893 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654e6 expref: 83 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999787.392427:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4893 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654e6 expref: 83 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999787.392445:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4893 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654e6 expref: 83 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:1.0:1716999787.392456:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.392457:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.392462:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65517 expref: 82 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.392469:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65517 expref: 82 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.392490:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65517 expref: 82 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999787.392500:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013502ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483008576:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999787.392834:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930efe40 going to sleep for 11 seconds 00000100:00100000:3.0:1716999787.392875:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.392958:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480671680 00000100:00100000:0.0:1716999787.394457:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480671680 00000100:00100000:0.0:1716999787.394492:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9033 00000100:00100000:0.0:1716999787.394498:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+644:11420:x1800404480671680:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999787.394899:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013502ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483008576:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999787.394914:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999787.394950:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+82:1958:x1800404480671616:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2555us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.394957:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4508 00000100:00100000:2.0:1716999787.396544:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.396946:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480671808 00000100:00100000:1.0:1716999787.396952:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480671808 00000100:00100000:1.0:1716999787.396979:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9034 00000100:00100000:1.0:1716999787.396984:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+645:11419:x1800404480671808:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999787.397099:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+645:11420:x1800404480671680:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2600us (4223us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.397106:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9033 00000040:00080000:0.0:1716999787.398594:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11396, 168 off2038240 00000001:00080000:0.0:1716999787.398601:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985913 00000100:00100000:0.0:1716999787.398698:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+646:11419:x1800404480671808:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1711us (2155us total) trans 4294985914 rc 0/0 00000100:00100000:0.0:1716999787.398704:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9034 00000020:00080000:0.0:1716999787.398708:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999787.404387:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.404449:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480671872 00000100:00100000:3.0:1716999787.404455:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480671872 00000100:00100000:3.0:1716999787.404495:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45320 00000100:00100000:3.0:1716999787.404501:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+646:11420:x1800404480671872:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.404518:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.404534:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6551e expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.404575:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404586:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404595:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404604:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc48f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404609:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc48f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404614:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc48f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404668:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404673:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404679:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404684:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.404687:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404693:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404701:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.404703:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.404706:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404710:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc48ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404721:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc48f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404725:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc48f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404729:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc48f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404732:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.404735:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc48f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404739:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc48f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404743:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff8800939ba800) 00010000:00010000:3.0:1716999787.404745:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.404747:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc48f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404751:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc48f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.404779:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48e7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6551e expref: 647 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.404786:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc48e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6551e expref: 647 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.404793:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c961c0, rc 0) 00000100:00100000:3.0:1716999787.404840:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+646:11420:x1800404480671872:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 339us (460us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.404846:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45320 00000100:00100000:3.0:1716999787.406050:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.406103:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480672000 00000100:00100000:0.0:1716999787.406108:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480672000 00000100:00100000:0.0:1716999787.406127:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45321 00000100:00100000:0.0:1716999787.406132:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+646:11419:x1800404480672000:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.406143:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.406153:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc48fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65525 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.406202:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4903 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.406211:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4903 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc34:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.406221:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4903 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc34:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:0.0:1716999787.406228:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc34:0x0]: returning size 12006 00010000:00010000:0.0:1716999787.406314:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc48fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65525 expref: 649 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.406625:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4903 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc34:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65525 expref: 648 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.406632:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:0.0:1716999787.406634:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1716999787.406637:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde640, rc 0) 00000100:00100000:0.0:1716999787.406726:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+648:11419:x1800404480672000:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 593us (677us total) trans 4294985915 rc 0/0 00000100:00100000:0.0:1716999787.406732:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45321 00000100:00100000:3.0:1716999787.409377:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.409405:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.409459:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480672128 00000100:00100000:0.0:1716999787.409465:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480672128 00000100:00100000:0.0:1716999787.409669:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480672256 00000100:00100000:0.0:1716999787.409672:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480672256 00000100:00100000:0.0:1716999787.409688:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45322 00000100:00100000:0.0:1716999787.409693:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+649:11420:x1800404480672128:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.409708:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.409710:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1716999787.409727:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc48e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65510 expref: 649 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.409740:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.409744:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.409753:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc4911 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6552c expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.409854:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4918 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.409864:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4918 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.409871:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4918 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.409895:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc491f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.409901:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc491f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.409906:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc491f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:0.0:1716999787.410263:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5ff:0x0], index 0: 0 00000040:00080000:0.0:1716999787.410318:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11397, 176 off2038416 00010000:00010000:0.0:1716999787.410399:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc4926 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.410405:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc4926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.410411:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc4926 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.410432:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4918 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.410438:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4918 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.410443:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4918 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.410448:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.410450:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4918 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.410456:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4918 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.410462:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.410465:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.410467:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4918 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.410471:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc4918 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999787.410479:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df0380 reply state ffff88012b156000 transno 4294985916 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc491f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.410484:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999787.410499:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc4911 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6552c expref: 651 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.410508:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc4926 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6552c expref: 650 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.410514:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc36:0x0].0x0 (ffff88009330dd00) 00010000:00010000:0.0:1716999787.410516:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.410518:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:0.0:1716999787.410554:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+651:11420:x1800404480672128:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 860us (1182us total) trans 4294985916 rc 0/0 00000100:00100000:0.0:1716999787.410560:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45322 00000100:00100000:0.0:1716999787.410575:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45323 00000100:00100000:0.0:1716999787.410579:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+650:11419:x1800404480672256:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.410596:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999787.410604:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc4877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654df expref: 650 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.410612:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:0.0:1716999787.410614:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.410641:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4934 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.410647:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.410652:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999787.410773:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df1c00 reply state ffff88012b157000 transno 4294985917 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.410778:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.410804:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+651:11419:x1800404480672256:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 224us (1398us total) trans 4294985917 rc 0/0 00000100:00100000:0.0:1716999787.410809:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45323 00010000:00010000:0.0:1716999787.412239:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc491f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.412248:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc491f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.412252:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc491f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.412256:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcfc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.412258:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc491f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.412263:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc491f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.412270:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff88009330de00) 00010000:00010000:0.0:1716999787.412272:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.412275:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc491f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.412279:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc491f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999787.413515:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999787.413628:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4934 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.413635:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4934 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.413640:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4934 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.413643:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.413645:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4934 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.413649:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4934 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.413657:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:1.0:1716999787.413659:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.413661:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4934 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.413665:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4934 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999787.413877:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480672320 00000100:00100000:2.0:1716999787.413912:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480672320 00000100:00100000:2.0:1716999787.414232:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45324 00000100:00100000:2.0:1716999787.414238:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+649:11419:x1800404480672320:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.414255:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.414266:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc493b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65533 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999787.414276:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999787.414307:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc493b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65533 expref: 650 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.414315:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc493b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65533 expref: 650 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.414327:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:2.0:1716999787.414330:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1716999787.414332:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea640, rc 0) 00000100:00100000:1.0:1716999787.414337:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480672384 00000100:00100000:1.0:1716999787.414340:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480672384 00000100:00100000:2.0:1716999787.414369:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+650:11419:x1800404480672320:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 131us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.414370:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9944 00000100:00100000:1.0:1716999787.414374:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+82:1959:x1800404480672384:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:2.0:1716999787.414375:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45324 00010000:00010000:1.0:1716999787.414381:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.414392:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4942 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6553a expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1716999787.414454:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x5ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1716999787.414467:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.414469:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.414473:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4942 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6553a expref: 83 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999787.414482:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4942 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6553a expref: 83 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999787.414489:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130d80, rc 0) 00000100:00100000:1.0:1716999787.414502:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+83:1959:x1800404480672384:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 128us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.414507:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9944 00000100:00100000:3.0:1716999787.416562:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.416639:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.416908:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480672576 00000100:00100000:1.0:1716999787.416914:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480672576 00000100:00100000:1.0:1716999787.416954:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9035 00000100:00100000:1.0:1716999787.416960:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+650:11420:x1800404480672576:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999787.416977:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480672448 00000100:00100000:0.0:1716999787.416982:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480672448 00000100:00100000:0.0:1716999787.417001:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9945 00000100:00100000:0.0:1716999787.417006:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+83:1958:x1800404480672448:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999787.417152:0:15837:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999787.417155:0:15837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb mtime from disk: 0 -> 1716999775 00002000:00010000:0.0:1716999787.417157:0:15837:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb atime from disk: 0 -> 1716999777 00002000:00010000:0.0:1716999787.417158:0:15837:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb ctime from disk: 0 -> 1716999787 00002000:00010000:0.0:1716999787.417160:0:15837:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1716999787.417190:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+84:1958:x1800404480672448:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 183us (632us total) trans 4294970129 rc 0/0 00000100:00100000:0.0:1716999787.417196:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9945 00000040:00080000:1.0:1716999787.417289:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11398, 168 off2038584 00000001:00080000:1.0:1716999787.417294:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985918 00000100:00100000:1.0:1716999787.417365:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+652:11420:x1800404480672576:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 400us (722us total) trans 4294985919 rc 0/0 00000100:00100000:1.0:1716999787.417372:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9035 00000020:00080000:1.0:1716999787.417375:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999787.420835:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.421146:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480672704 00000100:00100000:2.0:1716999787.421153:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480672704 00000100:00100000:2.0:1716999787.421195:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45325 00000100:00100000:2.0:1716999787.421201:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+652:11420:x1800404480672704:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999787.421239:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999787.421257:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc4926 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6552c expref: 652 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.421283:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc36:0x0].0x0 (ffff88009330dd00) 00010000:00010000:2.0:1716999787.421290:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.421311:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4949 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.421321:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4949 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999787.421345:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999787.421454:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4949 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.421461:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480672768 00000100:00100000:1.0:1716999787.421464:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480672768 00010000:00010000:2.0:1716999787.421466:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4950 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.421471:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4950 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.421476:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4950 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.421484:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45326 00000100:00100000:1.0:1716999787.421489:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+652:11419:x1800404480672768:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.421496:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.421504:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4957 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65541 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.421531:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc495e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.421537:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc495e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.421542:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc495e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.421550:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4965 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.421555:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4965 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.421559:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4965 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:1.0:1716999787.421561:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc34:0x0]: returning size 12006 00000004:00200000:1.0:1716999787.421564:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.421574:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc495e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.421593:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4957 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65541 expref: 654 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.421603:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc495e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65541 expref: 653 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.421608:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:1.0:1716999787.421611:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1716999787.421612:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133840, rc 0) 00000100:00100000:1.0:1716999787.421654:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+653:11419:x1800404480672768:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 164us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.421659:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45326 00000040:00080000:2.0:1716999787.421978:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1476, 64 off102720 00000040:00080000:2.0:1716999787.421997:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11399, 176 off2038760 00010000:00010000:2.0:1716999787.422045:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc496c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422051:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc496c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422057:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc496c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422062:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc496c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422070:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc496c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422075:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc496c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422080:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc496c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422084:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea1c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999787.422087:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc496c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422092:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc496c lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422099:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc36:0x0].0x0 (ffff880134241e00) 00010000:00010000:2.0:1716999787.422101:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999787.422103:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc496c lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422107:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc496c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc36:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422120:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4965 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422124:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4965 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422128:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4965 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422132:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.422134:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4965 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422138:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4965 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422143:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc36:0x0].0x0 (ffff880134241e00) 00010000:00010000:2.0:1716999787.422145:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999787.422146:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4965 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422150:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4965 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422182:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4949 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422186:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4949 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422190:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4949 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422194:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.422196:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4949 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422200:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4949 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422205:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.422207:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.422209:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4949 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.422216:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4949 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999787.422221:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df1f80 reply state ffff88012d291000 transno 4294985920 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4950 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.422226:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999787.422267:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480672704:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1066us (1451us total) trans 4294985920 rc 0/0 00000100:00100000:2.0:1716999787.422272:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45325 00010000:00010000:0.0:1716999787.423494:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4950 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423502:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4950 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423507:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4950 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423511:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaf40 already unused, calling callback (ffffffffa1389790) 00000100:00100000:2.0:1716999787.423513:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999787.423514:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4950 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423519:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4950 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423527:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff880134241300) 00010000:00010000:0.0:1716999787.423529:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.423532:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4950 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423536:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4950 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.423559:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.423575:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480672896 00000100:00100000:2.0:1716999787.423577:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480672832 00000100:00100000:2.0:1716999787.423579:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480672832 00000100:00100000:0.0:1716999787.423579:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480672896 00000100:00100000:2.0:1716999787.423608:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45327 00000100:00100000:0.0:1716999787.423612:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45328 00000100:00100000:2.0:1716999787.423616:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+654:11419:x1800404480672832:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:0.0:1716999787.423616:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480672896:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.423636:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.423645:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4973 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6554f expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.423680:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc497a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423687:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc497a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423693:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc497a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423701:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc4981 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423706:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc4981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423711:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc4981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423746:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc497a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423757:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc497a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423762:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc497a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423766:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.423768:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc497a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423773:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc497a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423783:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.423785:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.423787:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc497a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423791:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc497a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423798:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc4981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423802:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc4981 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423806:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc4981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423810:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.423812:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc4981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423830:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc4981 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423837:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff88009330de00) 00010000:00010000:0.0:1716999787.423839:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.423841:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc4981 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423845:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc4981 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.423873:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4973 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6554f expref: 655 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.423876:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.423899:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4988 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65548 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.423903:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc4973 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6554f expref: 655 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.423910:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdef40, rc 0) 00010000:00010000:2.0:1716999787.423921:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc498f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.423927:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc498f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.423932:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc498f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999787.423935:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+655:11420:x1800404480672896:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 319us (423us total) trans 0 rc 301/301 00010000:00010000:2.0:1716999787.423940:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999787.423941:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45328 00010000:00010000:2.0:1716999787.423945:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.423949:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424004:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc499d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424011:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc499d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424016:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc499d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:2.0:1716999787.424032:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc34:0x0]: returning size 12006 00000004:00200000:2.0:1716999787.424035:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999787.424042:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc499d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424049:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc499d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424054:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc498f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424058:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc498f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424062:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc498f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424066:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.424068:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc498f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424073:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc498f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424080:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.424081:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.424084:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc498f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424087:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc498f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424093:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424097:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4996 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424100:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424104:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.424105:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424109:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4996 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424114:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xa8353d69 (ffff880134241200) 00010000:00010000:2.0:1716999787.424116:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.424117:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4996 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424121:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4996 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.424138:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4988 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65548 expref: 655 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.424145:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc499d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65548 expref: 654 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.424149:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:2.0:1716999787.424151:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999787.424152:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb600, rc 0) 00000100:00100000:2.0:1716999787.424167:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+654:11419:x1800404480672832:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 554us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.424172:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45327 00000100:00100000:3.0:1716999787.426486:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.426672:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480672960 00000100:00100000:2.0:1716999787.426679:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480672960 00000100:00100000:3.0:1716999787.426807:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.427156:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673088 00000100:00100000:2.0:1716999787.427160:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673088 00000100:00100000:0.0:1716999787.427197:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45329 00000100:00100000:0.0:1716999787.427204:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+655:11420:x1800404480672960:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.427219:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.427233:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc49a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65556 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.427256:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc49a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65556 expref: 656 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.427270:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc49a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65556 expref: 656 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.427277:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.427279:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.427282:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bddb00, rc 0) 00000100:00100000:1.0:1716999787.427302:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45330 00000100:00100000:1.0:1716999787.427307:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+656:11419:x1800404480673088:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.427337:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999787.427349:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc499d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65548 expref: 656 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.427363:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc495e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65541 expref: 655 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.427371:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:1.0:1716999787.427374:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.427398:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc49ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.427405:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc49ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.427411:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc49ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.427430:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480672960:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 225us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.427435:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45329 00000004:00010000:1.0:1716999787.427649:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df2680 reply state ffff88009380d000 transno 4294985921 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc49ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.427655:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999787.427908:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+655:11419:x1800404480673088:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 599us (1100us total) trans 4294985921 rc 0/0 00000100:00100000:1.0:1716999787.427914:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45330 00000100:00100000:3.0:1716999787.431351:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.431407:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673152 00000100:00100000:1.0:1716999787.431413:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673152 00000100:00100000:1.0:1716999787.431457:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9036 00000100:00100000:3.0:1716999787.431458:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.431463:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+655:11420:x1800404480673152:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:0.0:1716999787.431515:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc49ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.431523:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc49ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.431529:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc49ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.431533:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.431536:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc49ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.431542:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc49ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.431553:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:0.0:1716999787.431556:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.431559:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc49ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.431564:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc49ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.432696:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673216 00000100:00100000:0.0:1716999787.432702:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673216 00000100:00100000:0.0:1716999787.432737:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9946 00000100:00100000:0.0:1716999787.432743:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+84:1959:x1800404480673216:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999787.432902:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999787.432905:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb mtime from disk: 1716999775 -> 1716999763 00002000:00010000:0.0:1716999787.432908:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb atime from disk: 1716999777 -> 1716999767 00002000:00010000:0.0:1716999787.432910:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb ctime from disk: 1716999787 -> 1716999787 00002000:00010000:0.0:1716999787.432911:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1716999787.432958:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+85:1959:x1800404480673216:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 214us (1499us total) trans 4294970130 rc 0/0 00000100:00100000:0.0:1716999787.432964:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9946 00000100:00100000:3.0:1716999787.434965:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.435039:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673280 00000100:00100000:1.0:1716999787.435049:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673280 00000100:00100000:1.0:1716999787.435074:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45331 00000100:00100000:1.0:1716999787.435079:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+656:11419:x1800404480673280:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.435097:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.435110:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc49b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6555d expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.435149:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc49b9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435159:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc49b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435167:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc49b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435177:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc49c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435182:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc49c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435187:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc49c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435256:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc49c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435263:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc49c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435268:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc49c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:1.0:1716999787.435289:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc34:0x0]: returning size 12006 00000004:00200000:1.0:1716999787.435292:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.435303:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc49c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435310:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc49c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435315:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc49b9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435319:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc49b9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435325:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc49b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435329:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.435332:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc49b9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435338:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc49b9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435346:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.435348:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.435351:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc49b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435356:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc49b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435366:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc49c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435371:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc49c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435375:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc49c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435379:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.435381:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc49c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435385:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc49c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435390:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xa8353d69 (ffff88009240e500) 00010000:00010000:1.0:1716999787.435392:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.435394:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc49c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435398:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc49c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.435416:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc49b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6555d expref: 658 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.435424:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc49c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6555d expref: 657 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.435429:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:1.0:1716999787.435431:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.435433:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131440, rc 0) 00000100:00100000:1.0:1716999787.435472:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+657:11419:x1800404480673280:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 392us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.435479:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45331 00000100:00100000:0.0:1716999787.436591:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+655:11420:x1800404480673152:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5125us (5243us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.436598:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9036 00000100:00100000:2.0:1716999787.438938:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.438988:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673408 00000100:00100000:0.0:1716999787.438994:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673408 00000100:00100000:0.0:1716999787.439030:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45332 00000100:00100000:0.0:1716999787.439036:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+655:11420:x1800404480673408:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.439054:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.439070:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc49ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65564 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.439110:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc49d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439120:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc49d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439128:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc49d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439138:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc49dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439144:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc49dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439149:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc49dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439195:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc49d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439201:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc49d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439206:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc49d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439210:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.439213:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc49d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439218:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc49d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439226:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.439228:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.439231:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc49d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439235:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc49d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439244:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc49dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439248:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc49dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439252:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc49dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439256:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcfc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.439258:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc49dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439262:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc49dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439267:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff88009330dd00) 00010000:00010000:0.0:1716999787.439269:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.439270:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc49dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439274:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc49dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.439305:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc49ce lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65564 expref: 656 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.439313:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc49ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65564 expref: 656 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.439320:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf600, rc 0) 00000100:00100000:0.0:1716999787.439625:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+655:11420:x1800404480673408:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 588us (689us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.439631:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45332 00000100:00100000:3.0:1716999787.440420:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.440597:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673344 00000100:00100000:0.0:1716999787.440602:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673344 00000100:00100000:0.0:1716999787.440632:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45333 00000100:00100000:0.0:1716999787.440637:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+655:11419:x1800404480673344:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.440646:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.440909:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc49e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6556b expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.440947:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc49ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.440956:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc49ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.440962:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc49ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.440970:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc49f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.440975:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc49f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.440980:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc49f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441020:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc49ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441025:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc49ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441029:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc49ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441033:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdfcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.441035:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc49ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441040:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc49ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441047:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.441049:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.441051:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc49ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441055:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc49ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441062:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc49f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441066:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc49f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441070:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc49f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441073:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.441075:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc49f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441078:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc49f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441083:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff88009330d300) 00010000:00010000:0.0:1716999787.441084:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.441086:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc49f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441090:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc49f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.441115:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc49e3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6556b expref: 656 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.441121:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc49e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6556b expref: 656 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.441128:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde1c0, rc 0) 00000100:00100000:0.0:1716999787.441151:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+655:11419:x1800404480673344:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 513us (732us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.441157:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45333 00000100:00100000:3.0:1716999787.443963:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.443996:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.444912:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673472 00000100:00100000:2.0:1716999787.444919:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673472 00000100:00100000:2.0:1716999787.444946:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673536 00000100:00100000:2.0:1716999787.444953:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673536 00000100:00100000:2.0:1716999787.444972:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45334 00000100:00100000:2.0:1716999787.444982:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+656:11420:x1800404480673472:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.444997:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.445012:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc49f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65572 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.445051:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc49ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445062:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc49ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445069:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc49ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445079:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4a06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445084:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445089:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445140:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc49ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445145:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc49ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445150:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc49ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445155:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.445157:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc49ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445162:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc49ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445171:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.445174:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.445177:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc49ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445181:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc49ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999787.445234:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45335 00000100:00100000:0.0:1716999787.445239:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+657:11419:x1800404480673536:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.445246:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.445253:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4a0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65579 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.445275:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4a14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445282:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4a14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445287:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4a14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445297:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4a1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445301:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445306:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445337:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4a14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445342:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4a14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445346:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4a14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445350:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.445353:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4a14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445357:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4a14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445363:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.445365:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.445367:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4a14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445371:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc4a14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445379:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445384:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4a1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445388:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4a1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445392:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.445394:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4a1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445398:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4a1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445404:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff88009330d900) 00010000:00010000:0.0:1716999787.445406:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.445408:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4a1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445412:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4a1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.445440:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4a0d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65579 expref: 658 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.445447:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc4a0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65579 expref: 658 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.445454:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bded00, rc 0) 00000100:00100000:0.0:1716999787.445506:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+657:11419:x1800404480673536:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 266us (1509us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.445512:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45335 00010000:00010000:2.0:1716999787.445554:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445560:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4a06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445564:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445568:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.445570:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445574:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4a06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445581:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xa8353d69 (ffff880134241200) 00010000:00010000:2.0:1716999787.445583:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.445585:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4a06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445595:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4a06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.445629:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc49f8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65572 expref: 656 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.445636:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc49f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65572 expref: 656 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.445643:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ead00, rc 0) 00000100:00100000:2.0:1716999787.445664:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+655:11420:x1800404480673472:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 682us (1707us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.445669:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45334 00000100:00100000:3.0:1716999787.448101:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.448138:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673600 00000100:00100000:3.0:1716999787.448141:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.448145:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673600 00000100:00100000:0.0:1716999787.448169:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45336 00000100:00100000:0.0:1716999787.448173:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+655:11420:x1800404480673600:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.448185:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.448194:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4a22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65580 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.448224:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4a29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448232:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4a29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448239:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4a29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448249:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4a30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448254:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448259:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448301:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4a29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448306:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4a29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448310:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4a29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448315:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fa80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.448317:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4a29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448322:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4a29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448330:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.448332:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.448335:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4a29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448339:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4a29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448347:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448351:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4a30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448355:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4a30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448359:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.448361:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4a30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448365:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4a30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448371:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xa8353d69 (ffff88009330da00) 00010000:00010000:0.0:1716999787.448373:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.448375:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4a30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448379:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4a30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.448407:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4a22 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65580 expref: 656 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.448413:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4a22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65580 expref: 656 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.448419:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f3c0, rc 0) 00000100:00100000:0.0:1716999787.448458:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+655:11420:x1800404480673600:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 283us (361us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.448465:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45336 00000100:00100000:2.0:1716999787.448803:0:6836:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673728 00000100:00100000:2.0:1716999787.448808:0:6836:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673728 00000100:00100000:2.0:1716999787.448845:0:6836:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 608 00000100:00100000:2.0:1716999787.448849:0:6836:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+655:11419:x1800404480673728:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999787.448869:0:6836:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999787.448902:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc49c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6555d expref: 655 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.448911:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:2.0:1716999787.448919:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc48bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65502 expref: 654 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.448926:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.448928:0:6836:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.448960:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4a37 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.448967:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4a37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.448973:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4a37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.448981:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4a3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.448986:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.448990:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.449003:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4a45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.449008:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4a45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.449013:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4a45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.449082:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4a4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.449089:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4a4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.449094:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4a4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000040:00080000:2.0:1716999787.449408:0:6836:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11400, 224 off2038984 00000004:00010000:2.0:1716999787.449496:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131d5f800 reply state ffff880093a40000 transno 4294985922 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4a4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.449502:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999787.449504:0:6836:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4a37 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.449509:0:6836:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4a37 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.449517:0:6836:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4a37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.449521:0:6836:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.449523:0:6836:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4a37 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.449528:0:6836:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4a37 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.449534:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.449536:0:6836:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.449542:0:6836:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4a37 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.449546:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4a37 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000004:00010000:2.0:1716999787.449553:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131d5f800 reply state ffff880093a40000 transno 4294985922 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.449558:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00010000:2.0:1716999787.449559:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131d5f800 reply state ffff880093a40000 transno 4294985922 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4a45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.449563:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1716999787.449591:0:6836:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+655:11419:x1800404480673728:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 741us (1449us total) trans 4294985922 rc 0/0 00000100:00100000:2.0:1716999787.449597:0:6836:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 608 00010000:00010000:0.0:1716999787.451461:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4a45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451470:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4a45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451475:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4a45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451479:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.451481:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4a45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451487:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4a45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451496:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xa8353d69 (ffff880134241e00) 00010000:00010000:0.0:1716999787.451498:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.451501:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4a45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451508:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4a45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451519:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4a3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451524:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4a3e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451529:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4a3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451532:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.451535:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4a3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451540:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4a3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451546:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff880134241d00) 00010000:00010000:0.0:1716999787.451547:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.451549:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4a3e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451553:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4a3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451561:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4a4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451565:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4a4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451573:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4a4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451576:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.451578:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4a4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451582:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4a4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451588:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:0.0:1716999787.451589:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1716999787.451591:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4a4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.451595:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4a4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000100:00100000:3.0:1716999787.453387:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.453445:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.453513:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673856 00000100:00100000:0.0:1716999787.453520:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673856 00000100:00100000:0.0:1716999787.453546:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673920 00000100:00100000:0.0:1716999787.453548:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673920 00000100:00100000:0.0:1716999787.453574:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45337 00000100:00100000:0.0:1716999787.453580:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+655:11420:x1800404480673856:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.453600:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.453602:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1716999787.453620:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc49a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65556 expref: 655 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999787.453625:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45338 00000100:00100000:2.0:1716999787.453630:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+654:11419:x1800404480673920:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.453632:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.453635:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.453639:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.453645:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4a53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65587 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.453646:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4a5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6558e expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.453679:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4a61 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453687:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4a61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453694:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4a61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453702:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4a68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453706:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453711:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.453725:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4a6f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.453731:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4a6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.453736:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4a6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.453743:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4a76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.453747:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4a76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.453751:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4a76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.453764:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4a7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453769:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453774:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:2.0:1716999787.453792:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc34:0x0]: returning size 12006 00000004:00200000:2.0:1716999787.453794:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999787.453805:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453811:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4a7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453828:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4a61 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453834:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4a61 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453838:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4a61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453842:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.453844:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4a61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453849:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4a61 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453855:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.453857:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.453859:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4a61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453862:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4a61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453869:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4a68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453873:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4a68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453877:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453900:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.453903:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4a68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453907:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4a68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453912:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff880134241200) 00010000:00010000:2.0:1716999787.453914:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.453916:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4a68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453919:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4a68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.453938:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8240/0x6d188eabd8dc4a5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6558e expref: 657 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.453946:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4a7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6558e expref: 656 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.453951:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:2.0:1716999787.453952:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999787.453954:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb600, rc 0) 00000100:00100000:2.0:1716999787.453986:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+656:11419:x1800404480673920:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 356us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.453992:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45338 00000004:00080000:0.0:1716999787.454761:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x600:0x0], index 1: 0 00000040:00080000:0.0:1716999787.454833:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11401, 184 off2039168 00010000:00010000:0.0:1716999787.454945:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4a84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.454953:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.454960:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.454981:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4a6f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.454986:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4a6f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.454990:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4a6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.454994:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.454996:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4a6f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.455001:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4a6f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.455011:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.455013:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.455016:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4a6f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.455020:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4a6f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999787.455028:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131d5e680 reply state ffff88012e817000 transno 4294985923 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4a76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.455033:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999787.455050:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4a53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65587 expref: 657 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.455060:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65587 expref: 656 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.455065:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:0.0:1716999787.455067:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.455069:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f840, rc 0) 00000100:00100000:0.0:1716999787.455094:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+657:11420:x1800404480673856:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1514us (1711us total) trans 4294985923 rc 0/0 00000100:00100000:0.0:1716999787.455100:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45337 00010000:00010000:0.0:1716999787.457351:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4a76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.457361:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4a76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.457366:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4a76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.457371:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.457374:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4a76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.457380:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4a76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.457390:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xa8353d69 (ffff8800b4877e00) 00010000:00010000:0.0:1716999787.457393:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.457396:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4a76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.457400:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4a76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999787.460874:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.460977:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.461792:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480674112 00000100:00100000:1.0:1716999787.461799:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480674112 00000100:00100000:1.0:1716999787.461839:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45339 00000100:00100000:1.0:1716999787.461846:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+656:11419:x1800404480674112:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.461863:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.461897:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4a92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6559c expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.461963:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4a99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.461973:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc32:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.461981:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4a99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc32:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:1.0:1716999787.461988:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc32:0x0]: returning size 53 00010000:00010000:1.0:1716999787.462085:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4a92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6559c expref: 659 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.462102:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4a99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc32:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6559c expref: 658 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.462108:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc32:0x0].0x0 (ffff88009240e200) 00010000:00010000:1.0:1716999787.462110:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1716999787.462112:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131b00, rc 0) 00000100:00100000:2.0:1716999787.462144:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480673984 00000100:00100000:1.0:1716999787.462144:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+658:11419:x1800404480674112:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 299us (1167us total) trans 4294985924 rc 0/0 00000100:00100000:2.0:1716999787.462147:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480673984 00000100:00100000:1.0:1716999787.462150:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45339 00000100:00100000:2.0:1716999787.462167:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9947 00000100:00100000:2.0:1716999787.462171:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+87:1959:x1800404480673984:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.462178:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.462189:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4aa7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65595 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999787.462204:0:15837:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x600:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999787.462215:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.462216:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.462222:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4aa7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65595 expref: 88 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.462231:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4aa7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65595 expref: 88 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.462238:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eaf40, rc 0) 00000100:00100000:2.0:1716999787.462266:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+88:1959:x1800404480673984:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 93us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.462271:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9947 00000100:00100000:3.0:1716999787.464974:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.465006:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.465105:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480674304 00000100:00100000:0.0:1716999787.465111:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480674304 00000100:00100000:0.0:1716999787.465137:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9037 00000100:00100000:0.0:1716999787.465143:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+658:11419:x1800404480674304:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999787.465163:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.465183:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480674368 00000100:00100000:2.0:1716999787.465185:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480674368 00000100:00100000:2.0:1716999787.465204:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 701 00000100:00100000:2.0:1716999787.465207:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+659:1958:x1800404480674368:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999787.465217:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999787.465231:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4a99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc32:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6559c expref: 659 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.465245:0:6809:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc32:0x0].0x0 (ffff88009240e200) 00010000:00010000:2.0:1716999787.465248:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999787.465272:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+658:1958:x1800404480674368:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 63us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.465277:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 701 00000100:00100000:1.0:1716999787.465709:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480674176 00000100:00100000:1.0:1716999787.465713:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480674176 00000040:00080000:0.0:1716999787.465726:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11402, 168 off2039336 00000100:00100000:0.0:1716999787.465808:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+659:11419:x1800404480674304:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 665us (800us total) trans 4294985925 rc 0/0 00000100:00100000:0.0:1716999787.465813:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9037 00000100:00100000:1.0:1716999787.466149:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45340 00000100:00100000:1.0:1716999787.466154:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+658:11420:x1800404480674176:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.466163:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.466178:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4aae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655a3 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.466211:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4ab5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466220:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466227:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466238:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4abc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466244:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466249:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466289:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4ab5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466294:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4ab5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466300:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4ab5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466304:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.466307:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4ab5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466312:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4ab5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466318:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.466321:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.466324:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4ab5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466328:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4ab5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466335:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4abc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466339:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4abc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466344:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4abc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466347:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.466349:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4abc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466353:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4abc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466359:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff88009240e800) 00010000:00010000:1.0:1716999787.466361:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.466363:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4abc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466367:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4abc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.466390:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4aae lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655a3 expref: 659 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.466396:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4aae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655a3 expref: 659 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.466402:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130240, rc 0) 00000100:00100000:1.0:1716999787.467197:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+658:11420:x1800404480674176:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1039us (2224us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.467203:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45340 00000100:00100000:2.0:1716999787.470173:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.470408:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480674496 00000100:00100000:1.0:1716999787.470415:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480674496 00000100:00100000:1.0:1716999787.470448:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45341 00000100:00100000:1.0:1716999787.470453:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+658:11419:x1800404480674496:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.470485:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999787.470500:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4655 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65430 expref: 658 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.470512:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc32:0x0].0x0 (ffff88009240e200) 00010000:00010000:1.0:1716999787.470519:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.470537:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4ac3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.470545:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.470552:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.470560:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4aca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.470564:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4aca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.470568:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4aca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.470637:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4ad1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.470641:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4ad1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.470645:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4ad1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:1.0:1716999787.471044:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1477, 64 off102784 00000040:00080000:1.0:1716999787.471063:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11403, 184 off2039520 00010000:00010000:1.0:1716999787.471115:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4ad8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471121:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471126:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4ad8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471132:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4ad8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471136:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4ad8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471140:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4ad8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471144:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4ad8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471148:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999787.471151:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4ad8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471155:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4ad8 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471161:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc32:0x0].0x0 (ffff8800941a3300) 00010000:00010000:1.0:1716999787.471163:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999787.471165:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4ad8 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471170:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4ad8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc32:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471186:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4ad1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471190:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4ad1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471193:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4ad1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471197:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.471200:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4ad1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471204:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4ad1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471209:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc32:0x0].0x0 (ffff8800941a3300) 00010000:00010000:1.0:1716999787.471211:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999787.471213:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4ad1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471217:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4ad1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc32:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471245:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4ac3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471249:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4ac3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471253:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4ac3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471257:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.471259:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4ac3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471263:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4ac3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471268:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.471270:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.471272:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4ac3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.471276:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4ac3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999787.471281:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897af480 reply state ffff88009c1e1000 transno 4294985926 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4aca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999787.471285:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999787.471328:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+659:11419:x1800404480674496:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 874us (1160us total) trans 4294985926 rc 0/0 00000100:00100000:1.0:1716999787.471334:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45341 00000100:00100000:2.0:1716999787.471508:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.471791:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480674560 00000100:00100000:0.0:1716999787.471795:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480674560 00000100:00100000:0.0:1716999787.471813:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45342 00000100:00100000:0.0:1716999787.471834:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+659:11420:x1800404480674560:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.471843:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.471853:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4adf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655aa expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.471868:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655aa expref: 660 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.471877:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655aa expref: 660 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.471896:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.471898:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.471900:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c240, rc 0) 00000100:00100000:0.0:1716999787.471919:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+660:11420:x1800404480674560:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 86us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.471924:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45342 00010000:00010000:0.0:1716999787.477561:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4aca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.477572:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4aca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.477580:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4aca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.477584:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.477588:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4aca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.477594:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4aca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.477606:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xeca88e0f (ffff88009240e500) 00010000:00010000:0.0:1716999787.477609:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.477612:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4aca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.477616:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4aca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999787.477950:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.477980:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.478034:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480674624 00000100:00100000:0.0:1716999787.478040:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480674624 00000100:00100000:0.0:1716999787.478068:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9038 00000100:00100000:0.0:1716999787.478073:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+659:11420:x1800404480674624:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999787.478424:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480674688 00000100:00100000:1.0:1716999787.478427:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480674688 00000100:00100000:1.0:1716999787.478447:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45343 00000100:00100000:1.0:1716999787.478451:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+660:11419:x1800404480674688:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.478459:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.478470:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4ae6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655b1 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.478504:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4aed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478513:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4aed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478520:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4aed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478531:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4af4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478540:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478545:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478595:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4aed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478599:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4aed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478603:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4aed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478608:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.478610:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4aed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478615:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4aed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478621:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.478624:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.478626:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4aed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478631:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4aed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478638:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.478642:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4af4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.479629:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4af4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.479633:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.479636:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4af4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.479641:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4af4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.479649:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xb9ed2257 (ffff8800941a3400) 00010000:00010000:1.0:1716999787.479652:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.479654:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4af4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.479659:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4af4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.479696:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4ae6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655b1 expref: 662 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.479704:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4ae6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655b1 expref: 662 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.479711:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130240, rc 0) 00000100:00100000:1.0:1716999787.479736:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+661:11419:x1800404480674688:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1284us (1755us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.479742:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45343 00000100:00100000:0.0:1716999787.483573:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+659:11420:x1800404480674624:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5489us (5617us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.483585:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9038 00000100:00100000:2.0:1716999787.485044:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.485074:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480674752 00000100:00100000:0.0:1716999787.485086:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480674752 00000100:00100000:0.0:1716999787.485118:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45344 00000100:00100000:0.0:1716999787.485123:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+659:11419:x1800404480674752:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.485138:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.485263:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4afb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655b8 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.485289:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4afb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655b8 expref: 660 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.485299:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4afb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655b8 expref: 660 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.485306:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.485309:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.485311:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216e1c0, rc 0) 00000100:00100000:0.0:1716999787.485351:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+660:11419:x1800404480674752:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 227us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.485356:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45344 00000100:00100000:3.0:1716999787.488985:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.489078:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.489152:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480674816 00000100:00100000:2.0:1716999787.489159:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480674816 00000100:00100000:2.0:1716999787.489191:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9948 00000100:00100000:2.0:1716999787.489197:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+88:11420:x1800404480674816:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.489212:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.489226:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655bf expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.489251:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4aa7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65595 expref: 89 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.489257:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.489259:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.489261:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655bf expref: 89 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.489288:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4aa7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65595 expref: 89 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.489298:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4aa7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65595 expref: 89 pid: 15837 timeout: 406 lvb_type: 1 00000100:00100000:2.0:1716999787.489309:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483008640:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999787.489351:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008ed62cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.489530:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480674880 00000100:00100000:0.0:1716999787.489535:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480674880 00000100:00100000:0.0:1716999787.489555:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9039 00000100:00100000:0.0:1716999787.489560:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+660:11419:x1800404480674880:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999787.492118:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.492238:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483008640:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999787.492260:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655bf expref: 89 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.492273:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8240, rc 0) 00000100:00100000:0.0:1716999787.492905:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+89:11420:x1800404480674816:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 3706us (3924us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.492912:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9948 00000100:00100000:2.0:1716999787.493011:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480674944 00000100:00100000:2.0:1716999787.493018:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480674944 00010000:00010000:2.0:1716999787.493035:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4aa7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65595 expref: 89 pid: 15837 timeout: 406 lvb_type: 1 00000100:00100000:2.0:1716999787.493053:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4509 00000100:00100000:2.0:1716999787.493058:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+89:1958:x1800404480674944:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999787.493068:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999787.493082:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4aa7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65595 expref: 89 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:2.0:1716999787.493091:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4aa7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65595 expref: 89 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:2.0:1716999787.493106:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4aa7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65595 expref: 89 pid: 15837 timeout: 406 lvb_type: 1 00010000:00010000:2.0:1716999787.493122:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.493124:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.493129:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655bf expref: 88 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.493136:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655bf expref: 88 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.493157:0:6808:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655bf expref: 88 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999787.493168:0:6808:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6808:1800404483008704:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999787.493594:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+660:11419:x1800404480674880:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4032us (4514us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.493604:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9039 00000100:00100000:2.0:1716999787.494076:0:6808:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008ed62cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.497172:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.497240:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480675008 00000100:00100000:1.0:1716999787.497247:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480675008 00000100:00100000:1.0:1716999787.497277:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45345 00000100:00100000:1.0:1716999787.497283:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+660:11419:x1800404480675008:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.497298:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.497312:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4b09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655c6 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.497353:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4b10 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497363:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4b10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497371:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4b10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497380:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4b17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497385:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4b17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497390:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4b17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497442:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4b10 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497447:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4b10 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497453:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4b10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497457:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.497460:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4b10 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497466:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4b10 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497474:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.497476:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.497479:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4b10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497483:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4b10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497494:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4b17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497498:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4b17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497503:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4b17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497506:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.497508:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4b17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497512:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4b17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497517:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xb9ed2257 (ffff88009240e200) 00010000:00010000:1.0:1716999787.497519:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.497521:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4b17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497524:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4b17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.497552:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4b09 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655c6 expref: 661 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.497558:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4b09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655c6 expref: 661 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.497564:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c1318c0, rc 0) 00000100:00100000:1.0:1716999787.497593:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+660:11419:x1800404480675008:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 310us (427us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.497598:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45345 00000100:00100000:2.0:1716999787.497856:0:6808:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897adc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6808:1800404483008704:192.168.203.3@tcp:105: 00010000:00010000:2.0:1716999787.497870:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999787.498501:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+88:1958:x1800404480674944:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 5440us (6385us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.498507:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4509 00000100:00100000:0.0:1716999787.498594:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.499002:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480675136 00000100:00100000:1.0:1716999787.499007:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480675136 00000100:00100000:1.0:1716999787.499025:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9040 00000100:00100000:1.0:1716999787.499030:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+660:11420:x1800404480675136:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:1.0:1716999787.499395:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985927 00000040:00080000:1.0:1716999787.499773:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11404, 168 off2039688 00000001:00080000:1.0:1716999787.499777:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985928 00000100:00100000:1.0:1716999787.499861:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+663:11420:x1800404480675136:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 829us (1266us total) trans 4294985929 rc 0/0 00000100:00100000:1.0:1716999787.499868:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9040 00000020:00080000:1.0:1716999787.499871:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1716999787.500924:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.501363:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480675264 00000100:00100000:2.0:1716999787.501368:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480675264 00000100:00100000:2.0:1716999787.501404:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45346 00000100:00100000:2.0:1716999787.501409:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+663:11419:x1800404480675264:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.501421:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.501424:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1716999787.501440:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4afb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655b8 expref: 663 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.501452:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.501456:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.501465:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4b1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655cd expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.501546:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4b25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.501556:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4b25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.501563:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4b25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.501572:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4b2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.501577:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.501581:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:2.0:1716999787.502000:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x600:0x0], index 0: 0 00000040:00080000:2.0:1716999787.502083:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11406, 184 off2039992 00010000:00010000:2.0:1716999787.502160:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4b33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.502167:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.502172:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.502195:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4b25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.502200:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4b25 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.502204:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4b25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.502209:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.502212:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4b25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.502217:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4b25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.502223:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.502225:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.502228:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4b25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.502232:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4b25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999787.502239:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131c5b800 reply state ffff880093a43000 transno 4294985930 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.502244:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999787.502258:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4b1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655cd expref: 665 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.502267:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4b33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655cd expref: 664 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.502272:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.502274:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999787.502276:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ead00, rc 0) 00000100:00100000:2.0:1716999787.502309:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+665:11419:x1800404480675264:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 899us (1387us total) trans 4294985930 rc 0/0 00000100:00100000:2.0:1716999787.502314:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45346 00000100:00100000:0.0:1716999787.502940:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.502997:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480675392 00000100:00100000:1.0:1716999787.503001:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480675392 00000100:00100000:1.0:1716999787.503021:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45347 00000100:00100000:1.0:1716999787.503027:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+665:11420:x1800404480675392:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.503040:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.503049:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4b41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655d4 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.503090:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4b48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.503097:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4b48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc37:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.503103:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4b48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc37:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999787.503110:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc37:0x0]: returning size 12006 00010000:00010000:1.0:1716999787.503168:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4b41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655d4 expref: 668 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.503179:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4b48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc37:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655d4 expref: 667 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.503183:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:1.0:1716999787.503185:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1716999787.503187:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131d40, rc 0) 00000100:00100000:1.0:1716999787.503207:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+667:11420:x1800404480675392:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 180us (268us total) trans 4294985931 rc 0/0 00000100:00100000:1.0:1716999787.503212:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45347 00010000:00010000:0.0:1716999787.504124:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.504132:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4b2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.504137:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4b2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.504142:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.504144:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4b2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.504149:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4b2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.504158:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xb9ed2257 (ffff8800a660cf00) 00010000:00010000:0.0:1716999787.504160:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.504162:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4b2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.504167:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4b2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.504925:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.505016:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480675456 00000100:00100000:2.0:1716999787.505022:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480675456 00000100:00100000:2.0:1716999787.505435:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9949 00000100:00100000:2.0:1716999787.505441:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+85:1959:x1800404480675456:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.505453:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.505467:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4b56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655db expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999787.505485:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x600:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999787.505497:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.505499:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.505504:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4b56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655db expref: 86 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.505514:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4b56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655db expref: 86 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.505522:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eaf40, rc 0) 00000100:00100000:2.0:1716999787.505560:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+86:1959:x1800404480675456:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 119us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.505569:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9949 00000100:00100000:0.0:1716999787.506938:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.507164:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480675584 00000100:00100000:2.0:1716999787.507169:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480675584 00000100:00100000:2.0:1716999787.507205:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45348 00000100:00100000:2.0:1716999787.507210:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+666:11420:x1800404480675584:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999787.507244:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999787.507260:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4a84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65587 expref: 666 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.507271:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:2.0:1716999787.507274:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.507314:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4b5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.507324:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4b5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.507331:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4b5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999787.507554:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099581500 reply state ffff880090b17000 transno 4294985932 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4b5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.507560:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999787.507602:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+667:11420:x1800404480675584:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 391us (666us total) trans 4294985932 rc 0/0 00000100:00100000:2.0:1716999787.507608:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45348 00000100:00100000:0.0:1716999787.509087:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999787.510163:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4b5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.510175:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4b5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.510180:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4b5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.510184:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.510187:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4b5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.510192:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4b5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.510204:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:2.0:1716999787.510205:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.510209:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4b5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.510213:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4b5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.510526:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.510591:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480675648 00000100:00100000:1.0:1716999787.510599:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480675648 00000100:00100000:1.0:1716999787.510625:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45349 00000100:00100000:1.0:1716999787.510631:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+666:11420:x1800404480675648:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.510648:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.510659:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4b64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655e2 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.510695:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e2 expref: 667 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.510704:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4b64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e2 expref: 667 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.510714:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:1.0:1716999787.510717:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1716999787.510718:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131440, rc 0) 00000100:00100000:1.0:1716999787.510748:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+667:11420:x1800404480675648:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 117us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.510753:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45349 00000100:00100000:3.0:1716999787.511088:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480675712 00000100:00100000:3.0:1716999787.511092:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480675712 00000100:00100000:3.0:1716999787.511261:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9950 00000100:00100000:3.0:1716999787.511266:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+86:11419:x1800404480675712:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.511273:0:15837:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.511281:0:15837:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655e9 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.511296:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4b56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655db expref: 87 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.511301:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.511302:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.511304:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e9 expref: 87 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.511325:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4b56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655db expref: 87 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.511337:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4b56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655db expref: 87 pid: 17864 timeout: 406 lvb_type: 1 00000100:00100000:3.0:1716999787.511346:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483008768:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999787.511383:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1716999787.512986:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483008768:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999787.513007:0:15837:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e9 expref: 87 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.513018:0:15837:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96f40, rc 0) 00000100:00100000:3.0:1716999787.513683:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+87:11419:x1800404480675712:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2414us (4596us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.513690:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9950 00000100:00100000:0.0:1716999787.513825:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.514110:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480675776 00000100:00100000:3.0:1716999787.514115:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480675776 00010000:00010000:3.0:1716999787.514132:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4b56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655db expref: 87 pid: 17864 timeout: 406 lvb_type: 1 00000100:00100000:3.0:1716999787.514150:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4510 00000100:00100000:3.0:1716999787.514155:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+87:1958:x1800404480675776:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999787.514164:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999787.514180:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4b56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655db expref: 87 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:3.0:1716999787.514193:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4b56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655db expref: 87 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:3.0:1716999787.514208:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4b56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655db expref: 87 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:3.0:1716999787.514226:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.514228:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.514233:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e9 expref: 86 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.514240:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e9 expref: 86 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.514262:0:6808:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e9 expref: 86 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999787.514271:0:6808:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6808:1800404483008832:192.168.203.3@tcp:105: 00000100:00100000:3.0:1716999787.514299:0:6808:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6540 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.514406:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.514751:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480675840 00000100:00100000:3.0:1716999787.514756:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480675840 00000100:00100000:3.0:1716999787.515260:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9951 00000100:00100000:3.0:1716999787.515265:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+88:1958:x1800404480675840:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:3.0:1716999787.515454:0:15837:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1716999787.515457:0:15837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb mtime from disk: 0 -> 1716999776 00002000:00010000:3.0:1716999787.515459:0:15837:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb atime from disk: 0 -> 1716999778 00002000:00010000:3.0:1716999787.515461:0:15837:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb ctime from disk: 0 -> 1716999788 00002000:00010000:3.0:1716999787.515462:0:15837:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1716999787.515491:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099580380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+89:1958:x1800404480675840:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 225us (1084us total) trans 4294970172 rc 0/0 00000100:00100000:3.0:1716999787.515497:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9951 00000100:00100000:3.0:1716999787.516532:0:6808:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6808:1800404483008832:192.168.203.3@tcp:105: 00010000:00010000:3.0:1716999787.516548:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999787.516576:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+86:1958:x1800404480675776:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2420us (2759us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.516583:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4510 00000100:00100000:0.0:1716999787.517643:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.518097:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480675968 00000100:00100000:1.0:1716999787.518103:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480675968 00000100:00100000:1.0:1716999787.518838:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9041 00000100:00100000:1.0:1716999787.518845:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+667:11419:x1800404480675968:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999787.519209:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11407, 168 off2040160 00000001:00080000:1.0:1716999787.519214:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985933 00000100:00100000:1.0:1716999787.519296:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+669:11419:x1800404480675968:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 451us (1654us total) trans 4294985934 rc 0/0 00000100:00100000:1.0:1716999787.519306:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9041 00000020:00080000:1.0:1716999787.519309:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999787.519494:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.519513:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480676032 00000100:00100000:3.0:1716999787.519518:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480676032 00000100:00100000:3.0:1716999787.519546:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45350 00000100:00100000:3.0:1716999787.519551:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+669:11420:x1800404480676032:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.519560:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.519572:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4b72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655f0 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.519607:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4b79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.519617:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.519625:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:3.0:1716999787.519643:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc37:0x0]: returning size 12006 00000004:00200000:3.0:1716999787.519647:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999787.519655:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.519670:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4b72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655f0 expref: 671 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.519681:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655f0 expref: 670 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.519687:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:3.0:1716999787.519689:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1716999787.519691:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c973c0, rc 0) 00000100:00100000:3.0:1716999787.519713:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+670:11420:x1800404480676032:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 161us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.519717:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45350 00000100:00100000:0.0:1716999787.522035:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.522109:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480676160 00000100:00100000:1.0:1716999787.522115:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480676160 00000100:00100000:1.0:1716999787.522222:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45351 00000100:00100000:1.0:1716999787.522228:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+670:11419:x1800404480676160:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.522246:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.522258:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4b80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655f7 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.522321:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4b87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.522330:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4b87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc38:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.522338:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4b87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc38:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999787.522346:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc38:0x0]: returning size 11991 00010000:00010000:1.0:1716999787.522435:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4b80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655f7 expref: 673 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.522447:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4b87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc38:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655f7 expref: 672 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.522453:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:1.0:1716999787.522456:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1716999787.522458:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c1318c0, rc 0) 00000100:00100000:1.0:1716999787.522503:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+672:11419:x1800404480676160:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 274us (472us total) trans 4294985935 rc 0/0 00000100:00100000:1.0:1716999787.522509:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45351 00000100:00100000:0.0:1716999787.523353:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.523399:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480676224 00000100:00100000:3.0:1716999787.523405:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480676224 00000100:00100000:3.0:1716999787.523434:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45352 00000100:00100000:3.0:1716999787.523440:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+672:11420:x1800404480676224:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.523448:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.523456:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4b95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f655fe expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.523485:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4b9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523492:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4b9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523498:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4b9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523509:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4ba3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523515:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523520:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523595:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4baa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523601:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523606:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:3.0:1716999787.523621:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc37:0x0]: returning size 12006 00000004:00200000:3.0:1716999787.523624:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999787.523631:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523637:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523642:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4b9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523647:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4b9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523652:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4b9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523659:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.523662:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4b9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523668:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4b9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523675:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.523677:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.523680:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4b9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523684:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4b9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523692:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523696:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4ba3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523700:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523704:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.523706:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523710:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4ba3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523716:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xa8353d69 (ffff8800939ba500) 00010000:00010000:3.0:1716999787.523718:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.523720:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4ba3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523725:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4ba3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.523747:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4b95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655fe expref: 674 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.523755:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4baa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655fe expref: 673 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.523760:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:3.0:1716999787.523762:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999787.523764:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94900, rc 0) 00000100:00100000:3.0:1716999787.523800:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+673:11420:x1800404480676224:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 359us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.523805:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45352 00000100:00100000:2.0:1716999787.525877:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.525975:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480676352 00000100:00100000:3.0:1716999787.525983:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480676352 00000100:00100000:3.0:1716999787.526019:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45353 00000100:00100000:3.0:1716999787.526025:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+673:11419:x1800404480676352:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999787.526069:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999787.526085:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4b33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655cd expref: 673 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.526097:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:3.0:1716999787.526101:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999787.526141:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4bb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.526150:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.526157:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999787.526386:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897adc00 reply state ffff88009a31d000 transno 4294985936 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999787.526393:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999787.526459:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+674:11419:x1800404480676352:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 433us (585us total) trans 4294985936 rc 0/0 00000100:00100000:3.0:1716999787.526465:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45353 00000100:00100000:0.0:1716999787.532336:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.533580:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.533825:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480676480 00000100:00100000:1.0:1716999787.533832:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480676480 00000100:00100000:1.0:1716999787.533859:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480676544 00000100:00100000:1.0:1716999787.533860:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480676544 00010000:00010000:2.0:1716999787.534186:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.534194:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4bb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.534200:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4bb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.534205:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.534208:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4bb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.534215:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4bb1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.534226:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.534229:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.534232:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4bb1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.534236:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4bb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.534293:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45354 00000100:00100000:1.0:1716999787.534299:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+674:11420:x1800404480676480:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.534338:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999787.534350:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4baa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655fe expref: 674 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.534361:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4b79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655f0 expref: 673 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.534367:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:1.0:1716999787.534369:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.534397:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4bb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.534406:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.534411:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999787.534662:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45355 00000100:00100000:2.0:1716999787.534666:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+672:11419:x1800404480676544:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.534676:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.534683:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4bbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65605 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.534708:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65605 expref: 673 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.534716:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65605 expref: 673 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.534727:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.534729:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1716999787.534731:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea400, rc 0) 00000100:00100000:2.0:1716999787.534778:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+673:11419:x1800404480676544:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 110us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.534783:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45355 00000004:00010000:1.0:1716999787.536966:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099582680 reply state ffff880089300000 transno 4294985937 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999787.536976:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999787.537056:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+674:11420:x1800404480676480:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2755us (4725us total) trans 4294985937 rc 0/0 00000100:00100000:1.0:1716999787.537063:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45354 00000100:00100000:0.0:1716999787.548018:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999787.548106:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4bb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.548116:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4bb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.548123:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4bb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.548127:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00000100:00100000:0.0:1716999787.548128:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999787.548131:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4bb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.548136:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4bb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.548148:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:3.0:1716999787.548151:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.548154:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4bb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.548159:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4bb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999787.548201:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480676608 00000100:00100000:3.0:1716999787.548209:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480676608 00000100:00100000:3.0:1716999787.548245:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480676672 00000100:00100000:3.0:1716999787.548247:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480676672 00000100:00100000:3.0:1716999787.548262:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9952 00000100:00100000:3.0:1716999787.548268:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+86:1959:x1800404480676608:12345-192.168.203.3@tcp:2:dbench.0 00000100:00100000:1.0:1716999787.548295:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9953 00000100:00100000:1.0:1716999787.548300:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:107d663a-2216-406b-94c6-b2fcb1558728+89:1958:x1800404480676672:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:1.0:1716999787.548412:0:11262:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1716999787.548415:0:11262:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb mtime from disk: 1716999776 -> 1716999764 00002000:00010000:1.0:1716999787.548417:0:11262:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb atime from disk: 1716999778 -> 1716999768 00002000:00010000:1.0:1716999787.548419:0:11262:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb ctime from disk: 1716999788 -> 1716999788 00002000:00010000:1.0:1716999787.548421:0:11262:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1716999787.548436:0:15837:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1716999787.548439:0:15837:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb mtime from disk: 0 -> 1716999776 00002000:00010000:3.0:1716999787.548441:0:15837:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb atime from disk: 0 -> 1716999778 00002000:00010000:3.0:1716999787.548443:0:15837:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb ctime from disk: 0 -> 1716999788 00002000:00010000:3.0:1716999787.548444:0:15837:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1716999787.548455:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:107d663a-2216-406b-94c6-b2fcb1558728+90:1958:x1800404480676672:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 154us (327us total) trans 4294970173 rc 0/0 00000100:00100000:3.0:1716999787.548462:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:107d663a-2216-406b-94c6-b2fcb1558728+87:1959:x1800404480676608:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 194us (450us total) trans 4294970131 rc 0/0 00000100:00100000:1.0:1716999787.548462:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9953 00000100:00100000:3.0:1716999787.548468:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9952 00000100:00100000:0.0:1716999787.550742:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.550784:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.550861:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480676736 00000100:00100000:1.0:1716999787.550867:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480676736 00000100:00100000:1.0:1716999787.550931:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480676800 00000100:00100000:1.0:1716999787.550934:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480676800 00000100:00100000:1.0:1716999787.550948:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45356 00000100:00100000:1.0:1716999787.550953:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+674:11419:x1800404480676736:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.550971:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.550985:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4bc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6560c expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.551024:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4bcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551034:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551046:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999787.551071:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc38:0x0]: returning size 11991 00000004:00200000:1.0:1716999787.551074:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.551084:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551100:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4bc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6560c expref: 676 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.551113:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4bcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6560c expref: 675 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.551120:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:1.0:1716999787.551122:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1716999787.551125:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130fc0, rc 0) 00000100:00100000:1.0:1716999787.551159:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+675:11419:x1800404480676736:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 206us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.551165:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45356 00000100:00100000:1.0:1716999787.551178:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45357 00000100:00100000:1.0:1716999787.551182:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+674:11420:x1800404480676800:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.551188:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.551195:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4bd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65613 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.551215:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4bdb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551225:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4bdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551231:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4bdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551240:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4be2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551245:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551250:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551320:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4be9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551326:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551331:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999787.551343:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc37:0x0]: returning size 12006 00000004:00200000:1.0:1716999787.551345:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.551350:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551357:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551362:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4bdb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551370:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4bdb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551376:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4bdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551380:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.551383:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4bdb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551389:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4bdb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551395:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.551398:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.551400:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4bdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551405:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4bdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551412:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4be2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551417:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4be2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551421:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4be2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551425:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.551427:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4be2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551435:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4be2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551440:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xa8353d69 (ffff88009240e500) 00010000:00010000:1.0:1716999787.551442:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.551443:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4be2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551448:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4be2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.551463:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4bd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65613 expref: 676 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.551471:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4be9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65613 expref: 675 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.551475:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:1.0:1716999787.551477:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.551479:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132d00, rc 0) 00000100:00100000:1.0:1716999787.551494:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+675:11420:x1800404480676800:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 312us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.551499:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45357 00000100:00100000:1.0:1716999787.554367:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.554408:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.554423:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480676864 00000100:00100000:3.0:1716999787.554430:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480676864 00000100:00100000:3.0:1716999787.554453:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480676928 00000100:00100000:3.0:1716999787.554455:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480676928 00000100:00100000:3.0:1716999787.554480:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45358 00000100:00100000:3.0:1716999787.554486:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+676:11420:x1800404480676864:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:2.0:1716999787.554486:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45359 00000100:00100000:2.0:1716999787.554491:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+676:11419:x1800404480676928:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.554504:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.554511:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.554517:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4bf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6561a expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.554521:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4bf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65621 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.554557:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.554557:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4bfe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.554567:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.554567:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4bfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.554574:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.554574:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4bfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.554584:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.554585:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4c13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.554589:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.554590:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.554593:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.554595:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.554639:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.554645:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.554649:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.554654:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.554657:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.554662:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.554663:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4c1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.554669:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.554673:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.554675:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.554676:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.554678:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.554682:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.554691:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00000004:00200000:2.0:1716999787.554694:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc38:0x0]: returning size 11991 00010000:00010000:3.0:1716999787.554695:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00000004:00200000:2.0:1716999787.554697:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:3.0:1716999787.554700:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.554703:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.554705:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999787.554707:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.554709:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.554714:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff8800939ba800) 00010000:00010000:2.0:1716999787.554714:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.554715:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.554717:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.554719:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4bfe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.554721:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.554723:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4bfe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.554728:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4bfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.554732:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.554734:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4bfe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.554739:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4bfe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.554745:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.554747:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.554748:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4bf0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6561a expref: 678 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.554750:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4bfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.554754:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4bfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.554755:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4bf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6561a expref: 678 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.554761:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94b40, rc 0) 00010000:00010000:2.0:1716999787.554764:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4c13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.554769:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4c13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.554774:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4c13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.554777:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.554779:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4c13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.554784:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4c13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.554789:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xb9ed2257 (ffff88009439cc00) 00010000:00010000:2.0:1716999787.554791:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1716999787.554793:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+677:11420:x1800404480676864:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 307us (432us total) trans 0 rc 301/301 00010000:00010000:2.0:1716999787.554793:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4c13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.554797:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4c13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999787.554799:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45358 00010000:00010000:2.0:1716999787.554813:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4bf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65621 expref: 677 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.554834:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65621 expref: 676 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.554839:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.554841:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999787.554843:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb3c0, rc 0) 00000100:00100000:2.0:1716999787.555160:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+676:11419:x1800404480676928:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 667us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.555165:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45359 00000100:00100000:1.0:1716999787.556651:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.556721:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480677056 00000100:00100000:0.0:1716999787.556728:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480677056 00000100:00100000:0.0:1716999787.556766:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45360 00000100:00100000:0.0:1716999787.556772:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+676:11419:x1800404480677056:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.556800:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999787.556831:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4c1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65621 expref: 676 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.556857:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4bcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6560c expref: 675 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.556866:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:0.0:1716999787.556869:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.556919:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4c21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.556932:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4c21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.556938:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4c21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999787.557171:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88013502b480 reply state ffff88012e814000 transno 4294985938 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4c21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.557177:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.557222:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+676:11419:x1800404480677056:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 450us (574us total) trans 4294985938 rc 0/0 00000100:00100000:0.0:1716999787.557227:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45360 00010000:00010000:3.0:1716999787.561098:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4c21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.561109:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4c21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.561115:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4c21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.561120:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c6c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.561124:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4c21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.561129:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4c21 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.561141:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:3.0:1716999787.561144:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.561147:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4c21 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.561152:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4c21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.562288:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.562465:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480677120 00000100:00100000:0.0:1716999787.562472:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480677120 00000100:00100000:0.0:1716999787.562508:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9954 00000100:00100000:0.0:1716999787.562514:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+87:1957:x1800404480677120:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999787.562650:0:17700:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999787.562653:0:17700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb mtime from disk: 1716999776 -> 1716999764 00002000:00010000:0.0:1716999787.562655:0:17700:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb atime from disk: 1716999778 -> 1716999768 00002000:00010000:0.0:1716999787.562657:0:17700:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb ctime from disk: 1716999788 -> 1716999788 00002000:00010000:0.0:1716999787.562659:0:17700:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1716999787.562692:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+88:1957:x1800404480677120:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 179us (409us total) trans 4294970132 rc 0/0 00000100:00100000:0.0:1716999787.562698:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9954 00000100:00100000:1.0:1716999787.562774:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.563723:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480677184 00000100:00100000:0.0:1716999787.563728:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480677184 00000100:00100000:0.0:1716999787.564214:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45361 00000100:00100000:0.0:1716999787.564221:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+675:11420:x1800404480677184:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.564236:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.564249:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4c28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65628 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.564286:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4c2f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564296:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4c2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564304:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4c2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564313:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4c36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564319:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564323:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564364:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4c2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564368:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4c2f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564374:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4c2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564379:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.564381:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4c2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564387:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4c2f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564395:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.564398:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.564400:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4c2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564405:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4c2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564413:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4c36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564418:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4c36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564422:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4c36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564426:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216eac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.564428:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4c36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564432:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4c36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564437:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff8800941a3300) 00010000:00010000:0.0:1716999787.564440:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.564441:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4c36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564445:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4c36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.564473:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4c28 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65628 expref: 676 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.564480:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4c28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65628 expref: 676 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.564486:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f180, rc 0) 00000100:00100000:0.0:1716999787.564528:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+675:11420:x1800404480677184:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 307us (1754us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.564534:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45361 00000100:00100000:1.0:1716999787.566036:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.566088:0:4162:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480677312 00000100:00100000:0.0:1716999787.566094:0:4162:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480677312 00000100:00100000:0.0:1716999787.566132:0:4162:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 609 00000100:00100000:0.0:1716999787.566137:0:4162:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+675:11420:x1800404480677312:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.566165:0:4162:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999787.566178:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4be9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65613 expref: 675 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.566191:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:0.0:1716999787.566199:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655aa expref: 674 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.566205:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.566208:0:4162:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.566247:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4c3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566258:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4c3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566265:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4c3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566273:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4c44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566278:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4c44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566283:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4c44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566296:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4c4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566301:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4c4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566306:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4c4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566372:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4c52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566378:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4c52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566383:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4c52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000040:00080000:0.0:1716999787.566674:0:4162:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11408, 224 off2040384 00000004:00010000:0.0:1716999787.566760:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88013502a300 reply state ffff88012e816000 transno 4294985939 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4c52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:0.0:1716999787.566766:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999787.566769:0:4162:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4c3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566774:0:4162:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4c3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566779:0:4162:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4c3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566783:0:4162:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216ed00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.566786:0:4162:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4c3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566792:0:4162:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4c3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566798:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.566800:0:4162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.566803:0:4162:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4c3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.566807:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4c3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00000004:00010000:0.0:1716999787.566813:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88013502a300 reply state ffff88012e816000 transno 4294985939 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4c44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:0.0:1716999787.566848:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00010000:0.0:1716999787.566850:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88013502a300 reply state ffff88012e816000 transno 4294985939 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4c4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:0.0:1716999787.566857:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1716999787.566927:0:4162:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+675:11420:x1800404480677312:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 789us (894us total) trans 4294985939 rc 0/0 00000100:00100000:0.0:1716999787.566934:0:4162:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 609 00000100:00100000:2.0:1716999787.569413:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.570230:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480677376 00000100:00100000:3.0:1716999787.570237:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480677376 00000100:00100000:3.0:1716999787.570266:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45362 00000100:00100000:3.0:1716999787.570272:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+675:11419:x1800404480677376:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.570286:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.570300:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4c59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6562f expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.570340:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4c60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570350:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4c60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570357:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4c60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570367:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4c67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570372:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570376:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570424:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4c60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570430:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4c60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570439:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4c60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570443:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.570446:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4c60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570451:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4c60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570460:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.570462:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.570464:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4c60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570468:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4c60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570477:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4c67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570482:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4c67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570486:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4c67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570490:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.570492:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4c67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570496:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4c67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570501:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xe7082257 (ffff8800939ba500) 00010000:00010000:3.0:1716999787.570503:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.570505:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4c67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570509:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4c67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.570536:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4c59 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6562f expref: 676 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.570543:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4c59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6562f expref: 676 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.570550:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97cc0, rc 0) 00000100:00100000:3.0:1716999787.571329:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+675:11419:x1800404480677376:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1054us (1919us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.571335:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45362 00010000:00010000:3.0:1716999787.571354:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4c4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571360:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4c4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571365:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4c4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571368:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.571371:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4c4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571379:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4c4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571385:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xa8353d69 (ffff8800a5486100) 00010000:00010000:3.0:1716999787.571387:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.571390:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4c4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571394:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4c4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xa8353d69 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571407:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4c44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571412:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4c44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571416:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4c44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571419:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.571421:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4c44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571426:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4c44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571431:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff8800941a3400) 00010000:00010000:3.0:1716999787.571433:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.571435:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4c44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571439:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4c44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571448:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4c52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571453:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4c52 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571457:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4c52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571460:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.571462:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4c52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571466:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4c52 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571471:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:3.0:1716999787.571473:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999787.571475:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4c52 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999787.571479:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4c52 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00000100:00100000:1.0:1716999787.572645:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.572740:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480677440 00000100:00100000:3.0:1716999787.572745:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480677440 00000100:00100000:3.0:1716999787.572773:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45363 00000100:00100000:3.0:1716999787.572779:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+674:11420:x1800404480677440:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.572792:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.572803:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4c6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65636 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.572847:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.572856:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.572862:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.572869:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.572875:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.572899:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573595:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4c83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573603:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573609:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:3.0:1716999787.573631:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc37:0x0]: returning size 12006 00000004:00200000:3.0:1716999787.573634:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999787.573644:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573652:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573658:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573662:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573668:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573671:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.573674:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573679:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573687:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.573689:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.573692:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573697:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4c75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573705:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573710:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573714:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573717:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.573720:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573725:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573729:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff8800939ba300) 00010000:00010000:3.0:1716999787.573731:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.573733:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573737:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4c7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.573755:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4c6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65636 expref: 676 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.573764:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65636 expref: 675 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.573769:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:3.0:1716999787.573771:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999787.573773:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c973c0, rc 0) 00000100:00100000:3.0:1716999787.574471:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+675:11420:x1800404480677440:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1690us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.574478:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45363 00000100:00100000:0.0:1716999787.575310:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.575708:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480677504 00000100:00100000:3.0:1716999787.575714:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480677504 00000100:00100000:3.0:1716999787.575737:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45364 00000100:00100000:3.0:1716999787.575742:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+675:11419:x1800404480677504:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.575756:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.575768:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4c8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6563d expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.575786:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6563d expref: 676 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.575794:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4c8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6563d expref: 676 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.575801:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.575803:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.575805:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94900, rc 0) 00000100:00100000:3.0:1716999787.575837:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+676:11419:x1800404480677504:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 95us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.575842:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45364 00000100:00100000:1.0:1716999787.577701:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.577761:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480677568 00000100:00100000:3.0:1716999787.577767:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480677568 00000100:00100000:3.0:1716999787.577789:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9042 00000100:00100000:3.0:1716999787.577793:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+676:11419:x1800404480677568:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999787.579568:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.580281:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480677696 00000100:00100000:1.0:1716999787.580287:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480677696 00000100:00100000:1.0:1716999787.580316:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45365 00000100:00100000:1.0:1716999787.580322:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+678:11420:x1800404480677696:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.580334:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.580347:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4c91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65644 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.580411:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4c98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.580420:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc35:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.580429:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4c98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc35:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:1.0:1716999787.580437:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc35:0x0]: returning size 53 00010000:00010000:1.0:1716999787.580533:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4c91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65644 expref: 681 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.580548:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4c98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc35:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65644 expref: 680 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.580554:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc35:0x0].0x0 (ffff8800939ba400) 00010000:00010000:1.0:1716999787.580556:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1716999787.580559:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132d00, rc 0) 00000100:00100000:1.0:1716999787.580585:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+680:11420:x1800404480677696:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 263us (1020us total) trans 4294985940 rc 0/0 00000100:00100000:1.0:1716999787.580593:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45365 00000100:00100000:3.0:1716999787.582373:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+678:11419:x1800404480677568:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4574us (4670us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.582382:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9042 00000100:00100000:1.0:1716999787.583316:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.583652:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480677824 00000100:00100000:3.0:1716999787.583659:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480677824 00000100:00100000:3.0:1716999787.583681:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9043 00000100:00100000:3.0:1716999787.583686:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+678:11420:x1800404480677824:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999787.583943:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11409, 168 off2040552 00000100:00100000:3.0:1716999787.584024:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+679:11420:x1800404480677824:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 336us (708us total) trans 4294985941 rc 0/0 00000100:00100000:3.0:1716999787.584029:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9043 00000100:00100000:0.0:1716999787.584167:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.586755:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480677888 00000100:00100000:3.0:1716999787.586763:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480677888 00000100:00100000:3.0:1716999787.586809:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 702 00000100:00100000:3.0:1716999787.586824:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+679:1959:x1800404480677888:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999787.586836:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999787.586852:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4c98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc35:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65644 expref: 679 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.586865:0:6808:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc35:0x0].0x0 (ffff8800939ba400) 00010000:00010000:3.0:1716999787.586868:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999787.586919:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+678:1959:x1800404480677888:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 103us (2751us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.586926:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 702 00000100:00100000:0.0:1716999787.587108:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.587510:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480677952 00000100:00100000:3.0:1716999787.587514:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480677952 00000100:00100000:3.0:1716999787.587543:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45366 00000100:00100000:3.0:1716999787.587548:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+678:11419:x1800404480677952:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.587560:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.587576:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4ca6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6564b expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.587613:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4cad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587623:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587631:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587641:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4cb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587646:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587651:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587700:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4cad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587706:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4cad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587711:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587716:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.587719:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4cad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587725:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4cad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587732:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.587734:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.587737:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4cad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587742:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc4cad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587749:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587753:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4cb4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587758:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587761:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.587763:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587767:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4cb4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587772:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xe7082257 (ffff8800939ba300) 00010000:00010000:3.0:1716999787.587774:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.587776:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4cb4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587780:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc4cb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.587806:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4ca6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6564b expref: 679 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.587813:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4ca6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6564b expref: 679 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.587836:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c961c0, rc 0) 00000100:00100000:3.0:1716999787.587861:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+678:11419:x1800404480677952:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 313us (753us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.587867:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45366 00000100:00100000:0.0:1716999787.588143:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.588423:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480678080 00000100:00100000:3.0:1716999787.588427:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480678080 00000100:00100000:3.0:1716999787.588455:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45367 00000100:00100000:3.0:1716999787.588459:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+678:11420:x1800404480678080:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999787.588482:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999787.588492:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4885 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654d8 expref: 678 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.588500:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc35:0x0].0x0 (ffff8800939ba400) 00010000:00010000:3.0:1716999787.588505:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999787.588520:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4cbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.588526:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4cbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.588532:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4cbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.588539:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4cc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.588544:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.588553:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.588614:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4cc9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.588620:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4cc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.588625:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4cc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:3.0:1716999787.589286:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1478, 64 off102848 00000040:00080000:3.0:1716999787.589303:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11410, 184 off2040736 00010000:00010000:3.0:1716999787.589351:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4cd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589358:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589364:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4cd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589370:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4cd0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589375:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4cd0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589380:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4cd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589384:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4cd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589392:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999787.589395:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4cd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589400:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4cd0 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589406:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc35:0x0].0x0 (ffff8800939ba800) 00010000:00010000:3.0:1716999787.589408:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999787.589410:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4cd0 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589414:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4cd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589429:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4cc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589434:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4cc9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589438:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4cc9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589442:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.589444:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4cc9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589449:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4cc9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589454:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc35:0x0].0x0 (ffff8800939ba800) 00010000:00010000:3.0:1716999787.589456:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999787.589458:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4cc9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589462:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4cc9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589489:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4cbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589494:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4cbb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589498:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4cbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589502:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.589504:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4cbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589508:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4cbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589513:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.589514:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.589517:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4cbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.589521:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4cbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999787.589527:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012b7f7480 reply state ffff88008eccc000 transno 4294985942 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999787.589532:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999787.590794:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+679:11420:x1800404480678080:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2328us (2646us total) trans 4294985942 rc 0/0 00000100:00100000:3.0:1716999787.590802:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45367 00000100:00100000:2.0:1716999787.593174:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.593657:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480678144 00000100:00100000:3.0:1716999787.593664:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480678144 00000100:00100000:3.0:1716999787.593693:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45368 00000100:00100000:3.0:1716999787.593698:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+679:11419:x1800404480678144:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.593712:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.593725:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4cd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65652 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.593765:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4cde lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593775:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4cde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593783:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4cde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593794:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4ce5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593799:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593805:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593869:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4cde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593876:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4cde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593902:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4cde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593907:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.593910:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4cde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593916:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4cde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593925:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.593927:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.593930:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4cde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593934:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4cde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593943:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593948:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4ce5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593952:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593956:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.593958:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593962:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593968:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xe7082257 (ffff8800939ba700) 00010000:00010000:3.0:1716999787.593970:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.593971:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4ce5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.593976:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4ce5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.594005:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4cd7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65652 expref: 680 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.594011:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4cd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65652 expref: 680 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.594018:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97a80, rc 0) 00000100:00100000:3.0:1716999787.594052:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+679:11419:x1800404480678144:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 354us (882us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.594058:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45368 00000100:00100000:2.0:1716999787.594380:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.594422:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480678208 00000100:00100000:1.0:1716999787.594426:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480678208 00000100:00100000:1.0:1716999787.594453:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45369 00000100:00100000:1.0:1716999787.594458:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+679:11420:x1800404480678208:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.594467:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.594475:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4cec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65659 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.594497:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4cf3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594505:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594511:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594519:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4cfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594524:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594529:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594562:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4cf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594567:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4cf3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594572:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594576:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.594578:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4cf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594583:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4cf3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594589:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.594591:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.594594:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4cf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594598:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4cf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594608:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594613:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4cfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594617:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594621:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.594623:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594627:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4cfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594633:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xb9ed2257 (ffff88009240e200) 00010000:00010000:1.0:1716999787.594635:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.594637:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4cfa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594647:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4cfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.594671:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4cec lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65659 expref: 680 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.594677:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4cec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65659 expref: 680 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.594685:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132d00, rc 0) 00000100:00100000:1.0:1716999787.594708:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+679:11420:x1800404480678208:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 250us (329us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.594714:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45369 00010000:00010000:3.0:1716999787.594726:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4cc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.594734:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4cc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.594738:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4cc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.594743:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.594745:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4cc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.594753:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4cc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.594760:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xeca88e0f (ffff8800939ba100) 00010000:00010000:3.0:1716999787.594763:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.594765:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4cc2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.594768:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4cc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xeca88e0f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999787.596479:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.596549:0:6836:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480678336 00000100:00100000:0.0:1716999787.596554:0:6836:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480678336 00000100:00100000:0.0:1716999787.596577:0:6836:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 610 00000100:00100000:0.0:1716999787.596582:0:6836:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+678:11419:x1800404480678336:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.596608:0:6836:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999787.596620:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4a7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6558e expref: 678 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.596708:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:0.0:1716999787.596718:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4c8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6563d expref: 677 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.596726:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.596728:0:6836:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.596765:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4d01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.596773:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4d01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.596783:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4d01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.596791:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4d08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.596796:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4d08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.596801:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4d08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.596814:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4d0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.596831:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.596836:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.596921:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4d16 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.596928:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4d16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.596934:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4d16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000040:00080000:0.0:1716999787.597227:0:6836:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11411, 224 off2040960 00000004:00010000:0.0:1716999787.597309:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897ac380 reply state ffff88008e841000 transno 4294985943 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4d16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999787.597319:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:0.0:1716999787.597322:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897ac380 reply state ffff88008e841000 transno 4294985943 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999787.597326:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1716999787.597329:0:6836:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4d01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.597334:0:6836:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4d01 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.597338:0:6836:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4d01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.597342:0:6836:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c6c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.597345:0:6836:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4d01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.597350:0:6836:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4d01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.597356:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.597359:0:6836:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.597361:0:6836:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4d01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.597366:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4d01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000004:00010000:0.0:1716999787.597372:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897ac380 reply state ffff88008e841000 transno 4294985943 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4d08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999787.597376:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1716999787.597427:0:6836:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+678:11419:x1800404480678336:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 843us (950us total) trans 4294985943 rc 0/0 00000100:00100000:0.0:1716999787.597433:0:6836:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 610 00000100:00100000:2.0:1716999787.599850:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999787.599927:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4d08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.599934:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4d08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.599940:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4d08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.599945:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.599948:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4d08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.599953:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4d08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.599963:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff880091b4da00) 00010000:00010000:3.0:1716999787.599965:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.599968:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4d08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.599972:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4d08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.599981:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999787.599984:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4d0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.599989:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4d0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.599993:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.599997:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.599999:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4d0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.600003:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4d0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.600008:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xe7082257 (ffff880091b4db00) 00010000:00010000:3.0:1716999787.600011:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.600013:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4d0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.600017:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4d0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.600024:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4d16 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.600029:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4d16 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999787.600030:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480678400 00010000:00010000:3.0:1716999787.600033:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4d16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999787.600036:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480678400 00010000:00010000:3.0:1716999787.600040:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.600042:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4d16 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.600046:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4d16 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.600052:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:3.0:1716999787.600054:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999787.600056:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4d16 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.600060:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4d16 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999787.600061:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480678464 00000100:00100000:0.0:1716999787.600064:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480678464 00000100:00100000:0.0:1716999787.600457:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45370 00000100:00100000:0.0:1716999787.600463:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+678:11420:x1800404480678400:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.600474:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.600485:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4d1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65660 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.600505:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65660 expref: 679 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.600514:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65660 expref: 679 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.600520:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.600522:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.600524:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216d8c0, rc 0) 00000100:00100000:0.0:1716999787.600551:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+679:11420:x1800404480678400:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 89us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.600557:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45370 00000100:00100000:0.0:1716999787.600567:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45371 00000100:00100000:0.0:1716999787.600571:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+678:11419:x1800404480678464:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.600579:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.600586:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4d24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65667 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.600616:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4d2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600623:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600628:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600637:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4d32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600642:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600646:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600716:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600723:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600728:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:0.0:1716999787.600748:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc34:0x0]: returning size 12006 00000004:00200000:0.0:1716999787.600751:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.600762:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600769:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600775:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600779:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4d2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600784:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600787:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.600790:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600794:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4d2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600799:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.600801:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.600804:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4d2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600808:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4d2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600955:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600961:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4d32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600965:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600969:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.600971:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600975:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4d32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600981:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xe7082257 (ffff880091b4d100) 00010000:00010000:0.0:1716999787.600983:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.600985:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4d32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.600989:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4d32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.601007:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4d24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65667 expref: 680 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.601015:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65667 expref: 679 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.601020:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:0.0:1716999787.601022:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.601024:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f840, rc 0) 00000100:00100000:0.0:1716999787.601055:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+679:11419:x1800404480678464:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 482us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.601060:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45371 00000100:00100000:2.0:1716999787.604777:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.604857:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.604921:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480678656 00000100:00100000:0.0:1716999787.604927:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480678656 00000100:00100000:0.0:1716999787.604955:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45372 00000100:00100000:0.0:1716999787.604961:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+679:11419:x1800404480678656:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.604993:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999787.605009:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4d39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65667 expref: 679 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.605023:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:0.0:1716999787.605026:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.605051:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4d40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.605060:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4d40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.605067:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4d40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999787.605290:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009c2c4700 reply state ffff88008e847000 transno 4294985944 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4d40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.605296:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.605360:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+680:11419:x1800404480678656:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 399us (503us total) trans 4294985944 rc 0/0 00000100:00100000:0.0:1716999787.605366:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45372 00000100:00100000:1.0:1716999787.605437:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480678528 00000100:00100000:1.0:1716999787.605441:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480678528 00000100:00100000:1.0:1716999787.605457:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9044 00000100:00100000:1.0:1716999787.605461:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+680:11420:x1800404480678528:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:3.0:1716999787.608309:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4d40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.608321:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4d40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.608326:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4d40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.608331:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.608335:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4d40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.608340:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4d40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.608352:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:3.0:1716999787.608354:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.608358:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4d40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.608362:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4d40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.608875:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+679:11420:x1800404480678528:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3409us (4100us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.610778:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9044 00000100:00100000:2.0:1716999787.612255:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.612275:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480678720 00000100:00100000:0.0:1716999787.612282:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480678720 00000100:00100000:0.0:1716999787.612317:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9955 00000100:00100000:0.0:1716999787.612323:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b87e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+88:1958:x1800404480678720:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999787.612460:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999787.612463:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb mtime from disk: 1716999763 -> 1716999775 00002000:00010000:0.0:1716999787.612465:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb atime from disk: 1716999767 -> 1716999778 00002000:00010000:0.0:1716999787.612468:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb ctime from disk: 1716999787 -> 1716999788 00002000:00010000:0.0:1716999787.612469:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x5fe:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1716999787.614016:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b87e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+89:1958:x1800404480678720:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 1689us (1760us total) trans 4294970133 rc 0/0 00000100:00100000:0.0:1716999787.614024:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9955 00000100:00100000:2.0:1716999787.614180:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.614391:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480678784 00000100:00100000:0.0:1716999787.614395:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480678784 00000100:00100000:0.0:1716999787.614471:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45373 00000100:00100000:0.0:1716999787.614476:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+679:11420:x1800404480678784:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.614491:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.614504:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4d47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6566e expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.614542:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4d4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614552:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614560:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614571:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614576:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614581:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614627:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614633:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4d4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614638:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614642:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.614645:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614651:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4d4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614660:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.614662:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.614665:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4d4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614670:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4d4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614677:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614681:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4d55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614685:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614689:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.614691:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614699:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614704:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xb9ed2257 (ffff880092a37000) 00010000:00010000:0.0:1716999787.614706:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.614708:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4d55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614712:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4d55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.614738:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4d47 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6566e expref: 680 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.614744:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ed00/0x6d188eabd8dc4d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6566e expref: 680 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.614751:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216ed00, rc 0) 00000100:00100000:0.0:1716999787.614771:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+679:11420:x1800404480678784:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 295us (593us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.614777:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45373 00000100:00100000:2.0:1716999787.616783:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.616827:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.616890:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480678912 00000100:00100000:1.0:1716999787.616896:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480678912 00000100:00100000:1.0:1716999787.616924:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480679040 00000100:00100000:1.0:1716999787.616926:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480679040 00000100:00100000:1.0:1716999787.616939:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45374 00000100:00100000:1.0:1716999787.616944:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+680:11419:x1800404480678912:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:1.0:1716999787.616976:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4d5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.616986:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.616993:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617007:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617012:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4d5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617017:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617021:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.617024:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617029:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4d5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617036:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:1.0:1716999787.617038:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1716999787.617041:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4d5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617048:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4d5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.617082:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+680:11419:x1800404480678912:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 138us (304us total) trans 0 rc -22/-22 00000100:00100000:1.0:1716999787.617088:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45374 00000100:00100000:1.0:1716999787.617101:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45375 00000100:00100000:1.0:1716999787.617105:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+679:11420:x1800404480679040:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.617112:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.617114:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999787.617124:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4d1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65660 expref: 679 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.617131:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.617134:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.617140:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4d63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65675 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.617209:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4d6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617216:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4d6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617221:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4d6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617230:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4d71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617238:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617243:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:1.0:1716999787.617579:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x601:0x0], index 1: 0 00000040:00080000:1.0:1716999787.617632:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11412, 184 off2041144 00010000:00010000:1.0:1716999787.617709:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4d78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617716:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617722:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4d78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617740:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4d6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617745:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4d6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617750:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4d6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617754:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.617756:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4d6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617761:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4d6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617767:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.617769:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.617771:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4d6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.617776:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4d6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999787.617783:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009c2c6680 reply state ffff8800940eb000 transno 4294985945 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.617788:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999787.617802:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4d63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65675 expref: 681 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.617810:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4d78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65675 expref: 680 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.617829:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999787.617831:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.617833:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130240, rc 0) 00000100:00100000:1.0:1716999787.617852:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+681:11420:x1800404480679040:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 746us (1035us total) trans 4294985945 rc 0/0 00000100:00100000:1.0:1716999787.617857:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45375 00000100:00100000:2.0:1716999787.620049:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999787.620099:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.620108:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4d71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.620113:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4d71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.620117:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.620120:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4d71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.620126:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4d71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.620136:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xb9ed2257 (ffff88009240e800) 00010000:00010000:3.0:1716999787.620138:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.620140:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4d71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999787.620145:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4d71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.620297:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480679104 00000100:00100000:0.0:1716999787.620303:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480679104 00000100:00100000:0.0:1716999787.620325:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9956 00000100:00100000:0.0:1716999787.620331:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+90:1959:x1800404480679104:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.620343:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.620355:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc4d86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6567c expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1716999787.620375:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x601:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1716999787.620386:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.620387:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.620393:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc4d86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6567c expref: 91 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999787.620403:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc4d86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6567c expref: 91 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999787.620411:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216eac0, rc 0) 00000100:00100000:0.0:1716999787.620525:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+91:1959:x1800404480679104:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 192us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.620531:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9956 00000100:00100000:0.0:1716999787.620747:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.621196:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480679168 00000100:00100000:2.0:1716999787.621199:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480679168 00000100:00100000:2.0:1716999787.621220:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45376 00000100:00100000:2.0:1716999787.621225:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+680:11419:x1800404480679168:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.621235:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.621244:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4d8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65683 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.621278:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4d94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621286:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4d94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621293:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4d94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621302:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4d9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621307:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621312:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621382:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4da2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621388:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621393:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:2.0:1716999787.621413:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc38:0x0]: returning size 11991 00000004:00200000:2.0:1716999787.621416:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999787.621426:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621432:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4da2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621438:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4d94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621443:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4d94 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621447:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4d94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621455:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.621457:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4d94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621462:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4d94 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621469:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.621471:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.621473:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4d94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621477:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4d94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621488:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4d9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621492:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4d9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621497:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621500:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.621502:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4d9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621507:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4d9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621512:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xb9ed2257 (ffff8800a660c300) 00010000:00010000:2.0:1716999787.621514:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.621516:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4d9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621520:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4d9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.621536:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4d8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65683 expref: 682 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.621544:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4da2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65683 expref: 681 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.621549:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.621550:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999787.621552:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9b00, rc 0) 00000100:00100000:2.0:1716999787.621583:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+681:11419:x1800404480679168:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 357us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.621588:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45376 00000100:00100000:3.0:1716999787.624088:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.624155:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480679232 00000100:00100000:0.0:1716999787.624161:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480679232 00000100:00100000:0.0:1716999787.624192:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9957 00000100:00100000:0.0:1716999787.624198:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+91:11420:x1800404480679232:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.624209:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.624220:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6568a expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.624239:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc4d86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6567c expref: 92 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999787.624245:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.624247:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.624250:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6568a expref: 92 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.624273:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc4d86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6567c expref: 92 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999787.624283:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc4d86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6567c expref: 92 pid: 17864 timeout: 406 lvb_type: 1 00000100:00100000:0.0:1716999787.624293:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483008896:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999787.624340:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135481240 going to sleep for 11 seconds 00000100:00100000:3.0:1716999787.626595:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.626743:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480679296 00000100:00100000:0.0:1716999787.626748:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480679296 00000100:00100000:0.0:1716999787.627098:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45377 00000100:00100000:0.0:1716999787.627104:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+681:11419:x1800404480679296:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.627116:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.627128:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4db0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65691 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.627165:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4db7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627175:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4db7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627183:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4db7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627192:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4dbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627198:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627203:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627250:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4db7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627255:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4db7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627262:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4db7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627267:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.627270:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4db7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627275:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4db7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627284:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.627286:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.627289:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4db7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627293:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4db7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627683:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627689:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4dbe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627695:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627699:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.627701:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627706:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4dbe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627713:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff880094791100) 00010000:00010000:0.0:1716999787.627715:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.627717:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4dbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627721:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.627753:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4db0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65691 expref: 682 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.627759:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4db0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65691 expref: 682 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.627766:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f180, rc 0) 00000100:00100000:0.0:1716999787.627808:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+681:11419:x1800404480679296:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 704us (1217us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.627822:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45377 00000100:00100000:0.0:1716999787.628898:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b7f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483008896:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999787.629107:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [8192->12287] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6568a expref: 92 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.629119:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216ed00, rc 0) 00000100:00100000:0.0:1716999787.629152:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+92:11420:x1800404480679232:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 4953us (5068us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.629158:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9957 00000100:00100000:3.0:1716999787.630590:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.631702:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.631789:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480679360 00000100:00100000:2.0:1716999787.631795:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480679360 00010000:00010000:2.0:1716999787.631825:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc4d86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6567c expref: 92 pid: 17864 timeout: 406 lvb_type: 1 00000100:00100000:2.0:1716999787.631854:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4511 00000100:00100000:2.0:1716999787.631859:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+92:1958:x1800404480679360:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999787.631869:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999787.631897:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc4d86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6567c expref: 92 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:2.0:1716999787.631920:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc4d86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6567c expref: 92 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:2.0:1716999787.631937:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc4d86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6567c expref: 92 pid: 17864 timeout: 406 lvb_type: 1 00010000:00010000:2.0:1716999787.632527:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.632529:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.632535:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6568a expref: 91 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.632544:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6568a expref: 91 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.632569:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6568a expref: 91 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999787.632580:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483008960:192.168.203.3@tcp:105: 00000100:00100000:2.0:1716999787.632865:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008eea3300 going to sleep for 11 seconds 00000100:00100000:2.0:1716999787.632895:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480679424 00000100:00100000:2.0:1716999787.632899:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480679424 00000100:00100000:2.0:1716999787.633255:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45378 00000100:00100000:2.0:1716999787.633260:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+681:11419:x1800404480679424:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.633274:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.633286:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4dc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65698 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.633307:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65698 expref: 682 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.633316:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4dc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65698 expref: 682 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.633322:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.633324:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.633326:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8900, rc 0) 00000100:00100000:2.0:1716999787.633345:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+682:11419:x1800404480679424:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 84us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.633351:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45378 00000100:00100000:3.0:1716999787.638544:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.638622:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009c2c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483008960:192.168.203.3@tcp:105: 00010000:00010000:2.0:1716999787.638639:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999787.638681:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+91:1958:x1800404480679360:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 6820us (8091us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.638690:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4511 00000100:00100000:0.0:1716999787.638976:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480679552 00000100:00100000:0.0:1716999787.638982:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480679552 00000100:00100000:0.0:1716999787.639005:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9045 00000100:00100000:0.0:1716999787.639010:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec24450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+682:11420:x1800404480679552:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999787.639597:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11413, 168 off2041312 00000001:00080000:0.0:1716999787.639603:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985946 00000100:00100000:0.0:1716999787.640226:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec24450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+684:11420:x1800404480679552:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1214us (1687us total) trans 4294985947 rc 0/0 00000100:00100000:0.0:1716999787.640233:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9045 00000020:00080000:0.0:1716999787.640236:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999787.640322:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.640406:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480679616 00000100:00100000:0.0:1716999787.640410:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480679616 00000100:00100000:0.0:1716999787.640426:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9046 00000100:00100000:0.0:1716999787.640430:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+684:11419:x1800404480679616:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999787.643850:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.644026:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480679744 00000100:00100000:1.0:1716999787.644031:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480679744 00000100:00100000:1.0:1716999787.644067:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45379 00000100:00100000:1.0:1716999787.644072:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+685:11420:x1800404480679744:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.644087:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.644100:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4dcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6569f expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.644161:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4dd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.644170:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4dd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc39:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.644178:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4dd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc39:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999787.644185:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc39:0x0]: returning size 11991 00010000:00010000:1.0:1716999787.644262:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4dcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6569f expref: 688 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.644274:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4dd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc39:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6569f expref: 687 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.644280:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999787.644282:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1716999787.644284:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130900, rc 0) 00000100:00100000:1.0:1716999787.644309:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+687:11420:x1800404480679744:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 236us (464us total) trans 4294985948 rc 0/0 00000100:00100000:1.0:1716999787.644314:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45379 00000100:00100000:0.0:1716999787.644402:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+686:11419:x1800404480679616:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3969us (4079us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.644409:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9046 00000100:00100000:3.0:1716999787.647766:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.647811:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.647811:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480679808 00000100:00100000:0.0:1716999787.647827:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480679808 00000100:00100000:1.0:1716999787.648148:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480679936 00000100:00100000:1.0:1716999787.648151:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480679936 00000100:00100000:1.0:1716999787.648169:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45380 00000100:00100000:1.0:1716999787.648174:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+687:11419:x1800404480679808:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:2.0:1716999787.648176:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45381 00000100:00100000:2.0:1716999787.648180:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+687:11420:x1800404480679936:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.648186:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.648199:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4de1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656a6 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.648209:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999787.648220:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4d78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65675 expref: 688 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.648227:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4de8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648235:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4de8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648243:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4de8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.648245:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:2.0:1716999787.648249:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.648258:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4def lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648263:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648266:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.648284:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4df6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.648290:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4df6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.648294:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4df6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.648313:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4de8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648318:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4de8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648322:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4de8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648326:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.648329:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4de8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648334:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4de8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648343:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.648345:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.648348:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4de8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648352:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4de8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648359:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648363:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4def lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648367:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4def lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648370:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.648372:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4def lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648376:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4def lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648381:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff8800a5486500) 00010000:00010000:1.0:1716999787.648382:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.648384:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4def lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648387:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4def lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.648415:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4de1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656a6 expref: 687 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.648421:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4de1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656a6 expref: 687 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.648427:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133840, rc 0) 00000100:00100000:1.0:1716999787.648640:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+687:11419:x1800404480679808:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 464us (878us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.648646:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45380 00000004:00010000:2.0:1716999787.648699:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009143c700 reply state ffff880090b11000 transno 4294985949 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4df6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999787.648705:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999787.648739:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+687:11420:x1800404480679936:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 558us (928us total) trans 4294985949 rc 0/0 00000100:00100000:2.0:1716999787.648744:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45381 00010000:00010000:0.0:1716999787.649961:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4df6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.649968:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4df6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.649973:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4df6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.649977:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.649980:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4df6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.649984:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4df6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.649993:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:0.0:1716999787.649995:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.649997:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4df6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.650001:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc4df6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999787.650475:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.650698:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680000 00000100:00100000:2.0:1716999787.650702:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680000 00000100:00100000:2.0:1716999787.650809:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45382 00000100:00100000:2.0:1716999787.650814:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+686:11420:x1800404480680000:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.650837:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.650847:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4dfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656ad expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.650917:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4dfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656ad expref: 687 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.650930:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4dfd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xc39:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656ad expref: 687 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.650943:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:2.0:1716999787.650945:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1716999787.650947:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8d80, rc 0) 00000100:00100000:2.0:1716999787.650973:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+687:11420:x1800404480680000:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 158us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.650977:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45382 00000100:00100000:3.0:1716999787.651829:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.651906:0:6836:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680128 00000100:00100000:0.0:1716999787.651910:0:6836:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680128 00000100:00100000:0.0:1716999787.651992:0:6836:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 611 00000100:00100000:0.0:1716999787.651998:0:6836:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+687:11419:x1800404480680128:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:3.0:1716999787.652060:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.652190:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680192 00000100:00100000:1.0:1716999787.652194:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680192 00000100:00100000:1.0:1716999787.652224:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9958 00000100:00100000:1.0:1716999787.652229:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+91:1958:x1800404480680192:12345-192.168.203.3@tcp:2:dbench.0 00010000:00010000:0.0:1716999787.652383:0:6836:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00002000:00010000:1.0:1716999787.652391:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1716999787.652393:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb mtime from disk: 0 -> 1716999776 00002000:00010000:1.0:1716999787.652395:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb atime from disk: 0 -> 1716999778 00002000:00010000:1.0:1716999787.652397:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb ctime from disk: 0 -> 1716999788 00010000:00010000:0.0:1716999787.652397:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc4da2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65683 expref: 687 pid: 11055 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1716999787.652398:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:0.0:1716999787.652406:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:0.0:1716999787.652414:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc4dc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65698 expref: 686 pid: 11055 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999787.652420:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+92:1958:x1800404480680192:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 191us (360us total) trans 4294970174 rc 0/0 00010000:00010000:0.0:1716999787.652420:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.652423:0:6836:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999787.652425:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9958 00010000:00010000:0.0:1716999787.652458:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4e04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.652467:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4e04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.652473:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4e04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.652483:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4e0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.652487:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4e0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.652492:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4e0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.652504:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4e12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.652509:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.652514:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.652589:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4e19 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.652599:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4e19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.652604:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4e19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000040:00080000:0.0:1716999787.652900:0:6836:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11414, 224 off2041536 00000004:00010000:0.0:1716999787.652984:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009143d880 reply state ffff88008e842000 transno 4294985950 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4e19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999787.652991:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999787.652994:0:6836:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4e04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.652999:0:6836:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4e04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.653003:0:6836:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4e04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.653007:0:6836:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216eac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.653010:0:6836:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4e04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.653015:0:6836:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4e04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.653022:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.653024:0:6836:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.653027:0:6836:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4e04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.653031:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4e04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000004:00010000:0.0:1716999787.653038:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009143d880 reply state ffff88008e842000 transno 4294985950 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4e0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999787.653042:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00010000:0.0:1716999787.653044:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009143d880 reply state ffff88008e842000 transno 4294985950 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000100:00100000:0.0:1716999787.653047:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1716999787.653087:0:6836:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+687:11419:x1800404480680128:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1088us (1258us total) trans 4294985950 rc 0/0 00000100:00100000:0.0:1716999787.653092:0:6836:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 611 00000100:00100000:3.0:1716999787.653741:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.653774:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680256 00000100:00100000:1.0:1716999787.653779:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680256 00000100:00100000:1.0:1716999787.653799:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45383 00000100:00100000:1.0:1716999787.653804:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+687:11420:x1800404480680256:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.653812:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.653826:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.653830:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4e20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656b4 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.653833:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4e12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653838:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4e12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653842:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.653844:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4e12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653848:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4e12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653856:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xb9ed2257 (ffff880094791100) 00010000:00010000:2.0:1716999787.653858:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.653860:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4e12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.653860:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4e27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.653866:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.653867:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc4e12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.653872:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.653895:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4e0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653899:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4e0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653904:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4e0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653907:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.653909:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4e0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653914:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4e0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653920:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff880094791900) 00010000:00010000:2.0:1716999787.653921:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.653923:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4e0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653927:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4e0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000004:00200000:1.0:1716999787.653927:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc39:0x0]: returning size 11991 00000004:00200000:1.0:1716999787.653930:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1716999787.653935:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4e19 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653939:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4e19 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00000004:00010000:1.0:1716999787.653939:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.653946:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4e19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653950:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.653951:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4e19 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653956:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4e19 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653962:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.653964:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1716999787.653966:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4e19 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:2.0:1716999787.653970:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4e19 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.654080:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4e20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656b4 expref: 689 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.654095:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656b4 expref: 687 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.654101:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999787.654103:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1716999787.654105:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130fc0, rc 0) 00000100:00100000:1.0:1716999787.654135:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+687:11420:x1800404480680256:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 331us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.654141:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45383 00000100:00100000:3.0:1716999787.654213:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.654288:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680320 00000100:00100000:1.0:1716999787.654291:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680320 00000100:00100000:1.0:1716999787.654306:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45384 00000100:00100000:1.0:1716999787.654310:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+687:11419:x1800404480680320:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.654319:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.654326:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4e2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656bb expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.654347:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4e35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654354:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4e35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654365:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4e35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654374:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc4e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654379:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc4e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654384:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc4e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654427:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc4e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654432:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc4e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654437:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc4e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999787.654447:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc38:0x0]: returning size 11991 00000004:00200000:1.0:1716999787.654449:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.654454:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc4e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654460:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc4e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654464:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4e35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654468:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4e35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654471:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4e35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654475:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.654477:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4e35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654481:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4e35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654486:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.654488:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.654490:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4e35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654494:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4e35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654501:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc4e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654505:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc4e3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654514:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc4e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654518:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a8901680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.654520:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc4e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654524:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc4e3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654530:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff8800a5486100) 00010000:00010000:1.0:1716999787.654532:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.654533:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc4e3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654537:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc4e3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.654555:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4e2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656bb expref: 689 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.654562:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc4e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656bb expref: 688 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.654567:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:1.0:1716999787.654569:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.654571:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8903cc0, rc 0) 00000100:00100000:1.0:1716999787.654604:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+688:11419:x1800404480680320:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 292us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.654609:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45384 00000100:00100000:2.0:1716999787.656771:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.656982:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680384 00000100:00100000:1.0:1716999787.656988:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680384 00000100:00100000:1.0:1716999787.657013:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45385 00000100:00100000:1.0:1716999787.657018:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+688:11420:x1800404480680384:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.657030:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.657040:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc4e4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656c2 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.657072:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc4e51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657081:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc4e51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657089:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc4e51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657099:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc4e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657104:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc4e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657109:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc4e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657177:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc4e5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657183:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc4e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657187:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc4e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999787.657205:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc39:0x0]: returning size 11991 00000004:00200000:1.0:1716999787.657208:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.657218:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc4e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657224:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc4e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657229:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc4e51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657233:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc4e51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657238:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc4e51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657242:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a8900240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.657245:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc4e51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657249:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc4e51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657256:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.657257:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.657260:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc4e51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657263:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc4e51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657271:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc4e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657275:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc4e58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657279:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc4e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657282:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8801339f8240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.657283:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc4e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657287:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc4e58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657292:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xb9ed2257 (ffff88009439c200) 00010000:00010000:1.0:1716999787.657293:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.657295:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc4e58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657299:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc4e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.657316:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc4e4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656c2 expref: 690 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.657325:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc4e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656c2 expref: 689 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.657330:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999787.657332:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.657334:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801339fba80, rc 0) 00000100:00100000:1.0:1716999787.657362:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+689:11420:x1800404480680384:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 344us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.657367:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45385 00000100:00100000:3.0:1716999787.660811:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.661040:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.661166:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680448 00000100:00100000:2.0:1716999787.661173:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680448 00000100:00100000:2.0:1716999787.661215:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45386 00000100:00100000:2.0:1716999787.661222:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+689:11419:x1800404480680448:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.661236:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.661250:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4e66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656c9 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.661294:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4e6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661305:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4e6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661313:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4e6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661323:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4e74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661327:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661331:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661384:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4e6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661390:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4e6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661394:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661398:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.661402:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4e6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661407:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4e6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661415:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.661418:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.661420:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4e6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661424:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc4e6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661432:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4e74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661437:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4e74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661441:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661445:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.661447:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4e74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661451:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4e74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661457:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x53504954 (ffff8800a660c300) 00010000:00010000:2.0:1716999787.661459:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.661461:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4e74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661465:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc4e74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.661495:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4e66 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656c9 expref: 690 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.661501:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc4e66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656c9 expref: 690 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.661507:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eaac0, rc 0) 00000100:00100000:2.0:1716999787.661543:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+689:11419:x1800404480680448:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 322us (738us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.661549:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45386 00000100:00100000:1.0:1716999787.661752:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680576 00000100:00100000:1.0:1716999787.661756:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680576 00000100:00100000:1.0:1716999787.661787:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45387 00000100:00100000:1.0:1716999787.661792:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+689:11420:x1800404480680576:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.661814:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999787.661835:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc4e5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656c2 expref: 689 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.661847:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4e27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656b4 expref: 688 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.661853:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999787.661856:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.661895:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc4e7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.661902:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc4e7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.661908:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc4e7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999787.662175:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009143e680 reply state ffff88009a6dd000 transno 4294985951 ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc4e7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999787.662182:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999787.662234:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+689:11420:x1800404480680576:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 441us (1194us total) trans 4294985951 rc 0/0 00000100:00100000:1.0:1716999787.662239:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45387 00000100:00100000:2.0:1716999787.663519:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.663643:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.663690:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680640 00000100:00100000:1.0:1716999787.663696:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680640 00000100:00100000:1.0:1716999787.663721:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45388 00000100:00100000:1.0:1716999787.663726:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+689:11419:x1800404480680640:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.663737:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.663753:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4e82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656d0 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.663754:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc4e7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.663761:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc4e7b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.663766:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc4e7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.663770:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8801339f9f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.663771:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656d0 expref: 690 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.663772:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc4e7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.663777:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc4e7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.663779:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4e82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656d0 expref: 690 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.663785:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.663785:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999787.663787:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.663787:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.663789:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133840, rc 0) 00010000:00010000:0.0:1716999787.663790:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc4e7b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.663796:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc4e7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999787.663863:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680704 00000100:00100000:3.0:1716999787.663867:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680704 00000100:00100000:0.0:1716999787.663896:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9959 00000100:00100000:0.0:1716999787.663900:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+92:1959:x1800404480680704:12345-192.168.203.3@tcp:2:dbench.0 00000100:00100000:1.0:1716999787.664021:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+689:11419:x1800404480680640:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 293us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.664027:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45388 00002000:00010000:0.0:1716999787.664407:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999787.664410:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb mtime from disk: 1716999776 -> 1716999764 00002000:00010000:0.0:1716999787.664412:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb atime from disk: 1716999778 -> 1716999768 00002000:00010000:0.0:1716999787.664414:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb ctime from disk: 1716999788 -> 1716999788 00002000:00010000:0.0:1716999787.664416:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1716999787.664444:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+93:1959:x1800404480680704:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 542us (800us total) trans 4294970175 rc 0/0 00000100:00100000:0.0:1716999787.664450:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9959 00000100:00100000:3.0:1716999787.665969:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.666181:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680768 00000100:00100000:1.0:1716999787.666186:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680768 00000100:00100000:1.0:1716999787.666219:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9047 00000100:00100000:1.0:1716999787.666225:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+689:11419:x1800404480680768:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999787.668089:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.668794:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680832 00000100:00100000:2.0:1716999787.668800:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680832 00000100:00100000:2.0:1716999787.668848:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45389 00000100:00100000:2.0:1716999787.668854:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+690:11420:x1800404480680832:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.668867:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.668898:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4e89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656d7 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.668937:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4e90 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.668948:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.668956:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.668965:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4e97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.668971:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.668975:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669020:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4e90 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669026:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4e90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669031:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4e90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669036:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.669039:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4e90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669044:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4e90 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669053:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.669055:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.669058:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4e90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669062:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc4e90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669070:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669074:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4e97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669079:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669083:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ead00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.669085:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669093:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4e97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669098:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xe7082257 (ffff8800a660cf00) 00010000:00010000:2.0:1716999787.669100:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.669102:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4e97 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669107:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc4e97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.669135:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4e89 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656d7 expref: 691 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.669142:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc4e89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656d7 expref: 691 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.669148:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e86c0, rc 0) 00000100:00100000:2.0:1716999787.669176:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+690:11420:x1800404480680832:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 322us (1091us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.669182:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45389 00000100:00100000:1.0:1716999787.669231:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+689:11419:x1800404480680768:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3004us (3262us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.669238:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9047 00000100:00100000:3.0:1716999787.671850:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.671901:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.672053:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680896 00000100:00100000:2.0:1716999787.672059:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680896 00000100:00100000:2.0:1716999787.672090:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480680960 00000100:00100000:2.0:1716999787.672092:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480680960 00000100:00100000:2.0:1716999787.672104:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45390 00000100:00100000:2.0:1716999787.672109:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+690:11420:x1800404480680896:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.672123:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.672137:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4e9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656de expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.672157:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4e9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656de expref: 691 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.672167:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4e9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656de expref: 691 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.672173:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.672176:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.672178:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8fc0, rc 0) 00000100:00100000:2.0:1716999787.672206:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+691:11420:x1800404480680896:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 96us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.672211:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45390 00000100:00100000:2.0:1716999787.672222:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45391 00000100:00100000:2.0:1716999787.672226:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+690:11419:x1800404480680960:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.672232:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.672238:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4ea5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656e5 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.672266:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4eac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672274:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4eac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672280:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4eac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672292:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4eb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672297:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672302:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672345:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4eac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672351:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4eac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672355:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4eac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672360:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.672363:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4eac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672368:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4eac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672376:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.672378:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.672380:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4eac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672385:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc4eac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672393:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4eb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672398:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4eb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672402:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672406:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.672408:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4eb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672412:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4eb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672417:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x764e078d (ffff8800a5486500) 00010000:00010000:2.0:1716999787.672419:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.672421:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4eb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672425:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc4eb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.672451:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4ea5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656e5 expref: 691 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.672458:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc4ea5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656e5 expref: 691 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.672464:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eaf40, rc 0) 00000100:00100000:2.0:1716999787.672479:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+690:11419:x1800404480680960:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 253us (599us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.672487:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45391 00000100:00100000:3.0:1716999787.674764:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.674828:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480681024 00000100:00100000:1.0:1716999787.674835:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480681024 00000100:00100000:1.0:1716999787.674871:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9048 00000100:00100000:1.0:1716999787.674899:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+690:11420:x1800404480681024:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999787.677413:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.677501:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480681152 00000100:00100000:0.0:1716999787.677507:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480681152 00000100:00100000:0.0:1716999787.677545:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45392 00000100:00100000:0.0:1716999787.677551:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+692:11419:x1800404480681152:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.677564:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.677566:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1716999787.677585:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4e82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656d0 expref: 692 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.677603:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.677607:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.677621:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4eba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656ec expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.677708:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4ec1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.677717:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4ec1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.677725:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4ec1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.677734:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4ec8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.677739:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.677744:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:0.0:1716999787.678143:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x601:0x0], index 0: 0 00000040:00080000:0.0:1716999787.678196:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11415, 184 off2041720 00010000:00010000:0.0:1716999787.678278:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4ecf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.678285:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.678291:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.678311:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4ec1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.678316:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4ec1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.678322:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4ec1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.678327:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.678329:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4ec1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.678335:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4ec1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.678341:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.678344:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.678346:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4ec1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.678350:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4ec1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999787.678357:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008ea7f100 reply state ffff88012dbc0000 transno 4294985952 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.678363:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999787.678378:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4eba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656ec expref: 694 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.678387:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656ec expref: 693 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.678392:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3a:0x0].0x0 (ffff880094791900) 00010000:00010000:0.0:1716999787.678394:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.678396:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f3c0, rc 0) 00000100:00100000:0.0:1716999787.678429:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+694:11419:x1800404480681152:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 879us (1021us total) trans 4294985952 rc 0/0 00000100:00100000:0.0:1716999787.678436:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45392 00000100:00100000:1.0:1716999787.680251:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+692:11420:x1800404480681024:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5369us (5486us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.680260:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9048 00000100:00100000:2.0:1716999787.682035:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.682092:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480681216 00000100:00100000:1.0:1716999787.682100:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480681216 00000100:00100000:1.0:1716999787.682135:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9960 00000100:00100000:1.0:1716999787.682141:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+89:1959:x1800404480681216:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.682154:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.682170:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4edd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656f3 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1716999787.682190:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x601:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1716999787.682205:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.682207:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.682213:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4edd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656f3 expref: 90 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999787.682224:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4edd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656f3 expref: 90 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999787.682233:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132d00, rc 0) 00000100:00100000:1.0:1716999787.682262:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+90:1959:x1800404480681216:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 120us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.682267:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9960 00010000:00010000:0.0:1716999787.683416:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.683424:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4ec8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.683431:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4ec8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.683435:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.683439:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4ec8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.683445:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4ec8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.683455:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x764e078d (ffff880094791800) 00010000:00010000:0.0:1716999787.683458:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.683460:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4ec8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.683465:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4ec8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999787.686023:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.686219:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480681280 00000100:00100000:0.0:1716999787.686225:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480681280 00000100:00100000:0.0:1716999787.686259:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45393 00000100:00100000:0.0:1716999787.686264:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+691:11420:x1800404480681280:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.686280:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.686294:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4ee4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f656fa expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.686332:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4eeb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686341:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686348:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686356:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4ef2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686361:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686365:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686409:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4eeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686414:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4eeb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686418:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4eeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686422:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.686424:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4eeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686429:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4eeb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686436:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.686438:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.686441:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4eeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686445:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4eeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686451:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686455:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686459:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686462:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.686464:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686468:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686472:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xe7082257 (ffff880094791f00) 00010000:00010000:0.0:1716999787.686473:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.686475:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4ef2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686478:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4ef2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.686499:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4ee4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656fa expref: 692 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.686505:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4ee4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656fa expref: 692 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.686511:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216e400, rc 0) 00000100:00100000:0.0:1716999787.686550:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+691:11420:x1800404480681280:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 286us (533us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.686555:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45393 00000100:00100000:2.0:1716999787.688231:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.688293:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480681408 00000100:00100000:1.0:1716999787.688301:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480681408 00000100:00100000:1.0:1716999787.688345:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9049 00000100:00100000:1.0:1716999787.688390:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+691:11419:x1800404480681408:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999787.688805:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.688854:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480681472 00000100:00100000:3.0:1716999787.688858:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480681472 00000100:00100000:3.0:1716999787.688901:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45394 00000100:00100000:3.0:1716999787.688906:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+693:11420:x1800404480681472:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.688914:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.688925:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4ef9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65701 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.688956:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4f00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.688969:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4f00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.688981:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4f00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689001:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4f07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00000040:00080000:1.0:1716999787.689204:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11416, 168 off2041888 00000001:00080000:1.0:1716999787.689209:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985953 00010000:00010000:3.0:1716999787.689258:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689266:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999787.689280:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+695:11419:x1800404480681408:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 928us (1051us total) trans 4294985954 rc 0/0 00000100:00100000:1.0:1716999787.689286:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9049 00000020:00080000:1.0:1716999787.689290:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1716999787.689303:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4f00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689308:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4f00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689312:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4f00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689316:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.689318:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4f00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689323:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4f00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689330:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.689331:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.689334:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4f00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689338:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc4f00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689347:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689351:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4f07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689355:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689358:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.689360:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689363:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4f07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689368:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xe7082257 (ffff8800939ba700) 00010000:00010000:3.0:1716999787.689369:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.689371:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4f07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689374:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc4f07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.689399:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4ef9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65701 expref: 694 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.689406:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc4ef9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65701 expref: 694 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.689412:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94480, rc 0) 00000100:00100000:3.0:1716999787.689432:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+693:11420:x1800404480681472:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 526us (628us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.689438:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45394 00000100:00100000:2.0:1716999787.691808:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.692246:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480681600 00000100:00100000:3.0:1716999787.692253:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480681600 00000100:00100000:3.0:1716999787.692286:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45395 00000100:00100000:3.0:1716999787.692291:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+693:11419:x1800404480681600:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999787.692326:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999787.692343:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc4ecf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656ec expref: 693 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.692356:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3a:0x0].0x0 (ffff880094791900) 00010000:00010000:3.0:1716999787.692363:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999787.692380:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4f0e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.692390:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4f0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.692397:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4f0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.692406:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4f15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.692411:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4f15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.692420:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4f15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999787.692437:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.692473:0:6836:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480681728 00000100:00100000:0.0:1716999787.692477:0:6836:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480681728 00010000:00010000:3.0:1716999787.692493:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4f1c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.692494:0:6836:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 612 00010000:00010000:3.0:1716999787.692498:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4f1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.692498:0:6836:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+693:11420:x1800404480681728:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999787.692503:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4f1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.692513:0:6836:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999787.692522:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc4c83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65636 expref: 693 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.692532:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:0.0:1716999787.692539:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc4e9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656de expref: 692 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.692544:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.692546:0:6836:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.692574:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4f23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.692580:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4f23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.692588:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4f23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.692595:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4f2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.692599:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.692603:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.692613:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4f31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.692617:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.692621:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.692667:0:6836:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4f38 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.692672:0:6836:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4f38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.692678:0:6836:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4f38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00000040:00080000:3.0:1716999787.692871:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1478, 64 off102848 00000040:00080000:3.0:1716999787.692908:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11417, 184 off2042072 00000040:00080000:0.0:1716999787.692930:0:6836:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11418, 224 off2042296 00010000:00010000:3.0:1716999787.692961:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4f3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.692969:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.692975:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4f3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.692980:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4f3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.692985:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4f3f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.692989:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4f3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.692994:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4f3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.693002:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999787.693005:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4f3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999787.693010:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008fc1ed80 reply state ffff88012dbc4000 transno 4294985956 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4f38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.693011:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4f3f lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.693018:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3a:0x0].0x0 (ffff8800939ba300) 00010000:00010000:3.0:1716999787.693020:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:0.0:1716999787.693020:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999787.693022:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4f3f lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999787.693023:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008fc1ed80 reply state ffff88012dbc4000 transno 4294985956 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.693026:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc4f3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.693027:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:0.0:1716999787.693029:0:6836:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4f23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.693033:0:6836:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4f23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.693038:0:6836:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4f23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.693041:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4f1c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.693043:0:6836:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fa80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.693046:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4f1c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.693046:0:6836:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4f23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.693050:0:6836:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4f23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.693051:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4f1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.693054:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.693057:0:6836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.693059:0:6836:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.693061:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4f1c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.693061:0:6836:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4f23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.693065:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4f1c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.693066:0:6836:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc4f23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.693071:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3a:0x0].0x0 (ffff8800939ba300) 00010000:00010000:3.0:1716999787.693073:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000004:00010000:0.0:1716999787.693073:0:6836:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008fc1ed80 reply state ffff88012dbc4000 transno 4294985956 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6836 initiator: MDT0 00010000:00010000:3.0:1716999787.693076:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4f1c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.693077:0:6836:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00010000:00010000:3.0:1716999787.693080:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc4f1c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.693108:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4f0e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.693112:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4f0e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.693116:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4f0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.693116:0:6836:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+694:11420:x1800404480681728:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 616us (679us total) trans 4294985956 rc 0/0 00010000:00010000:3.0:1716999787.693119:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.693121:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4f0e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.693122:0:6836:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 612 00010000:00010000:3.0:1716999787.693125:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4f0e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.693130:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999787.693131:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.693133:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4f0e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.693136:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc4f0e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:3.0:1716999787.693142:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009c2c7800 reply state ffff880136311000 transno 4294985955 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4f15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999787.693145:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999787.693167:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+694:11419:x1800404480681600:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 875us (1364us total) trans 4294985955 rc 0/0 00000100:00100000:3.0:1716999787.693172:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45395 00010000:00010000:0.0:1716999787.694984:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4f2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.694996:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4f2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.695001:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4f2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.695005:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.695008:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4f2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.695014:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4f2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.695024:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff880094791d00) 00010000:00010000:0.0:1716999787.695026:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.695032:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4f2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.695037:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc4f2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.695048:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4f15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.695049:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.695053:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4f31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.695056:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4f15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.695057:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4f31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.695061:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4f15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.695061:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.695063:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4f31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.695065:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.695068:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4f15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.695068:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4f31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.695072:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4f15 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.695073:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xe7082257 (ffff880094791100) 00010000:00010000:0.0:1716999787.695075:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.695077:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4f31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.695080:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x764e078d (ffff8800939ba400) 00010000:00010000:0.0:1716999787.695080:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc4f31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.695083:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.695086:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4f15 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.695089:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4f38 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6836 initiator: MDT0 00010000:00010000:1.0:1716999787.695090:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc4f15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.695094:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4f38 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.695098:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4f38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.695102:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c6c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.695104:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4f38 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.695108:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4f38 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.695113:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:0.0:1716999787.695116:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1716999787.695117:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4f38 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00010000:00010000:0.0:1716999787.695121:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc4f38 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6836 initiator: MDT0 00000100:00100000:2.0:1716999787.696134:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.696206:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480681792 00000100:00100000:3.0:1716999787.696213:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480681792 00000100:00100000:3.0:1716999787.696237:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45396 00000100:00100000:3.0:1716999787.696243:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+692:11420:x1800404480681792:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.696255:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.696266:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4f46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65708 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.696301:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4f4d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696310:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4f4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696317:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4f4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696325:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4f54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696331:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696336:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696424:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4f5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696431:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696437:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:3.0:1716999787.696458:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc37:0x0]: returning size 12006 00000004:00200000:3.0:1716999787.696462:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999787.696472:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696479:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696484:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4f4d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696488:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4f4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696492:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4f4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696496:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.696498:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4f4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696502:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4f4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696509:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.696511:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.696514:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4f4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696517:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc4f4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696525:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696529:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4f54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696532:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696535:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.696537:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696541:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4f54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696546:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xe7082257 (ffff8800939ba100) 00010000:00010000:3.0:1716999787.696548:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.696549:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4f54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696553:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc4f54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.696571:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc4f46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65708 expref: 694 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.696580:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65708 expref: 693 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.696585:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:3.0:1716999787.696587:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999787.696588:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c961c0, rc 0) 00000100:00100000:3.0:1716999787.696631:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+693:11420:x1800404480681792:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 387us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.696636:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45396 00000100:00100000:2.0:1716999787.698902:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.698944:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.699140:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480681920 00000100:00100000:0.0:1716999787.699146:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480681920 00000100:00100000:0.0:1716999787.699179:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480682048 00000100:00100000:0.0:1716999787.699181:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480682048 00000100:00100000:0.0:1716999787.699200:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45397 00000100:00100000:0.0:1716999787.699206:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+694:11419:x1800404480681920:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:1.0:1716999787.699207:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45398 00000100:00100000:1.0:1716999787.699214:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+694:11420:x1800404480682048:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.699241:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999787.699241:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999787.699255:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc4f5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65708 expref: 694 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.699255:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc4e43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656bb expref: 694 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.699266:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:0.0:1716999787.699266:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:1.0:1716999787.699270:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.699270:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.699293:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4f62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.699293:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4f69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.699301:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.699301:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.699308:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.699308:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999787.699567:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008fc1f480 reply state ffff88012dbc7000 transno 4294985957 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.699574:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:1.0:1716999787.699578:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008fc1f800 reply state ffff88009a6da000 transno 4294985958 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999787.699584:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.699623:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+696:11419:x1800404480681920:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 417us (747us total) trans 4294985957 rc 0/0 00000100:00100000:1.0:1716999787.699625:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+696:11420:x1800404480682048:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 410us (680us total) trans 4294985958 rc 0/0 00000100:00100000:0.0:1716999787.699629:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45397 00000100:00100000:1.0:1716999787.699632:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45398 00010000:00010000:1.0:1716999787.700491:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4f62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.700497:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4f62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.700505:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4f62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.700508:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.700511:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4f62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.700516:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4f62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.700524:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:1.0:1716999787.700526:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.700528:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4f62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.700532:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc4f62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.700902:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4f69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.700908:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4f69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.700913:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.700917:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.700920:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4f69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.700924:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4f69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.700932:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:0.0:1716999787.700934:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.700936:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4f69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.700941:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc4f69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.702006:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.702077:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480682176 00000100:00100000:0.0:1716999787.702083:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480682176 00000100:00100000:0.0:1716999787.702117:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9961 00000100:00100000:0.0:1716999787.702122:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+93:1959:x1800404480682176:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999787.702616:0:17700:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999787.702619:0:17700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb mtime from disk: 1716999764 -> 1716999776 00002000:00010000:0.0:1716999787.702622:0:17700:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb atime from disk: 1716999768 -> 1716999778 00002000:00010000:0.0:1716999787.702624:0:17700:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb ctime from disk: 1716999788 -> 1716999788 00002000:00010000:0.0:1716999787.702626:0:17700:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x600:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1716999787.703334:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+94:1959:x1800404480682176:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 1208us (1326us total) trans 4294970176 rc 0/0 00000100:00100000:0.0:1716999787.703341:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9961 00000100:00100000:2.0:1716999787.703436:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.703598:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480682112 00000100:00100000:0.0:1716999787.703602:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480682112 00000100:00100000:0.0:1716999787.703617:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9962 00000100:00100000:0.0:1716999787.703622:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+90:1958:x1800404480682112:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999787.703711:0:17700:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999787.703714:0:17700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb mtime from disk: 1716999764 -> 1716999776 00002000:00010000:0.0:1716999787.703716:0:17700:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb atime from disk: 1716999768 -> 1716999778 00002000:00010000:0.0:1716999787.703718:0:17700:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb ctime from disk: 1716999788 -> 1716999788 00002000:00010000:0.0:1716999787.703719:0:17700:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1716999787.703738:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+91:1958:x1800404480682112:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 116us (303us total) trans 4294970134 rc 0/0 00000100:00100000:0.0:1716999787.703743:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9962 00000100:00100000:2.0:1716999787.706021:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.706051:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.706099:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480682432 00000100:00100000:1.0:1716999787.706105:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480682432 00000100:00100000:0.0:1716999787.706274:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480682368 00000100:00100000:0.0:1716999787.706278:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480682368 00000100:00100000:1.0:1716999787.706280:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45399 00000100:00100000:1.0:1716999787.706286:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+694:11419:x1800404480682432:12345-192.168.203.3@tcp:55:dbench.0 00000100:00100000:0.0:1716999787.706296:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45400 00000100:00100000:0.0:1716999787.706300:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+694:11420:x1800404480682368:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:1.0:1716999787.706328:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4f77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.706328:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4f70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.706339:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.706339:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4f70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.706348:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.706349:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4f70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.706363:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.706363:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4f70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.706368:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4f77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.706368:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4f70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.706373:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4f77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.706373:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4f70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.706378:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.706378:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.706381:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4f77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.706381:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4f70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.706386:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4f77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.706386:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4f70 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.706394:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:0.0:1716999787.706394:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:1.0:1716999787.706396:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1716999787.706396:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1716999787.706399:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4f77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.706399:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4f70 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.706404:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc4f77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999787.706404:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc4f70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.706450:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+694:11420:x1800404480682368:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 148us (397us total) trans 0 rc -22/-22 00000100:00100000:0.0:1716999787.706456:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45400 00000100:00100000:1.0:1716999787.706640:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+693:11419:x1800404480682432:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 353us (622us total) trans 0 rc -22/-22 00000100:00100000:1.0:1716999787.706646:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45399 00000100:00100000:2.0:1716999787.708496:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.708534:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.708585:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480682496 00000100:00100000:0.0:1716999787.708590:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480682496 00000100:00100000:0.0:1716999787.708609:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480682560 00000100:00100000:0.0:1716999787.708611:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480682560 00000100:00100000:0.0:1716999787.708631:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45401 00000100:00100000:0.0:1716999787.708637:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+694:11419:x1800404480682496:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.708649:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.708660:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4f7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6570f expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.708693:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4f85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.708702:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.708709:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:0.0:1716999787.708730:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc38:0x0]: returning size 11991 00000004:00200000:0.0:1716999787.708733:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.708744:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4f85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.708758:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc4f7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6570f expref: 696 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.708769:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4f85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6570f expref: 695 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.708775:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:0.0:1716999787.708777:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1716999787.708779:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216fcc0, rc 0) 00000100:00100000:0.0:1716999787.708803:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+695:11419:x1800404480682496:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 167us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.708810:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45401 00000100:00100000:0.0:1716999787.708835:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45402 00000100:00100000:0.0:1716999787.708839:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+694:11420:x1800404480682560:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.708845:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.708852:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4f8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65716 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.708870:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4f93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.708877:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4f93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.708901:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4f93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.708911:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4f9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.708916:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.708921:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.708995:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4fa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709001:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709007:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:0.0:1716999787.709021:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc39:0x0]: returning size 11991 00000004:00200000:0.0:1716999787.709024:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.709029:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709036:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709041:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4f93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709046:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4f93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709051:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4f93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709055:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.709058:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4f93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709063:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4f93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709070:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.709072:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.709074:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4f93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709079:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc4f93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709086:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709091:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4f9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709095:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4f9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709099:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.709101:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4f9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709105:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4f9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709110:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xb9ed2257 (ffff880094791a00) 00010000:00010000:0.0:1716999787.709112:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.709114:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4f9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709118:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc4f9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.709133:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc4f8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65716 expref: 696 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.709142:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65716 expref: 695 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.709146:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:0.0:1716999787.709148:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.709150:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f180, rc 0) 00000100:00100000:0.0:1716999787.709165:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+695:11420:x1800404480682560:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 325us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.709171:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45402 00000100:00100000:2.0:1716999787.712813:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.712864:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.713262:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480682624 00000100:00100000:0.0:1716999787.713269:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480682624 00000100:00100000:0.0:1716999787.713363:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480682688 00000100:00100000:0.0:1716999787.713367:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480682688 00000100:00100000:1.0:1716999787.713421:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45403 00000100:00100000:1.0:1716999787.713428:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+696:11419:x1800404480682624:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.713442:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.713456:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4fa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6571d expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.713499:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4faf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713510:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4faf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713518:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4faf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713527:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713532:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713537:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713611:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4fbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713617:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713623:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:1.0:1716999787.713641:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc38:0x0]: returning size 11991 00000004:00200000:1.0:1716999787.713645:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.713654:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713661:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713667:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4faf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713672:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4faf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713676:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4faf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713681:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.713684:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4faf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713689:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4faf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713698:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999787.713700:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.713703:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4faf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713707:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc4faf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713716:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713720:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713724:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713728:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.713731:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713735:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713740:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff88009439cc00) 00010000:00010000:1.0:1716999787.713742:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.713744:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4fb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713748:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc4fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713765:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc4fa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6571d expref: 698 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.713774:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6571d expref: 697 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.713780:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:1.0:1716999787.713782:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.713783:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131f80, rc 0) 00000100:00100000:1.0:1716999787.713840:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+697:11419:x1800404480682624:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 412us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.713846:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45403 00000100:00100000:1.0:1716999787.713860:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45404 00000100:00100000:1.0:1716999787.713864:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+696:11420:x1800404480682688:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.713870:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.713877:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4fc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65724 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.713914:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc4fcb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713920:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc4fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713926:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc4fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713934:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc4fd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713939:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc4fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713944:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc4fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713973:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc4fcb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713978:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc4fcb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713982:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc4fcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713986:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131f8ed00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.713988:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc4fcb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.713993:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc4fcb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.714002:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.714004:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.714007:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc4fcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.714011:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc4fcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.714017:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc4fd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.714021:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc4fd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.714025:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc4fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.714028:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131f8ef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.714030:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc4fd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.714034:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc4fd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.714040:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff8800a660cf00) 00010000:00010000:1.0:1716999787.714042:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.714044:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc4fd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.714048:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc4fd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.714071:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4fc4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65724 expref: 697 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.714078:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc4fc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65724 expref: 697 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.714087:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133cc0, rc 0) 00000100:00100000:1.0:1716999787.714102:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+696:11420:x1800404480682688:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 238us (1238us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.714107:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45404 00000100:00100000:2.0:1716999787.717065:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.717136:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480682816 00000100:00100000:1.0:1716999787.717144:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480682816 00000100:00100000:1.0:1716999787.717179:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45405 00000100:00100000:1.0:1716999787.717185:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+696:11419:x1800404480682816:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.717219:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999787.717236:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc4fbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6571d expref: 696 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.717251:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc4f85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6570f expref: 695 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.717259:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:1.0:1716999787.717262:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.717286:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc4fd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.717296:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc4fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.717302:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc4fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999787.717526:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800889fc700 reply state ffff880091996000 transno 4294985959 ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc4fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999787.717532:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999787.717592:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+696:11419:x1800404480682816:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 406us (533us total) trans 4294985959 rc 0/0 00000100:00100000:1.0:1716999787.717598:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45405 00000100:00100000:0.0:1716999787.718390:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.718493:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480682880 00000100:00100000:1.0:1716999787.718497:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480682880 00000100:00100000:1.0:1716999787.718974:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45406 00000100:00100000:1.0:1716999787.718980:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+696:11420:x1800404480682880:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.718991:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.719000:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc4fe0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6572b expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.719018:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc4fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6572b expref: 697 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.719027:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc4fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6572b expref: 697 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.719033:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.719035:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.719037:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365d40, rc 0) 00000100:00100000:1.0:1716999787.719069:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+697:11420:x1800404480682880:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 89us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.719075:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45406 00000100:00100000:0.0:1716999787.720615:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999787.720616:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc4fd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.720623:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc4fd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.720628:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc4fd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.720632:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091367600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.720636:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc4fd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.720642:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc4fd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.720671:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.720674:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.720676:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc4fd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.720681:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc4fd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999787.721493:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480682944 00000100:00100000:1.0:1716999787.721500:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480682944 00000100:00100000:1.0:1716999787.721539:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9963 00000100:00100000:1.0:1716999787.721546:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+91:1958:x1800404480682944:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:1.0:1716999787.721685:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1716999787.721687:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb mtime from disk: 1716999776 -> 1716999764 00002000:00010000:1.0:1716999787.721689:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb atime from disk: 1716999778 -> 1716999768 00002000:00010000:1.0:1716999787.721691:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb ctime from disk: 1716999788 -> 1716999788 00002000:00010000:1.0:1716999787.721693:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1716999787.721740:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+92:1958:x1800404480682944:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 193us (1126us total) trans 4294970135 rc 0/0 00000100:00100000:1.0:1716999787.721746:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9963 00000100:00100000:3.0:1716999787.722142:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.722224:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683008 00000100:00100000:1.0:1716999787.722228:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683008 00000100:00100000:1.0:1716999787.722258:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9050 00000100:00100000:1.0:1716999787.722263:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec24050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+696:11420:x1800404480683008:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999787.724668:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.724718:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683072 00000100:00100000:2.0:1716999787.724723:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683072 00000100:00100000:2.0:1716999787.724760:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45407 00000100:00100000:2.0:1716999787.724766:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+698:11419:x1800404480683072:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.724777:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.724791:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4fe7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65732 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.724842:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4fee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.724852:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.724860:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:2.0:1716999787.724919:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc38:0x0]: returning size 11991 00000004:00200000:2.0:1716999787.724922:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999787.724935:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.724952:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc4fe7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65732 expref: 700 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.724964:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4fee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65732 expref: 699 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.724970:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.724973:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1716999787.724975:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea1c0, rc 0) 00000100:00100000:2.0:1716999787.725003:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+698:11419:x1800404480683072:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 236us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.725009:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45407 00000100:00100000:1.0:1716999787.725413:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec24050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+697:11420:x1800404480683008:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3148us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.725420:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9050 00000100:00100000:3.0:1716999787.728768:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.729091:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.729146:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683136 00000100:00100000:1.0:1716999787.729153:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683136 00000100:00100000:1.0:1716999787.729185:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683200 00000100:00100000:1.0:1716999787.729187:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683200 00000100:00100000:1.0:1716999787.729199:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45408 00000100:00100000:1.0:1716999787.729204:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+698:11420:x1800404480683136:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.729217:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.729231:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc4ff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65739 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.729269:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc4ffc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.729279:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc4ffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.729287:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc4ffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999787.729290:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45409 00000100:00100000:2.0:1716999787.729295:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+699:11419:x1800404480683200:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.729298:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc5003 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.729302:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.729303:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc5003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.729309:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc5003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.729310:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc500a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65740 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.729331:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5011 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729338:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729343:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729351:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5018 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729356:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729360:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.729361:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc4ffc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.729366:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc4ffc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.729371:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc4ffc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.729376:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.729379:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc4ffc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.729384:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc4ffc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.729392:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.729395:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.729398:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc4ffc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.729402:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc4ffc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.729413:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc5003 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.729415:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc501f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.729417:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc5003 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.729420:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc501f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.729422:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc5003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.729424:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc501f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.729426:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.729428:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc5003 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.729432:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc5003 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.729437:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff8800a660c300) 00010000:00010000:1.0:1716999787.729439:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.729441:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc5003 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00200000:2.0:1716999787.729443:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc38:0x0]: returning size 11991 00010000:00010000:1.0:1716999787.729445:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc5003 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00200000:2.0:1716999787.729446:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999787.729454:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc501f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729460:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc501f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729464:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5011 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729468:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5011 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.729471:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc4ff5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65739 expref: 700 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.729472:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5011 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729475:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaf40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.729477:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5011 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.729477:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc4ff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65739 expref: 700 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.729481:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5011 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.729485:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364d80, rc 0) 00010000:00010000:2.0:1716999787.729487:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.729488:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.729491:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5011 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729494:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5011 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729501:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729505:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5018 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729509:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729512:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9440 already unused, calling callback (ffffffffa1389790) 00000100:00100000:1.0:1716999787.729513:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+699:11420:x1800404480683136:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 309us (750us total) trans 0 rc 301/301 00010000:00010000:2.0:1716999787.729514:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729517:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5018 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.729519:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45408 00010000:00010000:2.0:1716999787.729521:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff8800941a3300) 00010000:00010000:2.0:1716999787.729523:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.729524:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5018 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729528:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.729542:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc500a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65740 expref: 699 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.729550:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc501f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65740 expref: 698 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.729554:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.729556:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999787.729557:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb840, rc 0) 00000100:00100000:2.0:1716999787.729572:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+698:11419:x1800404480683200:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 278us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.729577:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45409 00000100:00100000:3.0:1716999787.733062:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.733123:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683328 00000100:00100000:0.0:1716999787.733129:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683328 00000100:00100000:0.0:1716999787.733166:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45410 00000100:00100000:0.0:1716999787.733171:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+698:11419:x1800404480683328:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.733203:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999787.733219:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc501f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65740 expref: 698 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.733242:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc4fee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65732 expref: 697 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.733459:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:0.0:1716999787.733463:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.733491:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5026 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.733501:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.733507:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999787.734172:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008ea7c000 reply state ffff88009c08d000 transno 4294985960 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.734179:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.736975:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+698:11419:x1800404480683328:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3797us (3912us total) trans 4294985960 rc 0/0 00000100:00100000:0.0:1716999787.736984:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45410 00000100:00100000:1.0:1716999787.737125:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.737443:0:4162:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683456 00000100:00100000:2.0:1716999787.737450:0:4162:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683456 00000100:00100000:2.0:1716999787.737483:0:4162:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 613 00000100:00100000:2.0:1716999787.737488:0:4162:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+698:11420:x1800404480683456:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999787.737518:0:4162:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999787.737536:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc4fa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65716 expref: 698 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.737548:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:2.0:1716999787.737555:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc4fe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6572b expref: 697 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.737563:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.737565:0:4162:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.737611:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc502d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.737619:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc502d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.737625:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc502d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.737634:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc5034 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.737639:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc5034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.737643:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc5034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.737655:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc503b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.737659:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc503b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.737663:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc503b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.737728:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.737733:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.737738:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000040:00080000:2.0:1716999787.738022:0:4162:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11419, 224 off2042520 00000004:00010000:2.0:1716999787.738107:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df0a80 reply state ffff880092496000 transno 4294985961 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:2.0:1716999787.738113:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999787.738116:0:4162:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc502d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.738120:0:4162:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc502d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.738125:0:4162:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc502d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.738129:0:4162:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.738132:0:4162:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc502d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.738137:0:4162:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc502d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.738142:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.738144:0:4162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.738146:0:4162:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc502d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.738150:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc502d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00000004:00010000:2.0:1716999787.738156:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df0a80 reply state ffff880092496000 transno 4294985961 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc5034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:2.0:1716999787.738160:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00000004:00010000:2.0:1716999787.738162:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df0a80 reply state ffff880092496000 transno 4294985961 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc503b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:2.0:1716999787.738166:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:2.0:1716999787.738742:0:4162:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+698:11420:x1800404480683456:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1251us (1615us total) trans 4294985961 rc 0/0 00000100:00100000:2.0:1716999787.738748:0:4162:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 613 00010000:00010000:2.0:1716999787.740018:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5026 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.740026:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5026 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.740030:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5026 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.740034:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.740037:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5026 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.740042:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5026 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.740051:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.740053:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.740056:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5026 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.740060:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5026 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999787.746148:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999787.746267:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc503b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746277:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc503b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746283:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc503b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746288:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.746291:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc503b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746297:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc503b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746308:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xb9ed2257 (ffff880092a37000) 00010000:00010000:2.0:1716999787.746311:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.746313:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc503b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746317:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc503b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xb9ed2257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746332:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc5034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746335:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc5034 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746339:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc5034 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746344:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ead00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.746347:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc5034 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746351:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc5034 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746356:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff8800941a3400) 00010000:00010000:2.0:1716999787.746358:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.746360:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc5034 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746364:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc5034 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746374:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746378:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.746382:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00000100:00100000:3.0:1716999787.746424:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.746476:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683520 00000100:00100000:0.0:1716999787.746484:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683520 00000100:00100000:0.0:1716999787.746514:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45411 00000100:00100000:0.0:1716999787.746519:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+697:11420:x1800404480683520:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.746577:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.746589:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65747 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.746631:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5050 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746640:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746648:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746656:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5057 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746662:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746666:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746750:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc505e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746757:0:6823:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.746761:0:6823:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc505e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746773:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.746778:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 5/0,0 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 4162 initiator: MDT0 00010000:00010000:0.0:1716999787.746784:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:0.0:1716999787.746786:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1716999787.746787:0:6823:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc505e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746793:0:6823:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746797:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc505e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746806:0:6823:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746812:0:6823:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746828:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:0.0:1716999787.746854:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc39:0x0]: returning size 11991 00000004:00200000:0.0:1716999787.746858:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.746870:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746877:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746899:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746903:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5050 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746908:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746911:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.746914:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746918:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5050 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746924:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.746925:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.746928:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746932:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746939:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746943:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5057 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746951:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746955:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.746957:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746961:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5057 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746966:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff880094791100) 00010000:00010000:0.0:1716999787.746968:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.746970:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5057 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746974:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5057 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.746993:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65747 expref: 699 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.747001:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc505e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65747 expref: 698 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.747007:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:0.0:1716999787.747009:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.747011:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f840, rc 0) 00000100:00100000:0.0:1716999787.747047:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+698:11420:x1800404480683520:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 527us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.747052:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45411 00010000:00010000:2.0:1716999787.747211:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.747213:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.747218:0:3204:0:(ldlm_request.c:1631:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:2.0:1716999787.747220:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999787.747224:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5042 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 4162 initiator: MDT0 00000100:00100000:1.0:1716999787.747421:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683584 00000100:00100000:1.0:1716999787.747426:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683584 00000100:00100000:1.0:1716999787.747446:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9964 00000100:00100000:1.0:1716999787.747451:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+92:1958:x1800404480683584:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:1.0:1716999787.747573:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1716999787.747576:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb mtime from disk: 1716999764 -> 1716999776 00002000:00010000:1.0:1716999787.747578:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb atime from disk: 1716999768 -> 1716999758 00002000:00010000:1.0:1716999787.747579:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb ctime from disk: 1716999788 -> 1716999788 00002000:00010000:1.0:1716999787.747581:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1716999787.747613:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+93:1958:x1800404480683584:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 161us (1189us total) trans 4294970136 rc 0/0 00000100:00100000:1.0:1716999787.747619:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9964 00000100:00100000:0.0:1716999787.749845:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.750025:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683712 00000100:00100000:2.0:1716999787.750031:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683712 00000100:00100000:2.0:1716999787.750056:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45412 00000100:00100000:2.0:1716999787.750062:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+697:11419:x1800404480683712:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:2.0:1716999787.750100:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5065 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.750115:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5065 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.750125:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5065 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.750139:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5065 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.750144:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5065 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.750149:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5065 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.750153:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.750156:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5065 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.750162:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5065 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.750169:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.750172:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1716999787.750175:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5065 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.750179:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5065 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.750785:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+697:11419:x1800404480683712:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 721us (942us total) trans 0 rc -22/-22 00000100:00100000:2.0:1716999787.750794:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45412 00000100:00100000:3.0:1716999787.751240:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.751693:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683776 00000100:00100000:0.0:1716999787.751698:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683776 00000100:00100000:0.0:1716999787.752255:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45413 00000100:00100000:0.0:1716999787.752261:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+697:11420:x1800404480683776:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.752272:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.752284:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc506c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6574e expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.752316:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5073 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752325:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5073 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752332:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5073 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752341:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc507a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752346:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc507a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752351:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc507a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752398:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5073 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752404:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5073 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752409:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5073 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752414:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.752416:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5073 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752422:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5073 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752429:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.752432:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.752435:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5073 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752439:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5073 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752446:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc507a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752451:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc507a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752455:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc507a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752459:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c6c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.752461:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc507a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752465:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc507a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752470:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x53504954 (ffff880094791d00) 00010000:00010000:0.0:1716999787.752472:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.752474:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc507a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752478:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc507a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x53504954 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.752503:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc506c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6574e expref: 698 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.752509:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc506c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6574e expref: 698 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.752516:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216e400, rc 0) 00000100:00100000:0.0:1716999787.752542:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+697:11420:x1800404480683776:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 282us (1302us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999787.752548:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45413 00000100:00100000:2.0:1716999787.754363:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.754401:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.754412:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683840 00000100:00100000:1.0:1716999787.754417:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683840 00000100:00100000:1.0:1716999787.754439:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683904 00000100:00100000:1.0:1716999787.754441:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683904 00000100:00100000:1.0:1716999787.754460:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45414 00000100:00100000:1.0:1716999787.754465:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+698:11420:x1800404480683840:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:0.0:1716999787.754471:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45415 00010000:00010000:1.0:1716999787.754476:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1716999787.754476:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+698:11419:x1800404480683904:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.754484:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.754487:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5081 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65755 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.754492:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5088 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6575c expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.754508:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65755 expref: 700 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.754518:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65755 expref: 700 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.754521:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc508f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.754524:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.754527:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.754527:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc508f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.754529:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364d80, rc 0) 00010000:00010000:0.0:1716999787.754533:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc508f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.754554:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+700:11420:x1800404480683840:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 88us (195us total) trans 0 rc 0/0 00000004:00200000:0.0:1716999787.754557:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc38:0x0]: returning size 11991 00000100:00100000:1.0:1716999787.754559:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45414 00000004:00200000:0.0:1716999787.754560:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.754571:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc508f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.754585:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5088 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6575c expref: 700 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.754595:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc508f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6575c expref: 699 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.754600:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:0.0:1716999787.754602:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1716999787.754604:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216e640, rc 0) 00000100:00100000:0.0:1716999787.754620:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+699:11419:x1800404480683904:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 144us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.754625:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45415 00000100:00100000:3.0:1716999787.758218:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.758390:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.758482:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480683968 00000100:00100000:2.0:1716999787.758489:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480683968 00000100:00100000:1.0:1716999787.758558:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480684032 00000100:00100000:1.0:1716999787.758562:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480684032 00000100:00100000:2.0:1716999787.758636:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45416 00000100:00100000:2.0:1716999787.758643:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+700:11419:x1800404480683968:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.758657:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.758670:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5096 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65763 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.758709:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc509d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758719:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc509d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758728:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc509d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758739:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc50a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758744:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc50a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758749:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc50a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758840:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc50ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758854:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc50ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.758858:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9051 00010000:00010000:2.0:1716999787.758860:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc50ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.758863:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+701:11420:x1800404480684032:12345-192.168.203.3@tcp:37:dbench.0 00000004:00200000:2.0:1716999787.758899:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc38:0x0]: returning size 11991 00000004:00200000:2.0:1716999787.758902:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999787.758915:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc50ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758922:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc50ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758928:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc509d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758933:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc509d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758937:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc509d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758941:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ead00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.758944:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc509d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758949:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc509d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758957:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999787.758959:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.758962:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc509d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758966:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc509d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758974:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc50a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758977:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc50a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758981:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc50a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758984:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.758986:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc50a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758989:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc50a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758993:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff8800941a3400) 00010000:00010000:2.0:1716999787.758995:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.758996:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc50a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.758999:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc50a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.759016:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5096 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65763 expref: 702 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.759024:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc50ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65763 expref: 701 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.759033:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.759034:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999787.759036:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea1c0, rc 0) 00000100:00100000:2.0:1716999787.759070:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+701:11419:x1800404480683968:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 427us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.759076:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45416 00000100:00100000:3.0:1716999787.761020:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.761075:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480684160 00000100:00100000:0.0:1716999787.761081:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480684160 00000100:00100000:0.0:1716999787.761114:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45417 00000100:00100000:0.0:1716999787.761120:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+702:11419:x1800404480684160:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.761149:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999787.761164:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc50ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65763 expref: 702 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.761177:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc508f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6575c expref: 701 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.761187:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:0.0:1716999787.761191:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.761212:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc50b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.761220:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc50b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.761227:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc50b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999787.761460:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e443100 reply state ffff88009c08b000 transno 4294985962 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc50b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.761467:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.761511:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+702:11419:x1800404480684160:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 389us (494us total) trans 4294985962 rc 0/0 00000100:00100000:0.0:1716999787.761516:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45417 00010000:00010000:2.0:1716999787.762869:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc50b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.762876:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc50b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.762980:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc50b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.762985:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fa80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.762989:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc50b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.762994:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc50b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.763003:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999787.763005:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.763007:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc50b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.763011:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc50b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.763853:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+699:11420:x1800404480684032:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4986us (5460us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.763862:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9051 00000100:00100000:3.0:1716999787.764011:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.764191:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480684224 00000100:00100000:0.0:1716999787.764197:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480684224 00000100:00100000:0.0:1716999787.764225:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9965 00000100:00100000:0.0:1716999787.764229:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+93:1958:x1800404480684224:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:0.0:1716999787.764340:0:17700:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1716999787.764343:0:17700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb mtime from disk: 1716999776 -> 1716999764 00002000:00010000:0.0:1716999787.764345:0:17700:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb atime from disk: 1716999758 -> 1716999748 00002000:00010000:0.0:1716999787.764347:0:17700:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb ctime from disk: 1716999788 -> 1716999788 00002000:00010000:0.0:1716999787.764348:0:17700:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x240000400:0x600:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1716999787.764375:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+94:1958:x1800404480684224:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 144us (364us total) trans 4294970137 rc 0/0 00000100:00100000:0.0:1716999787.764380:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9965 00000100:00100000:3.0:1716999787.767604:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.767673:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480684288 00000100:00100000:2.0:1716999787.767680:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480684288 00000100:00100000:2.0:1716999787.767707:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45418 00000100:00100000:2.0:1716999787.767713:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+699:11420:x1800404480684288:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.767729:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.767742:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc50b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6576a expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.767785:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc50c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767795:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc50c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767803:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc50c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767840:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc50c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767846:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc50c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767852:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc50c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767918:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc50c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767924:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc50c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767929:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc50c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767937:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.767940:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc50c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767945:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc50c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767954:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.767957:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.767960:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc50c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767964:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc50c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767973:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc50c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767978:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc50c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767982:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc50c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767986:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaf40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.767987:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc50c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767992:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc50c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.767997:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x764e078d (ffff880092a37000) 00010000:00010000:2.0:1716999787.767999:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.768001:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc50c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.768005:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc50c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.768032:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc50b9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6576a expref: 700 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.768038:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc50b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6576a expref: 700 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.768045:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8fc0, rc 0) 00000100:00100000:2.0:1716999787.768073:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+699:11420:x1800404480684288:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 360us (475us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.768078:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45418 00000100:00100000:3.0:1716999787.768320:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.768584:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480684352 00000100:00100000:0.0:1716999787.768588:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480684352 00000100:00100000:0.0:1716999787.768615:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45419 00000100:00100000:0.0:1716999787.768619:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+699:11419:x1800404480684352:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.768626:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.768635:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc50ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65771 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.768658:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc50d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768665:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc50d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768671:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc50d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768680:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc50dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768685:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc50dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768690:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc50dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768749:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc50e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768756:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc50e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768761:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc50e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:0.0:1716999787.768782:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2d:0x0]: returning size 15360 00000004:00200000:0.0:1716999787.768785:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.768796:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc50e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768802:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc50e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768807:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc50d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768811:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc50d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768829:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc50d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768833:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.768835:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc50d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768840:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc50d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768847:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.768849:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.768851:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc50d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768856:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc50d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768864:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc50dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768868:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc50dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768873:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc50dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768877:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c6c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.768905:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc50dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768909:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc50dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768915:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xd4e4194e (ffff880094791e00) 00010000:00010000:0.0:1716999787.768917:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.768919:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc50dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768924:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc50dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.768941:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc50ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65771 expref: 701 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.768949:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc50e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65771 expref: 700 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.768958:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:0.0:1716999787.768960:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.768962:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216e1c0, rc 0) 00000100:00100000:0.0:1716999787.768981:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+700:11419:x1800404480684352:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 362us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.768987:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45419 00000100:00100000:3.0:1716999787.773874:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.774056:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480684480 00000100:00100000:0.0:1716999787.774063:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480684480 00000100:00100000:0.0:1716999787.774099:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9052 00000100:00100000:0.0:1716999787.774105:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+700:11419:x1800404480684480:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999787.774340:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11420, 168 off2042688 00000100:00100000:0.0:1716999787.774435:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+701:11419:x1800404480684480:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 330us (565us total) trans 4294985963 rc 0/0 00000100:00100000:0.0:1716999787.774442:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9052 00000100:00100000:1.0:1716999787.774550:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.774599:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480684608 00000100:00100000:1.0:1716999787.774602:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480684608 00000100:00100000:1.0:1716999787.774620:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45420 00000100:00100000:1.0:1716999787.774625:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+701:11420:x1800404480684608:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.774633:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.774636:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999787.774653:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5081 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65755 expref: 701 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.774668:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.774671:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.774686:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc50ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65778 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.774760:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc50f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.774769:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc50f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.774776:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc50f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.774785:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc50f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.774790:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc50f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.774795:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc50f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:1.0:1716999787.775115:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x602:0x0], index 1: 0 00000040:00080000:1.0:1716999787.775160:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11421, 184 off2042872 00010000:00010000:1.0:1716999787.775230:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc50ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.775236:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc50ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.775245:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc50ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.775265:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc50f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.775270:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc50f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.775275:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc50f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.775280:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.775283:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc50f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.775289:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc50f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.775295:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.775297:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.775299:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc50f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.775304:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc50f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999787.775311:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df3480 reply state ffff880091992000 transno 4294985964 ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc50f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999787.775317:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999787.775331:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc50ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65778 expref: 703 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.775343:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc50ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65778 expref: 702 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.775348:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3b:0x0].0x0 (ffff880131c40b00) 00010000:00010000:1.0:1716999787.775350:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.775352:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365440, rc 0) 00000100:00100000:1.0:1716999787.775376:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+703:11420:x1800404480684608:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 751us (826us total) trans 4294985964 rc 0/0 00000100:00100000:1.0:1716999787.775382:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45420 00000100:00100000:1.0:1716999787.779624:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.779694:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999787.779713:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc50f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.779722:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc50f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.779728:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc50f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.779733:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.779736:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc50f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.779743:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc50f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999787.779748:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480684800 00000100:00100000:3.0:1716999787.779755:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480684800 00010000:00010000:2.0:1716999787.779758:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x764e078d (ffff880131c40d00) 00010000:00010000:2.0:1716999787.779761:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.779764:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc50f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.779773:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc50f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999787.779796:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9966 00000100:00100000:0.0:1716999787.779939:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480684736 00000100:00100000:0.0:1716999787.779942:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480684736 00000100:00100000:0.0:1716999787.779960:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45421 00000100:00100000:0.0:1716999787.779966:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+702:11419:x1800404480684736:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:3.0:1716999787.780108:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+94:1959:x1800404480684800:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.780120:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.780134:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090c97cc0/0x6d188eabd8dc510d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6577f expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999787.780156:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x602:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999787.780171:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.780172:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.780178:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c97cc0/0x6d188eabd8dc510d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6577f expref: 95 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.780189:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090c97cc0/0x6d188eabd8dc510d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6577f expref: 95 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.780197:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97cc0, rc 0) 00000100:00100000:3.0:1716999787.780234:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+95:1959:x1800404480684800:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 432us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.780239:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9966 00010000:00010000:0.0:1716999787.780303:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999787.780316:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc50e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65771 expref: 702 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.780328:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc3fe8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc2d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65246 expref: 701 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.780344:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc3fbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc2d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65238 expref: 700 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.780351:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff88009330d100) 00010000:00010000:0.0:1716999787.780357:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.780373:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5114 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.780381:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5114 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.780387:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5114 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.780395:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc511b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.780400:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc511b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.780405:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc511b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781197:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5122 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781205:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5122 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781211:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5122 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:0.0:1716999787.781578:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1479, 64 off102912 00000040:00080000:0.0:1716999787.781595:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11422, 184 off2043056 00010000:00010000:0.0:1716999787.781636:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5129 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781642:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781648:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781653:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5129 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781657:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5129 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781661:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5129 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781665:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5129 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781668:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999787.781670:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5129 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781675:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5129 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781681:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff880094791d00) 00010000:00010000:0.0:1716999787.781683:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999787.781684:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5129 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781688:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5129 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781704:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5122 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781708:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5122 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781711:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5122 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781714:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.781716:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5122 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781720:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5122 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781724:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2d:0x0].0x0 (ffff880094791d00) 00010000:00010000:0.0:1716999787.781725:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999787.781727:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5122 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781730:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5122 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781755:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5114 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781758:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5114 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781762:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5114 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781765:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fa80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.781767:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5114 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781771:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5114 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781775:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.781776:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.781778:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5114 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.781781:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5114 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999787.781786:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df0e00 reply state ffff88009c08e000 transno 4294985965 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc511b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.781791:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.782896:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+701:11419:x1800404480684736:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2914us (3262us total) trans 4294985965 rc 0/0 00000100:00100000:0.0:1716999787.782903:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45421 00000100:00100000:1.0:1716999787.784117:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.784135:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480684928 00000100:00100000:1.0:1716999787.784140:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480684928 00000100:00100000:1.0:1716999787.784161:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9053 00000100:00100000:1.0:1716999787.784166:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+701:11420:x1800404480684928:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999787.784454:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11423, 168 off2043224 00000001:00080000:1.0:1716999787.784458:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985966 00000100:00100000:1.0:1716999787.784513:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+703:11420:x1800404480684928:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 346us (397us total) trans 4294985967 rc 0/0 00000100:00100000:1.0:1716999787.784518:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9053 00000020:00080000:1.0:1716999787.784521:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999787.787449:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999787.787793:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc511b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.787801:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc511b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.787806:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc511b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.787810:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216eac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.787824:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc511b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.787834:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc511b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.787847:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xd4e4194e (ffff880094791f00) 00010000:00010000:0.0:1716999787.787849:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.787853:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc511b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.787858:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc511b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.787969:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.788014:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480684992 00000100:00100000:0.0:1716999787.788020:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480684992 00000100:00100000:0.0:1716999787.788038:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480685120 00000100:00100000:0.0:1716999787.788041:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480685120 00000100:00100000:0.0:1716999787.788052:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45422 00000100:00100000:0.0:1716999787.788057:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+703:11419:x1800404480684992:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.788074:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.788084:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5130 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65786 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.788121:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5137 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788130:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5137 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788137:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5137 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788146:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc513e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788151:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc513e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788156:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc513e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788227:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788233:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788238:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:0.0:1716999787.788258:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc34:0x0]: returning size 12006 00000004:00200000:0.0:1716999787.788261:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.788272:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788279:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788284:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5137 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788288:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5137 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788293:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5137 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788297:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.788299:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5137 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788304:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5137 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788310:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.788312:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.788314:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5137 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788318:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5137 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788325:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc513e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788329:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc513e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788334:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc513e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788337:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.788339:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc513e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788343:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc513e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788348:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xe7082257 (ffff880094791800) 00010000:00010000:0.0:1716999787.788349:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.788351:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc513e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788355:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc513e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788373:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5130 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65786 expref: 705 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.788381:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65786 expref: 704 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.788386:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:0.0:1716999787.788388:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.788390:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c480, rc 0) 00000100:00100000:0.0:1716999787.788432:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+704:11419:x1800404480684992:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 374us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.788438:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45422 00000100:00100000:0.0:1716999787.788450:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45423 00000100:00100000:0.0:1716999787.788453:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+703:11420:x1800404480685120:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.788472:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999787.788482:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc50ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65778 expref: 703 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.788490:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3b:0x0].0x0 (ffff880131c40b00) 00010000:00010000:0.0:1716999787.788494:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999787.788506:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc514c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788512:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc514c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788517:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc514c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788526:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5153 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788531:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788535:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788581:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc515a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788587:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc515a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.788592:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc515a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999787.788962:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1480, 64 off102976 00000040:00080000:0.0:1716999787.788977:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11424, 184 off2043408 00010000:00010000:0.0:1716999787.789019:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5161 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789025:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789030:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5161 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789035:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5161 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789039:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5161 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789047:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5161 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789051:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5161 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789054:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999787.789056:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5161 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789060:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5161 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789065:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3b:0x0].0x0 (ffff880094791a00) 00010000:00010000:0.0:1716999787.789066:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999787.789068:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5161 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789071:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5161 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789081:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc515a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789084:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc515a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789088:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc515a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789091:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.789093:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc515a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789100:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc515a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789104:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3b:0x0].0x0 (ffff880094791a00) 00010000:00010000:0.0:1716999787.789105:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999787.789107:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc515a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789110:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc515a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789138:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc514c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789142:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc514c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789146:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc514c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789149:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c6c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.789150:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc514c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789154:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc514c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789159:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.789160:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.789162:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc514c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.789165:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc514c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999787.789170:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800889fca80 reply state ffff88012cbbb000 transno 4294985968 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.789175:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.789200:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+704:11420:x1800404480685120:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 744us (1230us total) trans 4294985968 rc 0/0 00000100:00100000:0.0:1716999787.789205:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45423 00000100:00100000:2.0:1716999787.792789:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999787.793758:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.793767:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5153 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.793773:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.793777:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.793780:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.793786:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5153 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.793797:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x764e078d (ffff880094791e00) 00010000:00010000:0.0:1716999787.793800:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.793803:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5153 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999787.793808:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5153 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x764e078d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999787.794055:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480685248 00000100:00100000:3.0:1716999787.794062:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480685248 00000100:00100000:3.0:1716999787.794100:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45424 00000100:00100000:3.0:1716999787.794106:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+703:11420:x1800404480685248:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999787.794146:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999787.794158:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc505e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65747 expref: 703 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.794179:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:3.0:1716999787.794181:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999787.794211:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5168 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.794223:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.794230:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00010000:3.0:1716999787.794458:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800889fd180 reply state ffff8800b536f000 transno 4294985969 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999787.794464:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999787.794516:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+704:11420:x1800404480685248:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 410us (1734us total) trans 4294985969 rc 0/0 00000100:00100000:3.0:1716999787.794522:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45424 00000100:00100000:3.0:1716999787.796791:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.797319:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480685376 00000100:00100000:1.0:1716999787.797326:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480685376 00000100:00100000:1.0:1716999787.797355:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9054 00000100:00100000:1.0:1716999787.797361:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+704:11419:x1800404480685376:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999787.797586:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11425, 168 off2043576 00000100:00100000:1.0:1716999787.797674:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+705:11419:x1800404480685376:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 312us (886us total) trans 4294985970 rc 0/0 00000100:00100000:1.0:1716999787.797680:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9054 00000100:00100000:2.0:1716999787.798211:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.798259:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480685440 00000100:00100000:3.0:1716999787.798263:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480685440 00000100:00100000:3.0:1716999787.798283:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9967 00000100:00100000:3.0:1716999787.798288:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+95:1958:x1800404480685440:12345-192.168.203.3@tcp:2:dbench.0 00010000:00010000:0.0:1716999787.798347:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5168 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.798356:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5168 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.798361:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5168 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.798365:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.798368:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5168 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.798374:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5168 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.798384:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:0.0:1716999787.798386:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.798389:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5168 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00002000:00010000:3.0:1716999787.798393:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb size from disk: 0 -> 0 00010000:00010000:0.0:1716999787.798393:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5168 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00002000:00010000:3.0:1716999787.798395:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb mtime from disk: 1716999764 -> 1716999776 00002000:00010000:3.0:1716999787.798397:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb atime from disk: 1716999768 -> 1716999778 00002000:00010000:3.0:1716999787.798399:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb ctime from disk: 1716999788 -> 1716999788 00002000:00010000:3.0:1716999787.798400:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1716999787.798417:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+96:1958:x1800404480685440:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 129us (206us total) trans 4294970177 rc 0/0 00000100:00100000:3.0:1716999787.798427:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9967 00000100:00100000:2.0:1716999787.799928:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.799965:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.800025:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480685696 00000100:00100000:1.0:1716999787.800025:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480685632 00000100:00100000:3.0:1716999787.800030:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480685696 00000100:00100000:1.0:1716999787.800030:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480685632 00000100:00100000:3.0:1716999787.800236:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45425 00000100:00100000:3.0:1716999787.800242:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+705:11420:x1800404480685632:12345-192.168.203.3@tcp:55:dbench.0 00000100:00100000:1.0:1716999787.800242:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45426 00000100:00100000:1.0:1716999787.800246:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+705:11419:x1800404480685696:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999787.800362:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1716999787.800366:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc516f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.800375:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc516f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.800375:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc34:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65786 expref: 705 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.800382:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc516f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.800387:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc493b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc34:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65533 expref: 704 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.800395:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc516f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.800395:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc4903 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc34:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65525 expref: 703 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.800399:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc516f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.800404:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc516f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.800406:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff88009330d700) 00010000:00010000:3.0:1716999787.800408:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.800410:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc516f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.800412:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999787.800414:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc516f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.800419:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:3.0:1716999787.800420:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1716999787.800422:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc516f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.800424:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5176 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.800427:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc516f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999787.800430:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5176 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.800435:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5176 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.800442:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc517d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.800446:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc517d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.800451:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc517d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.800829:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5184 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.800836:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5184 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.800842:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5184 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999787.801038:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+702:11420:x1800404480685632:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 794us (1111us total) trans 0 rc -22/-22 00000100:00100000:3.0:1716999787.801044:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45425 00000040:00080000:0.0:1716999787.801934:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1479, 64 off102912 00000040:00080000:0.0:1716999787.801952:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11426, 184 off2043760 00010000:00010000:0.0:1716999787.802002:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc518b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802010:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc518b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802018:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc518b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802023:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc518b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802028:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc518b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802031:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc518b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802035:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc518b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802040:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fcc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999787.802042:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc518b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802048:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc518b lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802055:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff880094791f00) 00010000:00010000:0.0:1716999787.802057:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999787.802060:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc518b lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802065:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc518b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802082:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5184 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802087:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5184 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802092:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5184 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802095:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.802097:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5184 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802102:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5184 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802107:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc34:0x0].0x0 (ffff880094791f00) 00010000:00010000:0.0:1716999787.802109:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999787.802111:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5184 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802114:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5184 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802148:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5176 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802153:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5176 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802157:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5176 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802161:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c6c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.802163:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5176 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802171:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5176 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802177:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:0.0:1716999787.802179:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.802181:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5176 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.802185:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5176 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999787.802192:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800889fea00 reply state ffff88012cbbf000 transno 4294985971 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc517d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.802197:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999787.802249:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+703:11419:x1800404480685696:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2000us (2282us total) trans 4294985971 rc 0/0 00000100:00100000:0.0:1716999787.802256:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45426 00000100:00100000:2.0:1716999787.804610:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999787.804731:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc517d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.804739:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc517d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.804744:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc517d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.804748:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.804752:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc517d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.804757:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc517d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.804767:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xe7082257 (ffff880094791800) 00010000:00010000:1.0:1716999787.804769:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.804772:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc517d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.804777:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc517d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.804827:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480685760 00000100:00100000:0.0:1716999787.804833:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480685760 00000100:00100000:0.0:1716999787.804867:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45427 00000100:00100000:0.0:1716999787.804873:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+702:11420:x1800404480685760:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.804919:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.804930:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5192 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6578d expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.804970:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5199 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.806102:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.806113:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:0.0:1716999787.806140:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc39:0x0]: returning size 11991 00000004:00200000:0.0:1716999787.806143:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.806155:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.806172:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6578d expref: 704 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.806181:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5199 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6578d expref: 703 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.806187:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:0.0:1716999787.806189:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1716999787.806191:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f180, rc 0) 00000100:00100000:0.0:1716999787.806237:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+703:11420:x1800404480685760:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1363us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.806244:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45427 00000100:00100000:3.0:1716999787.810935:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.811963:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480685824 00000100:00100000:0.0:1716999787.811970:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480685824 00000100:00100000:0.0:1716999787.812012:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45428 00000100:00100000:0.0:1716999787.812019:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+703:11420:x1800404480685824:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.812038:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.812054:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc51a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65794 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.812102:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc51a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812118:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc51a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812127:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc51a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812135:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc51ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812140:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc51ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812144:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc51ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812224:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc51b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812230:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc51b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812235:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc51b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:0.0:1716999787.812259:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc39:0x0]: returning size 11991 00000004:00200000:0.0:1716999787.812262:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999787.812273:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc51b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812280:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc51b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812286:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc51a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812291:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc51a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812296:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc51a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812301:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fa80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.812304:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc51a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812309:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc51a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812318:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999787.812320:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.812323:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc51a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812327:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc51a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812336:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc51ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812340:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc51ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812344:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc51ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812348:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999787.812350:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc51ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812354:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc51ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812360:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff880094791100) 00010000:00010000:0.0:1716999787.812361:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999787.812363:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc51ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812367:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc51ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999787.812388:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc51a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65794 expref: 705 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.812397:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc51b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65794 expref: 704 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.812402:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:0.0:1716999787.812404:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999787.812406:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c240, rc 0) 00000100:00100000:0.0:1716999787.812452:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+704:11420:x1800404480685824:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 433us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999787.812457:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45428 00000100:00100000:0.0:1716999787.814420:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.814582:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686016 00000100:00100000:2.0:1716999787.814588:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686016 00000100:00100000:2.0:1716999787.814625:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45429 00000100:00100000:2.0:1716999787.814631:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+704:11420:x1800404480686016:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999787.814662:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999787.814678:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc51b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65794 expref: 704 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.814704:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f180/0x6d188eabd8dc5199 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6578d expref: 703 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.814712:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:2.0:1716999787.814716:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.814743:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc51bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.814752:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc51bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.814758:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc51bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999787.815047:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012b7f5f80 reply state ffff88012ca97000 transno 4294985972 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc51bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.815053:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999787.815113:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+704:11420:x1800404480686016:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 481us (696us total) trans 4294985972 rc 0/0 00000100:00100000:2.0:1716999787.815119:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45429 00000100:00100000:0.0:1716999787.818806:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.818853:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480685888 00000100:00100000:2.0:1716999787.818861:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480685888 00000100:00100000:2.0:1716999787.818914:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45430 00000100:00100000:2.0:1716999787.818920:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+704:11419:x1800404480685888:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.818938:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.818952:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc51c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6579b expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.818991:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc51ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819002:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc51ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819010:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc51ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819023:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc51d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819028:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc51d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819033:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc51d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819091:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc51ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819097:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc51ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819102:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc51ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819107:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.819110:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc51ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819115:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc51ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819123:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999787.819126:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.819129:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc51ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819134:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc51ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819141:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc51d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819146:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc51d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819150:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc51d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819154:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.819156:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc51d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819160:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc51d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819165:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x52a89496 (ffff880092a37900) 00010000:00010000:2.0:1716999787.819167:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.819169:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc51d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819172:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc51d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.819277:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc51c3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6579b expref: 705 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.819284:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc51c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6579b expref: 705 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.819291:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea1c0, rc 0) 00000100:00100000:2.0:1716999787.819347:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+704:11419:x1800404480685888:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 427us (548us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.819356:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45430 00000100:00100000:0.0:1716999787.819443:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999787.819533:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc51bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.819539:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc51bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.819544:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc51bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.819551:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.819554:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc51bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.819559:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc51bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.819565:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999787.819567:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.819569:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc51bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999787.819573:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc51bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999787.819663:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686080 00000100:00100000:2.0:1716999787.819667:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686080 00000100:00100000:2.0:1716999787.820261:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9968 00000100:00100000:2.0:1716999787.820267:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+96:1956:x1800404480686080:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:2.0:1716999787.820395:0:17700:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1716999787.820398:0:17700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb mtime from disk: 1716999776 -> 1716999764 00002000:00010000:2.0:1716999787.820400:0:17700:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb atime from disk: 1716999778 -> 1716999768 00002000:00010000:2.0:1716999787.820402:0:17700:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb ctime from disk: 1716999788 -> 1716999788 00002000:00010000:2.0:1716999787.820404:0:17700:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1716999787.820437:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+97:1956:x1800404480686080:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 169us (993us total) trans 4294970178 rc 0/0 00000100:00100000:2.0:1716999787.820443:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9968 00000100:00100000:0.0:1716999787.821535:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.821664:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686144 00000100:00100000:2.0:1716999787.821669:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686144 00000100:00100000:2.0:1716999787.821731:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45431 00000100:00100000:2.0:1716999787.821739:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+703:11419:x1800404480686144:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.821751:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.821762:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc51d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657a2 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.821781:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc51d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657a2 expref: 704 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.821791:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc51d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657a2 expref: 704 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.821803:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999787.821805:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.821807:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8900, rc 0) 00000100:00100000:2.0:1716999787.821841:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+704:11419:x1800404480686144:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 104us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.821847:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45431 00000100:00100000:0.0:1716999787.824544:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.824589:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.825196:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686208 00000100:00100000:2.0:1716999787.825202:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686208 00000100:00100000:2.0:1716999787.825350:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9055 00000100:00100000:2.0:1716999787.825355:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+704:11419:x1800404480686208:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999787.825874:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686272 00000100:00100000:3.0:1716999787.825891:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686272 00000100:00100000:3.0:1716999787.825914:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45432 00000100:00100000:3.0:1716999787.825919:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+705:11420:x1800404480686272:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.825927:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.825941:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc51df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657a9 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.825979:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc51e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.825989:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc51e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.825998:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc51e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:3.0:1716999787.826519:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc39:0x0]: returning size 11991 00000004:00200000:3.0:1716999787.826523:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999787.826535:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc51e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.826551:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc51df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657a9 expref: 708 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.826566:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc51e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657a9 expref: 707 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.826574:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:3.0:1716999787.826577:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1716999787.826579:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95d40, rc 0) 00000100:00100000:3.0:1716999787.828134:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+707:11420:x1800404480686272:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1990us (3320us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.828141:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45432 00000100:00100000:2.0:1716999787.831728:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+705:11419:x1800404480686208:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 6364us (7182us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.831739:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9055 00000100:00100000:0.0:1716999787.833538:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.833758:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686336 00000100:00100000:3.0:1716999787.833765:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686336 00000100:00100000:3.0:1716999787.835326:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45433 00000100:00100000:3.0:1716999787.835333:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+705:11420:x1800404480686336:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.835348:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.835364:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc51ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657b0 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.835406:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc51f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835417:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc51f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835425:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc51f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835435:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc51fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835440:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc51fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835449:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc51fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835526:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5202 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835532:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835537:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:3.0:1716999787.835559:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc39:0x0]: returning size 11991 00000004:00200000:3.0:1716999787.835563:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999787.835574:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835585:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835590:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc51f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835595:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc51f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835600:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc51f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835604:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c973c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.835607:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc51f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835613:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc51f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835622:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.835625:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.835628:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc51f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835637:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc51f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835647:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc51fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835651:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc51fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835655:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc51fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835658:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.835660:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc51fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835664:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc51fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835669:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff8800939ba100) 00010000:00010000:3.0:1716999787.835671:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.835673:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc51fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.835676:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc51fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.835927:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.836457:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686400 00000100:00100000:1.0:1716999787.836462:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686400 00000100:00100000:1.0:1716999787.836483:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45434 00000100:00100000:1.0:1716999787.836488:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+708:11419:x1800404480686400:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.836496:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.836504:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5209 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657b7 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.836532:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc5210 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836539:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc5210 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836545:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc5210 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836555:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5217 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836560:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836565:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836610:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc5210 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836615:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc5210 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836618:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc5210 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836622:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.836624:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc5210 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836629:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc5210 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836638:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999787.836640:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.836642:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc5210 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836646:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc5210 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836655:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836660:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5217 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836664:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836668:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.836670:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836675:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5217 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836680:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x52a89496 (ffff8800a660c300) 00010000:00010000:1.0:1716999787.836682:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.836684:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5217 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836687:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5217 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.836716:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5209 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657b7 expref: 709 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.836723:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5209 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657b7 expref: 709 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.836730:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365440, rc 0) 00000100:00100000:1.0:1716999787.836765:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+708:11419:x1800404480686400:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 276us (839us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.836770:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45434 00010000:00010000:3.0:1716999787.837587:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc51ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657b0 expref: 707 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.837601:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657b0 expref: 706 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.837607:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:3.0:1716999787.837609:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999787.837612:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96ac0, rc 0) 00000100:00100000:3.0:1716999787.837635:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+706:11420:x1800404480686336:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2303us (4102us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.837640:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45433 00000100:00100000:0.0:1716999787.843687:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.843730:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.843796:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686464 00000100:00100000:3.0:1716999787.843801:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686592 00000100:00100000:1.0:1716999787.843805:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686464 00000100:00100000:3.0:1716999787.843808:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686592 00000100:00100000:1.0:1716999787.843849:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45435 00000100:00100000:3.0:1716999787.843854:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45436 00000100:00100000:1.0:1716999787.843855:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+707:11419:x1800404480686464:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:3.0:1716999787.843859:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+707:11420:x1800404480686592:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.844177:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.844192:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc521e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657be expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.844234:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5225 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.844245:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.844254:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.844264:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc522c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.844269:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc522c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.844273:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc522c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.844293:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1716999787.844307:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657b0 expref: 708 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.844336:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc51e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657a9 expref: 707 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.844339:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.844344:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999787.844345:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5225 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.844347:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.844350:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.844355:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.844358:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.844363:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5225 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.844367:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5233 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.844369:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999787.844372:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.844373:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5233 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.844374:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5225 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.844378:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5225 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.844381:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5233 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.845040:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc522c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.845047:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc522c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.845054:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc522c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.845058:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.845060:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc522c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.845064:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc522c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.845071:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x85ed8f9c (ffff880135ac4500) 00010000:00010000:1.0:1716999787.845074:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.845076:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc522c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.845080:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc522c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.845120:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc521e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657be expref: 706 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.845127:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc521e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657be expref: 706 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.845134:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365440, rc 0) 00000100:00100000:1.0:1716999787.845170:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+705:11419:x1800404480686464:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1315us (1491us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.845176:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45435 00000004:00010000:3.0:1716999787.845335:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135028a80 reply state ffff8800a6cde000 transno 4294985973 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5233 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999787.846182:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999787.846490:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+706:11420:x1800404480686592:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2627us (2756us total) trans 4294985973 rc 0/0 00000100:00100000:2.0:1716999787.846496:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45436 00000100:00100000:0.0:1716999787.849690:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.849840:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686656 00000100:00100000:2.0:1716999787.849847:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686656 00000100:00100000:2.0:1716999787.850237:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45437 00000100:00100000:2.0:1716999787.850244:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+706:11419:x1800404480686656:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.850259:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.850274:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc523a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657c5 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.850317:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5241 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850327:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5241 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850335:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5241 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850345:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5248 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850350:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850354:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850412:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5241 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850418:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5241 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850423:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5241 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850428:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.850431:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5241 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850436:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5241 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850444:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999787.850446:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.850449:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5241 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850454:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5241 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850479:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850484:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5248 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850488:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5248 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850491:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.850493:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5248 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850497:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5248 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850503:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xec6f74b7 (ffff8800941a3300) 00010000:00010000:2.0:1716999787.850505:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.850507:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5248 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850512:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5248 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.850543:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc523a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657c5 expref: 707 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.850549:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc523a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657c5 expref: 707 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.850558:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea1c0, rc 0) 00000100:00100000:2.0:1716999787.850593:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+706:11419:x1800404480686656:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 350us (909us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.850599:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45437 00000100:00100000:0.0:1716999787.850849:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999787.851143:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5233 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.851150:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5233 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.851154:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5233 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.851157:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.851160:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5233 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.851164:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5233 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.851171:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999787.851172:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.851174:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5233 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.851178:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5233 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999787.852193:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686720 00000100:00100000:2.0:1716999787.852200:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686720 00000100:00100000:2.0:1716999787.852555:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9969 00000100:00100000:2.0:1716999787.852562:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+97:1959:x1800404480686720:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:2.0:1716999787.852691:0:17700:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1716999787.852694:0:17700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb mtime from disk: 1716999764 -> 1716999776 00002000:00010000:2.0:1716999787.852696:0:17700:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb atime from disk: 1716999768 -> 1716999758 00002000:00010000:2.0:1716999787.852698:0:17700:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb ctime from disk: 1716999788 -> 1716999788 00002000:00010000:2.0:1716999787.852700:0:17700:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1716999787.852747:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+98:1959:x1800404480686720:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 185us (1897us total) trans 4294970179 rc 0/0 00000100:00100000:2.0:1716999787.852753:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9969 00000100:00100000:0.0:1716999787.853636:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.854187:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686784 00000100:00100000:2.0:1716999787.854193:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686784 00000100:00100000:2.0:1716999787.854216:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45438 00000100:00100000:2.0:1716999787.854221:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+705:11419:x1800404480686784:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.854235:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.854248:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc524f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657cc expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.854288:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5256 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.854300:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5256 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.854309:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5256 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.854318:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc525d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0xd13416e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.854323:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc525d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.854328:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc525d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.854380:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5256 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.854385:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5256 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.854390:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5256 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.854394:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.854397:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5256 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.854402:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5256 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.854410:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999787.854412:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.854415:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5256 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.854419:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5256 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.855182:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc525d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.855189:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc525d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.855193:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc525d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.855197:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.855200:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc525d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.855204:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc525d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.855210:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xd13416e1 (ffff8800941a3300) 00010000:00010000:2.0:1716999787.855212:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.855214:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc525d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.855218:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc525d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.855254:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc524f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657cc expref: 706 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.855261:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc524f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657cc expref: 706 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.855268:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9b00, rc 0) 00000100:00100000:2.0:1716999787.855651:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+705:11419:x1800404480686784:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1428us (2015us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.855657:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45438 00000100:00100000:0.0:1716999787.857179:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.857336:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686912 00000100:00100000:2.0:1716999787.857342:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686912 00000100:00100000:2.0:1716999787.857369:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45439 00000100:00100000:2.0:1716999787.857374:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+705:11420:x1800404480686912:12345-192.168.203.3@tcp:55:dbench.0 00010000:00010000:2.0:1716999787.857411:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5264 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.857421:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5264 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.857429:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5264 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.857445:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5264 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.857450:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5264 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.857455:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5264 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.857460:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.857462:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5264 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.857470:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5264 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.857478:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:2.0:1716999787.857480:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1716999787.857483:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5264 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.857487:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5264 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999787.857939:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+705:11420:x1800404480686912:12345-192.168.203.3@tcp:55:dbench.0 Request processed in 563us (761us total) trans 0 rc -22/-22 00000100:00100000:2.0:1716999787.857946:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45439 00000100:00100000:0.0:1716999787.860257:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.860458:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.860756:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480686976 00000100:00100000:2.0:1716999787.860763:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480686976 00000100:00100000:2.0:1716999787.860794:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480687040 00000100:00100000:2.0:1716999787.860796:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480687040 00000100:00100000:2.0:1716999787.860808:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45440 00000100:00100000:2.0:1716999787.860823:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+706:11419:x1800404480686976:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.860836:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.860849:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc526b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657d3 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.860905:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5272 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.860914:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.860922:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.860933:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc5279 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.860939:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc5279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.860944:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc5279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.860999:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5272 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861005:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5272 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861010:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5272 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861015:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.861018:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5272 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861023:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5272 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861031:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999787.861034:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.861037:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5272 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861041:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5272 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861049:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc5279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861055:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc5279 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861059:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc5279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861062:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.861064:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc5279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861068:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc5279 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861074:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x2253fa11 (ffff8800941a3400) 00010000:00010000:2.0:1716999787.861076:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.861078:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc5279 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861082:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea640/0x6d188eabd8dc5279 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861114:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc526b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657d3 expref: 707 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.861120:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc526b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657d3 expref: 707 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.861127:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb3c0, rc 0) 00000100:00100000:2.0:1716999787.861169:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+706:11419:x1800404480686976:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 355us (1294us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.861177:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45440 00000100:00100000:2.0:1716999787.861189:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45441 00000100:00100000:2.0:1716999787.861192:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+705:11420:x1800404480687040:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.861197:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.861203:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5280 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657da expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.861221:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861227:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861232:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:2.0:1716999787.861251:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc39:0x0]: returning size 11991 00000004:00200000:2.0:1716999787.861254:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999787.861263:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.861273:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5280 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657da expref: 707 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.861281:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657da expref: 706 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.861286:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:2.0:1716999787.861287:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1716999787.861289:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eaf40, rc 0) 00000100:00100000:2.0:1716999787.861301:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+706:11420:x1800404480687040:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 109us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.861306:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45441 00000100:00100000:0.0:1716999787.862768:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.863084:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480687104 00000100:00100000:1.0:1716999787.863090:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480687104 00000100:00100000:1.0:1716999787.863116:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45442 00000100:00100000:1.0:1716999787.863234:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+706:11420:x1800404480687104:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.863267:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.863279:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc528e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657e1 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.863312:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5295 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863325:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5295 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863332:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5295 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863341:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc529c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863345:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc529c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863349:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc529c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863787:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc52a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863795:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc52a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863801:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc52a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999787.863831:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc39:0x0]: returning size 11991 00000004:00200000:1.0:1716999787.863834:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999787.863845:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc52a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863852:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc52a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863857:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5295 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863865:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5295 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863870:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5295 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863874:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.863877:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5295 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863903:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5295 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863911:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.863914:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.863916:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5295 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863920:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5295 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863942:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc529c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863947:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc529c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863951:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc529c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863955:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.863957:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc529c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863965:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc529c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863970:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff880135ac4e00) 00010000:00010000:1.0:1716999787.863972:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.863974:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc529c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863978:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc529c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.863998:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc528e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657e1 expref: 708 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.864006:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc52a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657e1 expref: 707 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.864011:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999787.864013:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.864015:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364fc0, rc 0) 00000100:00100000:1.0:1716999787.864049:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+707:11420:x1800404480687104:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 927us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.864055:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45442 00000100:00100000:0.0:1716999787.864297:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.864582:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480687232 00000100:00100000:1.0:1716999787.864587:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480687232 00000100:00100000:1.0:1716999787.864612:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45443 00000100:00100000:1.0:1716999787.864617:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+707:11419:x1800404480687232:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.864625:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.864627:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999787.864638:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc51d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657a2 expref: 707 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.864647:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999787.864649:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.864656:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc52aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657e8 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.864727:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc52b1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.864734:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc52b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.864739:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc52b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.864747:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc52b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.864752:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc52b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.864757:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc52b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.866064:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.866379:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480687360 00000100:00100000:2.0:1716999787.866384:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480687360 00000100:00100000:2.0:1716999787.866416:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45444 00000100:00100000:2.0:1716999787.866421:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+708:11420:x1800404480687360:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999787.866449:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999787.866463:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc52a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657e1 expref: 708 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.866478:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657da expref: 707 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.866485:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:2.0:1716999787.866487:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.866507:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc52bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.866514:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc52bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.866520:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc52bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:1.0:1716999787.866863:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x602:0x0], index 0: 0 00000040:00080000:1.0:1716999787.866976:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11427, 176 off2043936 00010000:00010000:1.0:1716999787.867067:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc52c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.867074:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc52c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.867081:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc52c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.867103:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc52b1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.867107:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc52b1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.867111:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc52b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.867116:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.867119:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc52b1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.867124:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc52b1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.867130:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999787.867132:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.867134:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc52b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.867138:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc52b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999787.867147:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131c5ad80 reply state ffff880091997000 transno 4294985974 ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc52b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999787.867152:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999787.867169:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc52aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657e8 expref: 708 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.867180:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc52c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657e8 expref: 707 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.867185:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3c:0x0].0x0 (ffff880135ac4200) 00010000:00010000:1.0:1716999787.867187:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999787.867189:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091366880, rc 0) 00000100:00100000:1.0:1716999787.867230:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+708:11419:x1800404480687232:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2611us (2933us total) trans 4294985974 rc 0/0 00000100:00100000:1.0:1716999787.867236:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45443 00000004:00010000:2.0:1716999787.867415:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131c59500 reply state ffff88009c1f7000 transno 4294985975 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc52bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999787.867421:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999787.867465:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+709:11420:x1800404480687360:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1043us (1404us total) trans 4294985975 rc 0/0 00000100:00100000:2.0:1716999787.867470:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45444 00010000:00010000:1.0:1716999787.869547:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc52b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.869555:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc52b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.869559:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc52b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.869563:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.869566:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc52b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.869571:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc52b8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.869579:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x2253fa11 (ffff880135ac4f00) 00010000:00010000:1.0:1716999787.869581:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.869584:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc52b8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.869590:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc52b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.872173:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.872238:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.872295:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480687488 00000100:00100000:3.0:1716999787.872303:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480687488 00000100:00100000:3.0:1716999787.872332:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480687424 00000100:00100000:3.0:1716999787.872335:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480687424 00000100:00100000:3.0:1716999787.872348:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9970 00000100:00100000:3.0:1716999787.872354:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+98:1957:x1800404480687488:12345-192.168.203.3@tcp:2:dbench.0 00002000:00010000:3.0:1716999787.872501:0:17864:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1716999787.872504:0:17864:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb mtime from disk: 1716999776 -> 1716999764 00002000:00010000:3.0:1716999787.872506:0:17864:0:(ofd_lvb.c:337:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb atime from disk: 1716999758 -> 1716999748 00002000:00010000:3.0:1716999787.872508:0:17864:0:(ofd_lvb.c:343:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb ctime from disk: 1716999788 -> 1716999788 00002000:00010000:3.0:1716999787.872509:0:17864:0:(ofd_lvb.c:349:ofd_lvbo_update()) res: [0x280000400:0x601:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1716999787.872539:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+99:1957:x1800404480687488:12345-192.168.203.3@tcp:2:dbench.0 Request processed in 185us (372us total) trans 4294970180 rc 0/0 00000100:00100000:3.0:1716999787.872545:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9970 00000100:00100000:3.0:1716999787.872557:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9971 00000100:00100000:3.0:1716999787.872560:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+94:1959:x1800404480687424:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.872568:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.872580:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc52d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657ef expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999787.872597:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x602:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999787.872608:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.872609:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.872615:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc52d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657ef expref: 95 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.872626:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc52d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657ef expref: 95 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.872633:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95440, rc 0) 00000100:00100000:3.0:1716999787.872645:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+95:1959:x1800404480687424:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 85us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.872650:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9971 00010000:00010000:1.0:1716999787.872920:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc52bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.872926:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc52bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.872932:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc52bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.872936:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.872939:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc52bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.872944:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc52bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.872953:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:1.0:1716999787.872955:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.872958:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc52bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.872962:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc52bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999787.875488:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.875533:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.875618:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480687680 00000100:00100000:3.0:1716999787.875625:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480687680 00000100:00100000:3.0:1716999787.875664:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45445 00000100:00100000:3.0:1716999787.875671:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+707:11420:x1800404480687680:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.875690:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.875703:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc52db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657f6 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.875743:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc52e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875753:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc52e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875763:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc52e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875772:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc52e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875777:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc52e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875781:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc52e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875875:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc52f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875898:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc52f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875904:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc52f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:3.0:1716999787.875926:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc2f:0x0]: returning size 15360 00000004:00200000:3.0:1716999787.875929:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999787.875940:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc52f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875947:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc52f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875953:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc52e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875958:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc52e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875966:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc52e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875970:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.875972:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc52e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875977:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc52e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875985:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999787.875987:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.875990:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc52e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.875994:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc52e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.876006:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc52e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.876010:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc52e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.876013:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc52e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.876017:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.876019:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc52e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.876023:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc52e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.876028:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xd4e4194e (ffff8800939ba500) 00010000:00010000:3.0:1716999787.876030:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.876032:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc52e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.876036:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc52e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999787.876054:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc52db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657f6 expref: 709 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.876063:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc52f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657f6 expref: 708 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.876067:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:3.0:1716999787.876069:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999787.876071:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97a80, rc 0) 00000100:00100000:3.0:1716999787.876103:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+708:11420:x1800404480687680:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 433us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.876108:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45445 00000100:00100000:2.0:1716999787.876170:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480687616 00000100:00100000:2.0:1716999787.876174:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480687616 00000100:00100000:2.0:1716999787.876191:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9056 00000100:00100000:2.0:1716999787.876194:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+708:11419:x1800404480687616:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999787.876482:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11428, 168 off2044104 00000001:00080000:2.0:1716999787.876487:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985976 00000100:00100000:2.0:1716999787.876535:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+710:11419:x1800404480687616:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 339us (1053us total) trans 4294985977 rc 0/0 00000100:00100000:2.0:1716999787.876540:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9056 00000020:00080000:2.0:1716999787.876543:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999787.882297:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.882582:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.882642:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480687936 00000100:00100000:2.0:1716999787.882649:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480687936 00000100:00100000:2.0:1716999787.882692:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9057 00000100:00100000:2.0:1716999787.882698:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+710:11420:x1800404480687936:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999787.882990:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11429, 168 off2044272 00000100:00100000:2.0:1716999787.883076:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+711:11420:x1800404480687936:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 378us (494us total) trans 4294985978 rc 0/0 00000100:00100000:2.0:1716999787.883083:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9057 00000100:00100000:1.0:1716999787.883433:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480687808 00000100:00100000:1.0:1716999787.883437:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480687808 00000100:00100000:1.0:1716999787.883457:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45446 00000100:00100000:1.0:1716999787.883462:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+711:11419:x1800404480687808:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.883470:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.883483:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc52f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f657fd expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.883536:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc52fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.883547:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc52fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc3c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.883555:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc52fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc3c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999787.883563:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc3c:0x0]: returning size 0 00010000:00010000:1.0:1716999787.883623:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc52f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657fd expref: 714 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.883637:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc52fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc3c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657fd expref: 713 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.883643:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3c:0x0].0x0 (ffff880135ac4200) 00010000:00010000:1.0:1716999787.883645:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1716999787.883647:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091366ac0, rc 0) 00000100:00100000:1.0:1716999787.883666:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+713:11419:x1800404480687808:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 204us (1377us total) trans 4294985979 rc 0/0 00000100:00100000:1.0:1716999787.883671:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45446 00000100:00100000:0.0:1716999787.886799:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.887019:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480688064 00000100:00100000:2.0:1716999787.887026:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480688064 00000100:00100000:2.0:1716999787.887067:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45447 00000100:00100000:2.0:1716999787.887074:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+713:11420:x1800404480688064:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999787.887109:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1716999787.887126:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc52f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc2f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657f6 expref: 713 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.887143:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc4131 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652af expref: 712 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.887157:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc4107 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc2f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f652a1 expref: 711 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.887165:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880134241c00) 00010000:00010000:2.0:1716999787.887173:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.887192:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc530c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887202:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc530c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887209:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc530c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887219:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5313 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887224:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887230:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887308:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc531a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887314:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc531a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887321:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc531a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:2.0:1716999787.887692:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1481, 64 off103040 00000040:00080000:2.0:1716999787.887711:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11430, 184 off2044456 00010000:00010000:2.0:1716999787.887758:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5321 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887764:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887769:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887775:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5321 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887779:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5321 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887784:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5321 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887789:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5321 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887793:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999787.887796:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5321 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887801:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5321 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887807:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880092a37900) 00010000:00010000:2.0:1716999787.887809:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999787.887812:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5321 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887829:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5321 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887846:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc531a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887851:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc531a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887856:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc531a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887860:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.887863:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc531a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887867:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc531a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887873:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc2f:0x0].0x0 (ffff880092a37900) 00010000:00010000:2.0:1716999787.887875:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999787.887908:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc531a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887913:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc531a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887944:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc530c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887949:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc530c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887954:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc530c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887957:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.887960:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc530c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887964:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc530c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887970:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.887972:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.887974:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc530c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999787.887978:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc530c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999787.887984:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099581c00 reply state ffff88009c1f2000 transno 4294985980 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999787.887990:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999787.888039:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+712:11420:x1800404480688064:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 964us (1246us total) trans 4294985980 rc 0/0 00000100:00100000:2.0:1716999787.888046:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45447 00000100:00100000:0.0:1716999787.888286:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.889058:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480688128 00000100:00100000:3.0:1716999787.889063:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480688128 00000100:00100000:3.0:1716999787.889091:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9972 00000100:00100000:3.0:1716999787.889097:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+95:11419:x1800404480688128:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.889105:0:17700:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.889116:0:17700:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65804 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.889139:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc52d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657ef expref: 96 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.889145:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.889147:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999787.889150:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65804 expref: 96 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.889173:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc52d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f657ef expref: 96 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999787.889183:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc52d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f657ef expref: 96 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999787.889194:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e441880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17700:1800404483009024:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999787.890639:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008dcfa480 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.891674:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999787.891734:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.891741:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5313 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.891748:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5313 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.891753:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.891756:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5313 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.891762:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5313 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.891773:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xd4e4194e (ffff880092a37000) 00010000:00010000:1.0:1716999787.891775:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.891778:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5313 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.891782:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5313 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xd4e4194e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999787.891849:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480688192 00000100:00100000:2.0:1716999787.891856:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480688192 00000100:00100000:2.0:1716999787.891915:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45448 00000100:00100000:2.0:1716999787.891922:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+711:11420:x1800404480688192:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.891939:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.891950:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc532f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6580b expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.891986:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5336 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.891996:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5336 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892002:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5336 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892010:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc533d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892015:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc533d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892019:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc533d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892096:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892102:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892107:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:2.0:1716999787.892128:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc37:0x0]: returning size 12006 00000004:00200000:2.0:1716999787.892131:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999787.892142:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892149:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892155:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5336 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892159:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5336 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892164:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5336 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892168:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.892170:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5336 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892175:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5336 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892180:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:2.0:1716999787.892182:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.892184:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5336 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892188:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5336 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892195:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc533d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892200:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc533d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892205:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc533d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892208:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.892211:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc533d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892215:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc533d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892220:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xe7082257 (ffff8800910ced00) 00010000:00010000:2.0:1716999787.892222:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.892224:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc533d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892228:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc533d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999787.892245:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ead00/0x6d188eabd8dc532f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6580b expref: 713 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.892254:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6580b expref: 712 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.892259:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:2.0:1716999787.892261:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999787.892263:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea880, rc 0) 00000100:00100000:2.0:1716999787.892293:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+712:11420:x1800404480688192:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 372us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.892298:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45448 00000100:00100000:3.0:1716999787.893425:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e441880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17700:1800404483009024:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999787.893445:0:17700:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65804 expref: 96 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.893457:0:17700:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95b00, rc 0) 00000100:00100000:3.0:1716999787.893478:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+96:11419:x1800404480688128:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 4380us (5192us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.893484:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9972 00000100:00100000:0.0:1716999787.894013:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.895405:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480688256 00000100:00100000:2.0:1716999787.895412:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480688256 00010000:00010000:2.0:1716999787.895435:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc52d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f657ef expref: 96 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999787.895465:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4512 00000100:00100000:2.0:1716999787.895471:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+96:1959:x1800404480688256:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999787.895480:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999787.895497:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc52d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f657ef expref: 96 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999787.895505:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc52d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f657ef expref: 96 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999787.895521:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c95440/0x6d188eabd8dc52d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f657ef expref: 96 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999787.895533:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.895534:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.895539:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65804 expref: 95 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.895545:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65804 expref: 95 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.895570:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65804 expref: 95 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999787.895581:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483009088:192.168.203.3@tcp:105: 00000100:00100000:2.0:1716999787.896539:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008eea3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.896648:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.897088:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480688384 00000100:00100000:3.0:1716999787.897093:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480688384 00000100:00100000:3.0:1716999787.897122:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9058 00000100:00100000:3.0:1716999787.897127:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+712:11420:x1800404480688384:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999787.897355:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11431, 168 off2044624 00000100:00100000:3.0:1716999787.897445:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+713:11420:x1800404480688384:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 316us (796us total) trans 4294985981 rc 0/0 00000100:00100000:3.0:1716999787.897451:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9058 00000100:00100000:2.0:1716999787.900410:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.901207:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483009088:192.168.203.3@tcp:105: 00010000:00010000:0.0:1716999787.901224:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999787.901312:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480688448 00000100:00100000:1.0:1716999787.901318:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480688448 00000100:00100000:1.0:1716999787.901364:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45449 00000100:00100000:1.0:1716999787.901374:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+713:11419:x1800404480688448:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.901388:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.901406:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc534b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65812 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.901445:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5352 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999787.901452:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+95:1959:x1800404480688256:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 5800us (7259us total) trans 0 rc 0/0 00010000:00010000:1.0:1716999787.901455:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5352 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999787.901460:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4512 00010000:00010000:1.0:1716999787.901463:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5352 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.901473:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.901478:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.901483:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.901533:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5352 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.901537:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5352 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.901542:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5352 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.901546:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.902004:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5352 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902011:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5352 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902020:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999787.902023:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.902026:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5352 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902030:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5352 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902049:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902054:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5359 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902058:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902062:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.902064:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902068:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5359 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902074:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x19f5fa5d (ffff880135ac4500) 00010000:00010000:1.0:1716999787.902075:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.902077:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5359 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902082:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902115:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc534b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65812 expref: 714 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.902121:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc534b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65812 expref: 714 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.902126:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365b00, rc 0) 00000100:00100000:1.0:1716999787.902162:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+713:11419:x1800404480688448:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 792us (1757us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.902167:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45449 00000100:00100000:1.0:1716999787.902204:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.902215:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480688576 00000100:00100000:1.0:1716999787.902218:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480688576 00000100:00100000:1.0:1716999787.902230:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45450 00000100:00100000:1.0:1716999787.902234:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+713:11420:x1800404480688576:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999787.902256:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1716999787.902265:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc37:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6580b expref: 713 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.902276:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc4b64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc37:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e2 expref: 712 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.902284:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc4b48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc37:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655d4 expref: 711 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.902289:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff8800b4877900) 00010000:00010000:1.0:1716999787.902296:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999787.902310:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5360 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902316:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5360 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902320:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5360 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902327:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5367 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902332:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5367 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902336:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5367 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902389:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc536e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902394:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc536e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902398:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc536e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:1.0:1716999787.902744:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1482, 64 off103104 00000040:00080000:1.0:1716999787.902760:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11432, 184 off2044808 00010000:00010000:1.0:1716999787.902804:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5375 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902810:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902828:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5375 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902833:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5375 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902837:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5375 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902840:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5375 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902848:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5375 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902852:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999787.902854:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5375 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902858:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5375 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902863:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff880135ac4a00) 00010000:00010000:1.0:1716999787.902865:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999787.902867:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5375 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902871:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5375 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902904:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc536e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902908:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc536e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902912:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc536e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902915:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.902916:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc536e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902920:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc536e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902928:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc37:0x0].0x0 (ffff880135ac4a00) 00010000:00010000:1.0:1716999787.902929:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999787.902931:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc536e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902934:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc536e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902962:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5360 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902966:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5360 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902969:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5360 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902972:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091367600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.902974:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5360 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902978:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5360 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902982:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999787.902984:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.902986:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5360 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.902989:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5360 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999787.902994:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009143fb80 reply state ffff88009c0e4000 transno 4294985982 ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5367 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999787.902999:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999787.903024:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+712:11420:x1800404480688576:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 789us (819us total) trans 4294985982 rc 0/0 00000100:00100000:1.0:1716999787.903029:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45450 00010000:00010000:1.0:1716999787.905219:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5367 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.905229:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5367 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.905234:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5367 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.905239:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.905242:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5367 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.905247:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5367 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.905258:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xe7082257 (ffff880135ac4e00) 00010000:00010000:1.0:1716999787.905260:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.905263:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5367 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.905267:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5367 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xe7082257 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999787.905677:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.906199:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480688640 00000100:00100000:3.0:1716999787.906205:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480688640 00000100:00100000:3.0:1716999787.906906:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45451 00000100:00100000:3.0:1716999787.906912:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+711:11419:x1800404480688640:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.906931:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.906944:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc537c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65819 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.906965:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc537c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65819 expref: 712 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.906979:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc537c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65819 expref: 712 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.906985:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999787.906987:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.906990:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94900, rc 0) 00000100:00100000:3.0:1716999787.907029:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+712:11419:x1800404480688640:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 117us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.907035:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45451 00000100:00100000:0.0:1716999787.910025:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.910089:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.910242:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480688704 00000100:00100000:2.0:1716999787.910254:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480688704 00000100:00100000:3.0:1716999787.910360:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9059 00000100:00100000:3.0:1716999787.910367:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+712:11419:x1800404480688704:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999787.911080:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480688768 00000100:00100000:3.0:1716999787.911085:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480688768 00000100:00100000:3.0:1716999787.911105:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45452 00000100:00100000:3.0:1716999787.911110:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+714:11420:x1800404480688768:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.911118:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.911133:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc5383 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65820 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.911172:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc538a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.911535:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc538a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.911544:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc538a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.911555:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5391 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.911560:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.911564:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.911607:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc538a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.911612:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc538a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.911618:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc538a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.911622:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.911625:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc538a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.911630:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc538a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.911639:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999787.911641:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.911644:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc538a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.911648:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc538a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.912234:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.912240:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5391 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.912244:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.912247:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.912249:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.912253:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5391 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.912259:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x52a89496 (ffff8800939ba800) 00010000:00010000:3.0:1716999787.912261:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.912263:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5391 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.912267:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5391 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.912304:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc5383 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65820 expref: 715 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.912310:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc5383 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65820 expref: 715 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.912315:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94480, rc 0) 00000100:00100000:3.0:1716999787.913025:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+714:11420:x1800404480688768:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1912us (2932us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.913031:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45452 00000100:00100000:3.0:1716999787.915567:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+712:11419:x1800404480688704:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5193us (5540us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.915577:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9059 00000100:00100000:0.0:1716999787.916803:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.917283:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480688832 00000100:00100000:3.0:1716999787.917289:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480688832 00000100:00100000:3.0:1716999787.917322:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45453 00000100:00100000:3.0:1716999787.917326:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+712:11420:x1800404480688832:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.917340:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.917353:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5398 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65827 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.917375:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5398 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65827 expref: 713 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.917384:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5398 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65827 expref: 713 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.917390:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999787.917392:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.917394:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95d40, rc 0) 00000100:00100000:3.0:1716999787.917423:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+713:11420:x1800404480688832:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 96us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.917428:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45453 00000100:00100000:2.0:1716999787.920012:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.920058:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.920556:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480688960 00000100:00100000:3.0:1716999787.920563:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480688960 00000100:00100000:3.0:1716999787.920590:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45454 00000100:00100000:3.0:1716999787.920596:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+713:11419:x1800404480688960:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.920609:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.920612:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1716999787.920629:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc537c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65819 expref: 713 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.920906:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999787.920911:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999787.920920:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc539f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6582e expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999787.921433:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689024 00000100:00100000:0.0:1716999787.921437:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689024 00000100:00100000:0.0:1716999787.921461:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9060 00000100:00100000:0.0:1716999787.921466:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec23850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+714:11420:x1800404480689024:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:3.0:1716999787.922095:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922106:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922113:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922122:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922127:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922132:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:3.0:1716999787.922463:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x603:0x0], index 1: 0 00000040:00080000:3.0:1716999787.922514:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11433, 184 off2044992 00010000:00010000:3.0:1716999787.922596:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc53b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922603:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc53b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922609:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc53b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922629:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922634:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922639:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922644:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.922647:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922652:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922659:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999787.922661:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.922664:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.922668:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:3.0:1716999787.922677:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800889fdc00 reply state ffff8800903d4000 transno 4294985983 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999787.922682:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999787.922698:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc539f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6582e expref: 717 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.922708:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc53b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6582e expref: 716 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.922713:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3d:0x0].0x0 (ffff8800939ba300) 00010000:00010000:3.0:1716999787.922715:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999787.922717:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c973c0, rc 0) 00000100:00100000:3.0:1716999787.924290:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+717:11419:x1800404480688960:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 3689us (4280us total) trans 4294985983 rc 0/0 00000100:00100000:3.0:1716999787.924300:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45454 00000100:00100000:2.0:1716999787.927338:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec23850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+715:11420:x1800404480689024:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5862us (7271us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.927349:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9060 00000100:00100000:3.0:1716999787.927641:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999787.927731:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.927739:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.927745:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.927750:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.927753:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.927759:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.927771:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x19f5fa5d (ffff8800939ba800) 00010000:00010000:1.0:1716999787.927774:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.927777:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.927781:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999787.928440:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689088 00000100:00100000:2.0:1716999787.928447:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689088 00000100:00100000:2.0:1716999787.929021:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9973 00000100:00100000:2.0:1716999787.929027:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+99:1958:x1800404480689088:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.929040:0:17700:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.929054:0:17700:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918ea880/0x6d188eabd8dc53c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65835 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999787.929072:0:17700:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x603:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999787.929085:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.929087:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.929093:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918ea880/0x6d188eabd8dc53c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65835 expref: 100 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.929106:0:17700:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918ea880/0x6d188eabd8dc53c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65835 expref: 100 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.929114:0:17700:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea880, rc 0) 00000100:00100000:2.0:1716999787.929613:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+100:1958:x1800404480689088:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 584us (1971us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.929621:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9973 00000100:00100000:0.0:1716999787.931744:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.932134:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689152 00000100:00100000:3.0:1716999787.932140:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689152 00000100:00100000:3.0:1716999787.932258:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45455 00000100:00100000:3.0:1716999787.932266:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+714:11420:x1800404480689152:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.932286:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.932301:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc53c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6583c expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.932350:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc53d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.932360:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc53d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.932370:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc53d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.932381:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.932386:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.932390:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.932455:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc53d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.932460:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc53d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.932466:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc53d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.932470:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.932474:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc53d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.932479:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc53d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.932487:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999787.932489:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.932492:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc53d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.932496:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc53d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.932805:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.933172:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689280 00000100:00100000:2.0:1716999787.933177:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689280 00000100:00100000:2.0:1716999787.933214:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9061 00000100:00100000:2.0:1716999787.933219:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+716:11419:x1800404480689280:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999787.933572:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11434, 168 off2045160 00000001:00080000:2.0:1716999787.933578:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985984 00010000:00010000:3.0:1716999787.933698:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.933704:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.933709:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.933713:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.933715:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.933721:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.933729:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x52a89496 (ffff8800939ba700) 00010000:00010000:3.0:1716999787.933731:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.933734:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.933738:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc53d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.933777:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc53c9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6583c expref: 718 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.933784:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc53c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6583c expref: 718 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.933791:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94000, rc 0) 00000100:00100000:3.0:1716999787.934598:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+717:11420:x1800404480689152:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2331us (2857us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.934598:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+717:11419:x1800404480689280:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1376us (1791us total) trans 4294985985 rc 0/0 00000100:00100000:2.0:1716999787.934604:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9061 00000100:00100000:3.0:1716999787.934605:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45455 00000020:00080000:2.0:1716999787.934608:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999787.946464:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.946831:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689472 00000100:00100000:3.0:1716999787.946839:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689472 00000100:00100000:3.0:1716999787.946877:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45456 00000100:00100000:3.0:1716999787.946905:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+716:11419:x1800404480689472:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.946923:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.946939:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6584a expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.947005:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc53e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.947020:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc53e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc3d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.947029:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc53e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc3d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:3.0:1716999787.947037:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc3d:0x0]: returning size 0 00010000:00010000:3.0:1716999787.947134:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc53de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6584a expref: 719 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.947162:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc53e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc3d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6584a expref: 718 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.947168:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3d:0x0].0x0 (ffff8800939ba300) 00010000:00010000:3.0:1716999787.947170:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1716999787.947172:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94900, rc 0) 00000100:00100000:3.0:1716999787.947207:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+718:11419:x1800404480689472:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 302us (749us total) trans 4294985986 rc 0/0 00000100:00100000:3.0:1716999787.947212:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45456 00000100:00100000:0.0:1716999787.950202:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.951116:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689344 00000100:00100000:3.0:1716999787.951124:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689344 00000100:00100000:3.0:1716999787.951170:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45457 00000100:00100000:3.0:1716999787.951176:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+718:11420:x1800404480689344:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.951192:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.951206:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc53f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65843 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.951248:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc53fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.951259:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc53fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.951267:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc53fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.951279:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.951283:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.951287:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.951345:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc53fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.951350:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc53fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.951355:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc53fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999787.953195:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.953628:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689536 00000100:00100000:2.0:1716999787.953636:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689536 00000100:00100000:2.0:1716999787.953675:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9974 00000100:00100000:2.0:1716999787.953682:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+100:11419:x1800404480689536:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.953693:0:17700:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.953705:0:17700:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65851 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.953726:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918ea880/0x6d188eabd8dc53c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65835 expref: 101 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.953734:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.953735:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.953738:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65851 expref: 101 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.953768:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918ea880/0x6d188eabd8dc53c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65835 expref: 101 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.953778:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918ea880/0x6d188eabd8dc53c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65835 expref: 101 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999787.953789:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483009152:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999787.953833:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.953839:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc53fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.953847:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc53fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999787.953848:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093549900 going to sleep for 11 seconds 00010000:00010000:3.0:1716999787.953859:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999787.953861:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.953865:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc53fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.953870:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc53fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.953909:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.953915:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5401 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.953920:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.953924:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.953926:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.953930:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5401 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.953941:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x85ed8f9c (ffff8800939ba500) 00010000:00010000:3.0:1716999787.953943:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.953947:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5401 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.953952:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5401 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999787.954012:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc53f3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65843 expref: 719 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.954019:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc53f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65843 expref: 719 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.954026:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94480, rc 0) 00000100:00100000:3.0:1716999787.954060:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+718:11420:x1800404480689344:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2884us (3865us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.954066:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45457 00000100:00100000:0.0:1716999787.958007:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.958040:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483009152:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999787.958064:0:17700:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65851 expref: 101 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.958077:0:17700:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ead00, rc 0) 00000100:00100000:1.0:1716999787.958118:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689600 00000100:00100000:1.0:1716999787.958123:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689600 00010000:00010000:1.0:1716999787.958143:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918ea880/0x6d188eabd8dc53c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65835 expref: 102 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999787.958172:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4513 00000100:00100000:1.0:1716999787.958177:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+102:1958:x1800404480689600:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999787.958187:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999787.958202:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918ea880/0x6d188eabd8dc53c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65835 expref: 102 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999787.958215:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918ea880/0x6d188eabd8dc53c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65835 expref: 102 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999787.958231:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918ea880/0x6d188eabd8dc53c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65835 expref: 102 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999787.958232:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999787.958242:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.958244:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.958248:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65851 expref: 101 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.958255:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65851 expref: 101 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.958285:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65851 expref: 101 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999787.958295:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483009216:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999787.958342:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930ef180 going to sleep for 11 seconds 00000100:00100000:1.0:1716999787.958363:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689664 00000100:00100000:1.0:1716999787.958366:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689664 00000100:00100000:1.0:1716999787.958385:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45458 00000100:00100000:1.0:1716999787.958389:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+718:11420:x1800404480689664:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.958402:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.958414:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc540f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65858 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.958456:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5416 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958464:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5416 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958471:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5416 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958480:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc541d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958484:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc541d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958490:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc541d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958550:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5416 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958555:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5416 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958561:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5416 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958565:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.958569:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5416 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958574:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5416 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958584:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999787.958587:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.958589:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5416 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958593:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5416 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958601:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc541d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958605:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc541d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958608:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc541d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958612:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.958614:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc541d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958618:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc541d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958624:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xec6f74b7 (ffff8800941a3300) 00010000:00010000:1.0:1716999787.958626:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.958627:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc541d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958631:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc541d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.958661:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc540f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65858 expref: 719 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.958667:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc540f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65858 expref: 719 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.958673:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365f80, rc 0) 00000100:00100000:1.0:1716999787.958706:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+718:11420:x1800404480689664:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 315us (474us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.958711:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45458 00000100:00100000:3.0:1716999787.958761:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+101:11419:x1800404480689536:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 5079us (5570us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.958766:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9974 00000100:00100000:1.0:1716999787.962330:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009c2c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483009216:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999787.962348:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999787.962385:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+100:1958:x1800404480689600:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 4206us (4382us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.962394:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4513 00000100:00100000:0.0:1716999787.962504:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.962542:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689728 00000100:00100000:1.0:1716999787.962546:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689728 00000100:00100000:0.0:1716999787.962572:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.962944:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689792 00000100:00100000:1.0:1716999787.962948:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689792 00000100:00100000:1.0:1716999787.962966:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45459 00000100:00100000:1.0:1716999787.962974:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+719:11420:x1800404480689728:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.962989:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.963006:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5424 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6585f expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.963049:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc542b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963065:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc542b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963074:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc542b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963084:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5432 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0xd13416e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963089:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963094:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963154:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc542b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963159:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc542b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963164:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc542b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963169:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.963173:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc542b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963179:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc542b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963187:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999787.963189:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.963192:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc542b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963196:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc542b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963206:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5432 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963210:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5432 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963214:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963218:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091367600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.963220:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5432 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963224:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5432 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963230:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xd13416e1 (ffff8800941a3400) 00010000:00010000:1.0:1716999787.963232:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.963234:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5432 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963238:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5432 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xd13416e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963267:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5424 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6585f expref: 720 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.963274:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5424 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6585f expref: 720 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.963280:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364900, rc 0) 00000100:00100000:1.0:1716999787.963317:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+719:11420:x1800404480689728:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 345us (814us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.963323:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45459 00000100:00100000:1.0:1716999787.963345:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45460 00000100:00100000:1.0:1716999787.963348:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+718:11419:x1800404480689792:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.963358:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.963364:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5439 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65866 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.963383:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5440 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963389:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5440 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963394:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5440 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963400:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5447 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963405:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963409:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963435:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5440 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963439:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5440 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963447:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5440 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963451:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.963453:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5440 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963458:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5440 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963463:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999787.963465:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.963467:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5440 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963471:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5440 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963479:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963484:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5447 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963488:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963491:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.963493:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963496:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5447 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963501:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x863a7a8e (ffff880135ac4a00) 00010000:00010000:1.0:1716999787.963503:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.963504:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5447 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963508:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5447 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999787.963531:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5439 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65866 expref: 719 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.963537:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5439 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65866 expref: 719 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.963544:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364b40, rc 0) 00000100:00100000:1.0:1716999787.963572:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+718:11419:x1800404480689792:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 222us (1000us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999787.963577:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45460 00000100:00100000:2.0:1716999787.965284:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.965908:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689856 00000100:00100000:3.0:1716999787.965914:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689856 00000100:00100000:3.0:1716999787.965942:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45461 00000100:00100000:3.0:1716999787.965948:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+718:11420:x1800404480689856:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.965959:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.965970:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc544e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6586d expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.966001:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5455 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966011:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966017:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966028:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc545c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966033:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc545c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966038:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc545c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966083:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966089:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5455 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966093:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966098:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.966101:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966106:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5455 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966113:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999787.966116:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.966118:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5455 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966122:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5455 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966144:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc545c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966149:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc545c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966152:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc545c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966156:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.966158:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc545c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966163:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc545c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966169:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x2253fa11 (ffff8800939ba500) 00010000:00010000:3.0:1716999787.966171:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.966173:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc545c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966176:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc545c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.966418:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc544e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6586d expref: 719 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.966426:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc544e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6586d expref: 719 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.966434:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95440, rc 0) 00000100:00100000:3.0:1716999787.966475:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+718:11420:x1800404480689856:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 526us (1193us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.966484:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45461 00000100:00100000:0.0:1716999787.967684:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.967715:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.967754:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480689920 00000100:00100000:1.0:1716999787.967758:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480689920 00000100:00100000:1.0:1716999787.967784:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480690048 00000100:00100000:1.0:1716999787.967786:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480690048 00000100:00100000:1.0:1716999787.967806:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45462 00000100:00100000:1.0:1716999787.967810:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+719:11419:x1800404480689920:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.967826:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.967836:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5463 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65874 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.967856:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65874 expref: 720 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.967865:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65874 expref: 720 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.967871:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999787.967873:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.967875:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365d40, rc 0) 00000100:00100000:2.0:1716999787.967894:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45463 00000100:00100000:2.0:1716999787.967901:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+720:11420:x1800404480690048:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.967908:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.967910:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00000100:00100000:1.0:1716999787.967914:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+720:11419:x1800404480689920:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 102us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.967920:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45462 00010000:00010000:2.0:1716999787.967922:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5398 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65827 expref: 720 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.967936:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999787.967939:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.967950:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc546a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6587b expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.968020:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5471 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968029:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5471 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968039:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5471 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968056:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5478 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968061:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968066:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:2.0:1716999787.968435:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x603:0x0], index 0: 0 00000040:00080000:2.0:1716999787.968516:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11435, 176 off2045336 00010000:00010000:2.0:1716999787.968595:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc547f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968601:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc547f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968607:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc547f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968627:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5471 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968632:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5471 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968637:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5471 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968641:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.968644:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5471 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968649:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5471 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.968656:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999787.969492:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.969496:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5471 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.969502:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5471 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999787.969511:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af50700 reply state ffff88008e4d5000 transno 4294985987 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999787.969526:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999787.969550:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc546a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6587b expref: 721 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.969559:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc547f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6587b expref: 720 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.969565:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3e:0x0].0x0 (ffff8800910ce000) 00010000:00010000:2.0:1716999787.969567:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999787.969569:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9440, rc 0) 00000100:00100000:2.0:1716999787.969608:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+721:11420:x1800404480690048:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1707us (1892us total) trans 4294985987 rc 0/0 00000100:00100000:2.0:1716999787.969614:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45463 00000100:00100000:0.0:1716999787.971224:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.971304:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.971361:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480690176 00000100:00100000:3.0:1716999787.971367:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480690112 00000100:00100000:2.0:1716999787.971367:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480690176 00000100:00100000:3.0:1716999787.971371:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480690112 00000100:00100000:2.0:1716999787.971391:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9975 00000100:00100000:3.0:1716999787.971394:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9062 00000100:00100000:2.0:1716999787.971397:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+95:1959:x1800404480690176:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:3.0:1716999787.971399:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+721:11419:x1800404480690112:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:2.0:1716999787.971407:0:17700:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.971419:0:17700:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc548d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65882 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999787.971436:0:17700:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x603:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999787.971447:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.971448:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.971454:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc548d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65882 expref: 96 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.971464:0:17700:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc548d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65882 expref: 96 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.971473:0:17700:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eaac0, rc 0) 00000100:00100000:2.0:1716999787.971496:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+96:1959:x1800404480690176:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 99us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.971502:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9975 00010000:00010000:1.0:1716999787.971608:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.971615:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5478 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.971620:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5478 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.971624:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999787.971626:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5478 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.971631:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5478 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.971640:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x2253fa11 (ffff8800910ced00) 00010000:00010000:1.0:1716999787.971643:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999787.971645:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5478 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999787.971649:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5478 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999787.974541:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.974698:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480690304 00000100:00100000:2.0:1716999787.974705:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480690304 00000100:00100000:2.0:1716999787.974731:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9063 00000100:00100000:2.0:1716999787.974736:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+722:11420:x1800404480690304:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999787.975374:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11436, 168 off2045504 00000001:00080000:2.0:1716999787.975379:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985988 00000100:00100000:2.0:1716999787.975445:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+724:11420:x1800404480690304:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 707us (909us total) trans 4294985989 rc 0/0 00000100:00100000:2.0:1716999787.975452:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9063 00000020:00080000:2.0:1716999787.975456:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999787.976580:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+722:11419:x1800404480690112:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5178us (5356us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.976587:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9062 00000100:00100000:0.0:1716999787.978199:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.978296:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.978383:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480690560 00000100:00100000:2.0:1716999787.978390:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480690560 00000100:00100000:2.0:1716999787.978412:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480690496 00000100:00100000:2.0:1716999787.978414:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480690496 00000100:00100000:2.0:1716999787.979223:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45464 00000100:00100000:2.0:1716999787.979230:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+723:11420:x1800404480690560:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.979246:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.979261:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5494 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65890 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.979326:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc549b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979336:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc549b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc3e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979345:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc549b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc3e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:2.0:1716999787.979354:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc3e:0x0]: returning size 0 00010000:00010000:2.0:1716999787.979446:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5494 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65890 expref: 726 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.979457:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc549b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc3e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65890 expref: 725 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.979463:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3e:0x0].0x0 (ffff8800910ce000) 00010000:00010000:2.0:1716999787.979466:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999787.979469:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9200, rc 0) 00000100:00100000:2.0:1716999787.979502:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+725:11420:x1800404480690560:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 272us (1405us total) trans 4294985990 rc 0/0 00000100:00100000:2.0:1716999787.979507:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45464 00000100:00100000:2.0:1716999787.979521:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45465 00000100:00100000:2.0:1716999787.979525:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+724:11419:x1800404480690496:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.979531:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.979538:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc54a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65889 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.979582:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc54b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979590:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc54b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979595:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc54b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979604:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc54b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979608:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc54b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979612:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc54b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979638:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc54b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979643:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc54b0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979649:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc54b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979653:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaf40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.979656:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc54b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979661:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc54b0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979668:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999787.979670:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.979672:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc54b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979676:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc54b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979684:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc54b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979687:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc54b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979691:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc54b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979695:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.979697:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc54b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979701:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc54b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979706:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x863a7a8e (ffff8800990ea500) 00010000:00010000:2.0:1716999787.979707:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.979709:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc54b7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979712:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc54b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999787.979728:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc54a9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65889 expref: 725 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.979734:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc54a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65889 expref: 725 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.979739:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8900, rc 0) 00000100:00100000:2.0:1716999787.979754:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+724:11419:x1800404480690496:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 229us (1459us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999787.979759:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45465 00000100:00100000:0.0:1716999787.981918:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.981979:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480690624 00000100:00100000:3.0:1716999787.981985:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480690624 00000100:00100000:3.0:1716999787.982021:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45466 00000100:00100000:3.0:1716999787.982027:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+724:11419:x1800404480690624:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.982045:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.982385:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc54be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65897 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.982423:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc54c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982434:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc54c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982441:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc54c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982453:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc54cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x86397a9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982458:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc54cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982463:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc54cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982505:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc54c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982510:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc54c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982515:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc54c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982520:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.982522:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc54c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982527:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc54c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982535:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999787.982537:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.982540:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc54c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982545:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc54c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982554:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc54cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982559:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc54cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982563:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc54cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982568:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.982570:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc54cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982574:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc54cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982579:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x86397a9e (ffff8800939ba800) 00010000:00010000:3.0:1716999787.982581:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.982583:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc54cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982587:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc54cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.982614:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc54be lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65897 expref: 725 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.982620:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc54be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65897 expref: 725 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.982626:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94fc0, rc 0) 00000100:00100000:3.0:1716999787.982903:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+724:11419:x1800404480690624:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 875us (995us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.982910:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45466 00000100:00100000:0.0:1716999787.983036:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.983244:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480690688 00000100:00100000:0.0:1716999787.983248:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480690688 00000100:00100000:0.0:1716999787.983278:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9976 00000100:00100000:0.0:1716999787.983283:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:107d663a-2216-406b-94c6-b2fcb1558728+96:11420:x1800404480690688:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999787.983291:0:11262:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999787.983300:0:11262:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6589e expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.983316:0:11262:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc548d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65882 expref: 97 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999787.983322:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.983324:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999787.983327:0:11262:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6589e expref: 97 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999787.983349:0:11262:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc548d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65882 expref: 97 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999787.983358:0:11262:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc548d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65882 expref: 97 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999787.983368:0:11262:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008af52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11262:1800404483009280:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999787.983395:0:11262:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135481780 going to sleep for 11 seconds 00000100:00100000:0.0:1716999787.985797:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999787.985873:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.985918:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480690880 00000100:00100000:3.0:1716999787.985924:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480690880 00000100:00100000:3.0:1716999787.985963:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45467 00000100:00100000:3.0:1716999787.985967:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+724:11419:x1800404480690880:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.985979:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.985981:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1716999787.985995:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65874 expref: 724 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999787.986000:0:11262:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008af52680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11262:1800404483009280:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999787.986008:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999787.986011:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999787.986019:0:11262:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6589e expref: 97 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.986020:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc54da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658a5 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999787.986030:0:11262:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f180, rc 0) 00000100:00100000:2.0:1716999787.986056:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:107d663a-2216-406b-94c6-b2fcb1558728+97:11420:x1800404480690688:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2773us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.986062:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9976 00010000:00010000:3.0:1716999787.986105:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc54e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.986113:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc54e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.986120:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc54e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.986129:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc54e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.986134:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc54e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.986138:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc54e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999787.986293:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480690752 00000100:00100000:1.0:1716999787.986296:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480690752 00010000:00010000:1.0:1716999787.986310:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc548d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65882 expref: 97 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999787.986590:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4514 00000100:00100000:1.0:1716999787.986595:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+97:1959:x1800404480690752:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999787.986602:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999787.986618:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc548d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65882 expref: 97 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999787.986626:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc548d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65882 expref: 97 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999787.986637:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc548d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65882 expref: 97 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999787.986645:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.986647:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999787.986651:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6589e expref: 96 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.986661:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6589e expref: 96 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.986682:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6589e expref: 96 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999787.986692:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483009344:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999787.986722:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930ef180 going to sleep for 11 seconds 00000004:00080000:3.0:1716999787.987248:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x604:0x0], index 1: 0 00000040:00080000:3.0:1716999787.987297:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11437, 184 off2045688 00010000:00010000:3.0:1716999787.987373:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc54ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.987383:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc54ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.987388:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc54ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.987406:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc54e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.987410:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc54e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.987415:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc54e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.987419:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.987421:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc54e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.987425:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc54e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.987430:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999787.987432:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.987435:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc54e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.987438:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc54e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999787.987444:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af50a80 reply state ffff880135ae4000 transno 4294985991 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc54e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999787.987452:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999787.987466:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc54da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658a5 expref: 726 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.987473:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc54ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658a5 expref: 725 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.987478:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3f:0x0].0x0 (ffff8800939ba700) 00010000:00010000:3.0:1716999787.987479:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999787.987481:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95440, rc 0) 00000100:00100000:3.0:1716999787.987507:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+726:11419:x1800404480690880:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1539us (1634us total) trans 4294985991 rc 0/0 00000100:00100000:3.0:1716999787.987512:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45467 00000100:00100000:1.0:1716999787.988673:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009c2c7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483009344:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999787.988686:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999787.988703:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+96:1959:x1800404480690752:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2109us (2913us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999787.988709:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4514 00000100:00100000:0.0:1716999787.988840:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.988905:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480690944 00000100:00100000:3.0:1716999787.988909:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480690944 00000100:00100000:3.0:1716999787.988925:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45468 00000100:00100000:3.0:1716999787.988929:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+726:11420:x1800404480690944:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.988939:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.988948:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc54fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658ac expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.988974:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5504 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.988982:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5504 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.988987:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5504 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.988996:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc550b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989000:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc550b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989005:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc550b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989038:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5504 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989042:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5504 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989046:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5504 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989050:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.989052:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5504 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989056:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5504 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989061:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999787.989063:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.989065:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5504 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989069:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5504 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989706:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc550b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989711:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc550b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989715:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc550b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989718:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999787.989720:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc550b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989724:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc550b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989730:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x19f5fa5d (ffff880131c40d00) 00010000:00010000:3.0:1716999787.989731:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.989733:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc550b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989736:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc550b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999787.989764:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc54fd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658ac expref: 727 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.989769:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc54fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658ac expref: 727 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.989775:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94480, rc 0) 00000100:00100000:3.0:1716999787.989793:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+726:11420:x1800404480690944:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 863us (954us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999787.989800:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45468 00010000:00010000:2.0:1716999787.990094:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc54e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.990101:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc54e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.990105:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc54e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.990109:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999787.990111:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc54e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.990115:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc54e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.990123:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x86397a9e (ffff8800939ba500) 00010000:00010000:2.0:1716999787.990125:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999787.990127:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc54e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999787.990131:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc54e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999787.990293:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.990541:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480691008 00000100:00100000:2.0:1716999787.990546:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480691008 00000100:00100000:2.0:1716999787.990579:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9977 00000100:00100000:2.0:1716999787.990584:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:107d663a-2216-406b-94c6-b2fcb1558728+100:1958:x1800404480691008:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999787.990592:0:11262:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999787.990603:0:11262:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5512 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658b3 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999787.990619:0:11262:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x604:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999787.990630:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.990632:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999787.990637:0:11262:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658b3 expref: 101 pid: 11262 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.990646:0:11262:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658b3 expref: 101 pid: 11262 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999787.990654:0:11262:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb3c0, rc 0) 00000100:00100000:2.0:1716999787.990681:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:107d663a-2216-406b-94c6-b2fcb1558728+101:1958:x1800404480691008:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 96us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.990685:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9977 00000100:00100000:0.0:1716999787.992021:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.992156:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480691072 00000100:00100000:3.0:1716999787.992161:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480691072 00000100:00100000:3.0:1716999787.992182:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45469 00000100:00100000:3.0:1716999787.992188:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+725:11420:x1800404480691072:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999787.992201:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999787.992212:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5519 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658ba expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.992232:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5519 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658ba expref: 726 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.992241:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5519 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658ba expref: 726 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999787.992246:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999787.992249:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999787.992251:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc000, rc 0) 00000100:00100000:3.0:1716999787.992286:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+726:11420:x1800404480691072:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 96us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999787.992291:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45469 00000100:00100000:1.0:1716999787.992763:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999787.993610:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480691200 00000100:00100000:3.0:1716999787.993615:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480691200 00000100:00100000:3.0:1716999787.993642:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9064 00000100:00100000:3.0:1716999787.993646:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+726:11419:x1800404480691200:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999787.994004:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11438, 168 off2045856 00000001:00080000:3.0:1716999787.994009:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985992 00000100:00100000:3.0:1716999787.994073:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+728:11419:x1800404480691200:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 425us (1310us total) trans 4294985993 rc 0/0 00000100:00100000:3.0:1716999787.994080:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9064 00000020:00080000:3.0:1716999787.994083:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999787.994641:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999787.994758:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480691264 00000100:00100000:2.0:1716999787.994762:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480691264 00000100:00100000:2.0:1716999787.994791:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9065 00000100:00100000:2.0:1716999787.994795:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+728:11420:x1800404480691264:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999787.997113:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999787.997159:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480691392 00000100:00100000:1.0:1716999787.997165:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480691392 00000100:00100000:1.0:1716999787.997198:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45470 00000100:00100000:1.0:1716999787.997203:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+729:11419:x1800404480691392:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999787.997216:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999787.997228:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5520 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658c1 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.997281:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5527 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.997290:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5527 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc3f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999787.997298:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5527 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc3f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999787.997305:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc3f:0x0]: returning size 0 00010000:00010000:1.0:1716999787.997381:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5520 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658c1 expref: 732 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.997392:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5527 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc3f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658c1 expref: 731 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999787.997398:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3f:0x0].0x0 (ffff8800939ba700) 00010000:00010000:1.0:1716999787.997400:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1716999787.997402:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364b40, rc 0) 00000100:00100000:1.0:1716999787.997426:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+731:11419:x1800404480691392:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 223us (317us total) trans 4294985994 rc 0/0 00000100:00100000:1.0:1716999787.997431:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45470 00000100:00100000:2.0:1716999787.998018:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+730:11420:x1800404480691264:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3220us (3376us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999787.998025:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9065 00000100:00100000:0.0:1716999787.999961:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.000253:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.000295:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480691584 00000100:00100000:2.0:1716999788.000300:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480691584 00000100:00100000:2.0:1716999788.000339:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9978 00000100:00100000:2.0:1716999788.000345:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+101:11419:x1800404480691584:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:3.0:1716999788.000350:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480691520 00000100:00100000:3.0:1716999788.000353:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480691520 00010000:00010000:2.0:1716999788.000357:0:17700:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.000368:0:17700:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658cf expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.000380:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45471 00000100:00100000:3.0:1716999788.000384:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+730:11420:x1800404480691520:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.000391:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5512 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658b3 expref: 102 pid: 11262 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.000393:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.000395:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1716999788.000397:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.000399:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.000401:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658cf expref: 102 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.000408:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5519 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658ba expref: 730 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.000421:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.000423:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658b3 expref: 102 pid: 11262 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.000424:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999788.000430:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc553c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658c8 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.000432:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658b3 expref: 102 pid: 11262 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.000442:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483009408:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.000475:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff880131c09840 going to sleep for 11 seconds 00010000:00010000:3.0:1716999788.000514:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5543 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.000522:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5543 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.000529:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5543 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.000539:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc554a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.000548:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc554a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.000552:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc554a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:3.0:1716999788.001788:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x604:0x0], index 0: 0 00000040:00080000:3.0:1716999788.001861:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11439, 184 off2046040 00010000:00010000:3.0:1716999788.001980:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5551 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.001988:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.001994:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.002016:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5543 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.002020:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5543 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.002025:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5543 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.002030:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcd80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.002033:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5543 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.002038:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5543 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.002046:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.002049:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.002052:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5543 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.002055:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5543 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999788.002066:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af53800 reply state ffff880135ae7000 transno 4294985995 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc554a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999788.002072:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999788.002091:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc553c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658c8 expref: 732 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.002101:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5551 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658c8 expref: 731 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.002106:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc40:0x0].0x0 (ffff880131c40100) 00010000:00010000:3.0:1716999788.002108:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999788.002109:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bded00, rc 0) 00000100:00100000:3.0:1716999788.002153:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+732:11420:x1800404480691520:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1767us (2194us total) trans 4294985995 rc 0/0 00000100:00100000:3.0:1716999788.002160:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45471 00000100:00100000:0.0:1716999788.002642:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483009408:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.002661:0:17700:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658cf expref: 102 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.002671:0:17700:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea640, rc 0) 00000100:00100000:0.0:1716999788.003289:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+102:11419:x1800404480691584:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2942us (3034us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.003295:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9978 00000100:00100000:0.0:1716999788.003448:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.004050:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480691648 00000100:00100000:1.0:1716999788.004055:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480691648 00010000:00010000:1.0:1716999788.004089:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658b3 expref: 102 pid: 11262 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999788.004105:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4515 00000100:00100000:1.0:1716999788.004110:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+102:1958:x1800404480691648:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999788.004118:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999788.004132:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658b3 expref: 102 pid: 11262 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.004144:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658b3 expref: 102 pid: 11262 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.004156:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5512 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658b3 expref: 102 pid: 11262 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.004164:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.004166:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.004170:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658cf expref: 101 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.004177:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658cf expref: 101 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.004199:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658cf expref: 101 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.004220:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483009472:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999788.004248:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930ef180 going to sleep for 11 seconds 00000100:00080000:3.0:1716999788.004792:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1716999758 00010000:00010000:1.0:1716999788.004967:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc554a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.004975:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc554a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.004979:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc554a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.004987:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddb00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.004989:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc554a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.004995:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc554a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.005003:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x19f5fa5d (ffff880131c40b00) 00010000:00010000:1.0:1716999788.005006:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.005008:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc554a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.005013:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc554a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999788.005115:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.005278:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480691712 00000100:00100000:2.0:1716999788.005283:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480691712 00000100:00100000:2.0:1716999788.005323:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9979 00000100:00100000:2.0:1716999788.005328:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+96:1959:x1800404480691712:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.005339:0:17700:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.005351:0:17700:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc555f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658d6 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1716999788.005375:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1716999758 00002000:00010000:2.0:1716999788.005580:0:17700:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x604:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999788.005591:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.005592:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.005597:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc555f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658d6 expref: 97 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.005606:0:17700:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc555f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658d6 expref: 97 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.005612:0:17700:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9f80, rc 0) 00000100:00100000:2.0:1716999788.005642:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+97:1959:x1800404480691712:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 313us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.005648:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9979 00000100:00100000:1.0:1716999788.006645:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009c2c5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483009472:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999788.006662:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999788.006807:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+101:1958:x1800404480691648:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2695us (3358us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.006822:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4515 00000100:00100000:0.0:1716999788.007868:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.007965:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480691840 00000100:00100000:2.0:1716999788.007970:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480691840 00000100:00100000:2.0:1716999788.008004:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9066 00000100:00100000:2.0:1716999788.008009:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+731:11420:x1800404480691840:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999788.008566:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.008663:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480691904 00000100:00100000:3.0:1716999788.008667:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480691904 00000100:00100000:3.0:1716999788.008687:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45472 00000100:00100000:3.0:1716999788.008691:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+733:11419:x1800404480691904:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.008699:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.008712:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5566 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658dd expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.008747:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc556d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008757:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc556d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008765:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc556d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008775:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5574 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008780:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008784:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008833:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc556d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008839:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc556d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008843:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc556d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008848:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.008851:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc556d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008856:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc556d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008864:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.008867:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.008870:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc556d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008874:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc556d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000040:00080000:2.0:1716999788.008874:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11440, 168 off2046208 00000001:00080000:2.0:1716999788.008894:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985996 00010000:00010000:3.0:1716999788.008907:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008912:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5574 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008916:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008920:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.008922:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008927:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5574 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008933:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x85ed8f9c (ffff88009439c200) 00010000:00010000:3.0:1716999788.008935:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.008937:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5574 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008940:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5574 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.008969:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5566 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658dd expref: 735 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.008976:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5566 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658dd expref: 735 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.008982:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf3c0, rc 0) 00000100:00100000:3.0:1716999788.009661:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+734:11419:x1800404480691904:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 967us (1093us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.009661:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+734:11420:x1800404480691840:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1650us (1793us total) trans 4294985997 rc 0/0 00000100:00100000:3.0:1716999788.009668:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45472 00000100:00100000:2.0:1716999788.009668:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9066 00000020:00080000:2.0:1716999788.009672:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999788.013986:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.014030:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.014093:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480691968 00000100:00100000:1.0:1716999788.014100:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480691968 00000100:00100000:1.0:1716999788.014207:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480692096 00000100:00100000:1.0:1716999788.014211:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480692096 00000100:00100000:1.0:1716999788.014236:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45473 00000100:00100000:1.0:1716999788.014242:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+734:11419:x1800404480691968:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.014260:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.014276:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc557b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658e4 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.014300:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc557b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658e4 expref: 735 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.014310:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc557b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658e4 expref: 735 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.014317:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.014319:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.014322:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364d80, rc 0) 00000100:00100000:1.0:1716999788.014354:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+735:11419:x1800404480691968:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 111us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.014360:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45473 00000100:00100000:1.0:1716999788.014373:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45474 00000100:00100000:1.0:1716999788.014377:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+734:11420:x1800404480692096:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.014383:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.014390:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5582 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658eb expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.014444:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5589 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.014451:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc40:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.014457:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc40:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999788.014468:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc40:0x0]: returning size 0 00010000:00010000:1.0:1716999788.015660:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc5582 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658eb expref: 737 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.015672:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5589 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc40:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658eb expref: 736 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.015678:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc40:0x0].0x0 (ffff880131c40100) 00010000:00010000:1.0:1716999788.015680:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1716999788.015681:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365b00, rc 0) 00000100:00100000:1.0:1716999788.015700:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+736:11420:x1800404480692096:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1323us (1670us total) trans 4294985998 rc 0/0 00000100:00100000:1.0:1716999788.015705:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45474 00000100:00100000:0.0:1716999788.017452:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.017511:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480692160 00000100:00100000:2.0:1716999788.017517:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480692160 00000100:00100000:2.0:1716999788.017552:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9067 00000100:00100000:2.0:1716999788.017557:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+736:11419:x1800404480692160:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999788.018398:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.018512:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480692224 00000100:00100000:2.0:1716999788.018516:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480692224 00000100:00100000:2.0:1716999788.019542:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9980 00000100:00100000:2.0:1716999788.019548:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+97:11420:x1800404480692224:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.019559:0:17700:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.019571:0:17700:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658f2 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.019589:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc555f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658d6 expref: 98 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.019595:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.019597:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.019599:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f2 expref: 98 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.019619:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc555f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658d6 expref: 98 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.019628:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc555f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658d6 expref: 98 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.019637:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17700:1800404483009536:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.019713:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1716999788.021975:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.021995:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480692288 00000100:00100000:1.0:1716999788.022000:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480692288 00010000:00010000:1.0:1716999788.022021:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc555f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658d6 expref: 99 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999788.022047:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4516 00000100:00100000:1.0:1716999788.022052:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+99:1958:x1800404480692288:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999788.022060:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999788.022074:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc555f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658d6 expref: 99 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.022083:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc555f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658d6 expref: 99 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.022099:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.022100:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.022105:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f2 expref: 99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.022113:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f2 expref: 99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.022135:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f2 expref: 99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.022144:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483009600:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999788.022175:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930ef180 going to sleep for 11 seconds 00010000:00010000:3.0:1716999788.022280:0:17700:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc555f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658d6 expref: 99 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.022290:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17700:1800404483009536:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999788.022305:0:17700:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f2 expref: 98 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.022312:0:17700:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8480, rc 0) 00000100:00100000:3.0:1716999788.022332:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+98:11420:x1800404480692224:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2784us (3935us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.022338:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9980 00000100:00100000:0.0:1716999788.023242:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+736:11419:x1800404480692160:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5681us (5791us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.023251:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9067 00000100:00100000:1.0:1716999788.023913:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483009600:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999788.023927:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999788.023957:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+97:1958:x1800404480692288:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1903us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.023962:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4516 00000100:00100000:0.0:1716999788.025409:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.025468:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480692352 00000100:00100000:1.0:1716999788.025473:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480692352 00000100:00100000:1.0:1716999788.025505:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45475 00000100:00100000:1.0:1716999788.025511:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+736:11419:x1800404480692352:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.025527:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.025542:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc559e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f658f9 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.025586:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc55a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025596:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc55a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025604:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc55a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025615:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc55ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025620:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc55ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025625:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc55ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025674:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc55a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025679:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc55a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025685:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc55a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025690:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.025693:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc55a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025698:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc55a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025711:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.025713:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.025716:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc55a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025720:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc55a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025730:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc55ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025734:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc55ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025739:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc55ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025743:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091367600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.025745:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc55ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025749:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc55ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025756:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xec6f74b7 (ffff880135ac4500) 00010000:00010000:1.0:1716999788.025758:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.025760:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc55ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025764:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc55ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.025794:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc559e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f9 expref: 737 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.025801:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc559e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f9 expref: 737 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.025810:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365440, rc 0) 00000100:00100000:1.0:1716999788.025847:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+736:11419:x1800404480692352:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 336us (440us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.025853:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45475 00000100:00100000:0.0:1716999788.026321:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.026405:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480692416 00000100:00100000:2.0:1716999788.026409:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480692416 00000100:00100000:2.0:1716999788.026430:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45476 00000100:00100000:2.0:1716999788.026434:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+736:11420:x1800404480692416:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.026441:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.026449:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65900 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.026472:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc55ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026479:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc55ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026485:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc55ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026494:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026499:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026503:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026534:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc55ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026539:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc55ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026543:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc55ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026547:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.026549:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc55ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026553:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc55ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026559:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.026561:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.026564:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc55ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026567:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc55ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026578:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026582:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026586:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026590:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.026593:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026597:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026602:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x863a7a8e (ffff8800990eae00) 00010000:00010000:2.0:1716999788.026604:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.026606:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026610:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.026637:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55b3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65900 expref: 737 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.026645:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65900 expref: 737 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.026651:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9b00, rc 0) 00000100:00100000:2.0:1716999788.026670:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+736:11420:x1800404480692416:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 235us (350us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.026676:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45476 00000100:00100000:0.0:1716999788.028690:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.028726:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.028785:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480692608 00000100:00100000:2.0:1716999788.028790:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480692608 00000100:00100000:1.0:1716999788.028864:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480692480 00000100:00100000:1.0:1716999788.028868:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480692480 00000100:00100000:1.0:1716999788.028907:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45477 00000100:00100000:3.0:1716999788.029189:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9068 00000100:00100000:3.0:1716999788.029196:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+737:11419:x1800404480692608:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999788.029503:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11441, 168 off2046376 00000001:00080000:3.0:1716999788.029508:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294985999 00000100:00100000:3.0:1716999788.029569:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+739:11419:x1800404480692608:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 372us (841us total) trans 4294986000 rc 0/0 00000100:00100000:3.0:1716999788.029578:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9068 00000020:00080000:3.0:1716999788.029581:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999788.029714:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+738:11420:x1800404480692480:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.029722:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.029733:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc55c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65907 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.029753:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc55c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65907 expref: 739 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.029763:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc55c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65907 expref: 739 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.029770:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.029772:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.029774:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365d40, rc 0) 00000100:00100000:1.0:1716999788.029800:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+739:11420:x1800404480692480:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 87us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.030408:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45477 00000100:00100000:0.0:1716999788.031947:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.032157:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480692672 00000100:00100000:2.0:1716999788.032163:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480692672 00000100:00100000:2.0:1716999788.032197:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9069 00000100:00100000:2.0:1716999788.032202:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+739:11420:x1800404480692672:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999788.033384:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.033448:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480692800 00000100:00100000:1.0:1716999788.033453:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480692800 00000100:00100000:1.0:1716999788.033473:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45478 00000100:00100000:1.0:1716999788.033478:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+741:11419:x1800404480692800:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999788.033509:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1716999788.033527:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc53e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc3d:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6584a expref: 741 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.033543:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc53b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6582e expref: 740 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.033552:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3d:0x0].0x0 (ffff8800939ba300) 00010000:00010000:1.0:1716999788.033564:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc557b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658e4 expref: 739 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.033573:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.033576:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.033590:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc55cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.033599:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc55cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.033607:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc55cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.033616:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc55d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.033626:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc55d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.033631:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc55d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.033698:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc55dd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.033705:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc55dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.033710:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc55dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:1.0:1716999788.034132:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1483, 64 off103168 00000040:00080000:1.0:1716999788.034150:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11442, 184 off2046560 00010000:00010000:1.0:1716999788.034199:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc55e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034207:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc55e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034213:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc55e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034218:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc55e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034222:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc55e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034227:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc55e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034236:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc55e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034241:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999788.034244:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc55e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034249:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc55e4 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034256:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3d:0x0].0x0 (ffff880135ac4e00) 00010000:00010000:1.0:1716999788.034258:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999788.034261:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc55e4 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034265:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc55e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034281:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc55dd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034286:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc55dd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034290:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc55dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034294:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.034297:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc55dd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034301:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc55dd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034310:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3d:0x0].0x0 (ffff880135ac4e00) 00010000:00010000:1.0:1716999788.034312:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999788.034314:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc55dd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034318:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc55dd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034350:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc55cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034354:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc55cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034359:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc55cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034362:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.034365:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc55cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034369:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc55cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034375:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.034377:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.034379:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc55cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.034383:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc55cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999788.034390:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339ff480 reply state ffff880099960000 transno 4294986001 ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc55d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999788.034396:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999788.034432:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+740:11419:x1800404480692800:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 953us (1049us total) trans 4294986001 rc 0/0 00000100:00100000:1.0:1716999788.034438:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45478 00000100:00100000:2.0:1716999788.036195:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+738:11420:x1800404480692672:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3988us (4246us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.036204:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9069 00000100:00100000:1.0:1716999788.039780:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999788.040018:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc55d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.040026:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc55d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.040031:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc55d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.040036:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.040039:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc55d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.040045:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc55d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.040057:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x19f5fa5d (ffff880135ac4f00) 00010000:00010000:2.0:1716999788.040059:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.040063:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc55d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.040066:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc55d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999788.041058:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.041208:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480693056 00000100:00100000:2.0:1716999788.041216:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480693056 00000100:00100000:2.0:1716999788.041242:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45479 00000100:00100000:2.0:1716999788.041249:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+737:11420:x1800404480693056:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.041267:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.041279:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc55eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6590e expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.041357:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041367:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041375:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041385:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041392:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041396:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041426:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041431:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041436:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041441:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.041443:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041448:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041454:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.041456:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.041459:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041463:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc55f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041470:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041475:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041480:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041483:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.041485:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041489:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041495:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x863a7a8e (ffff8800990ead00) 00010000:00010000:2.0:1716999788.041497:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.041499:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041503:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc55f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x863a7a8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.041524:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc55eb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6590e expref: 738 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.041531:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc55eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6590e expref: 738 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.041537:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9f80, rc 0) 00000100:00100000:3.0:1716999788.041654:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480692928 00000100:00100000:3.0:1716999788.041657:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480692928 00000100:00100000:3.0:1716999788.041678:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9070 00000100:00100000:3.0:1716999788.041682:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec23050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+738:11419:x1800404480692928:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999788.041995:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11443, 168 off2046728 00000001:00080000:3.0:1716999788.042000:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986002 00000100:00100000:3.0:1716999788.042437:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec23050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+740:11419:x1800404480692928:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 754us (2663us total) trans 4294986003 rc 0/0 00000100:00100000:3.0:1716999788.042444:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9070 00000020:00080000:3.0:1716999788.042448:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999788.042505:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+740:11420:x1800404480693056:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1176us (1368us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.042512:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45479 00000100:00100000:0.0:1716999788.043855:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.043955:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480693184 00000100:00100000:2.0:1716999788.043960:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480693184 00000100:00100000:2.0:1716999788.043980:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45480 00000100:00100000:2.0:1716999788.043989:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+739:11419:x1800404480693184:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999788.044018:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999788.044031:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc52fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc3c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657fd expref: 739 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.044043:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc52c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc3c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f657e8 expref: 738 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.044050:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3c:0x0].0x0 (ffff880135ac4200) 00010000:00010000:2.0:1716999788.044056:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999788.044070:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5600 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044079:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5600 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044084:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5600 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044093:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5607 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044098:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5607 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044103:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5607 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044169:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc560e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044174:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc560e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044179:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc560e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:2.0:1716999788.044509:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1480, 64 off102976 00000004:00080000:2.0:1716999788.044514:0:6822:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307243633459ns, next at 308243631964ns, rc = 0 00000040:00080000:2.0:1716999788.044529:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11444, 176 off2046904 00010000:00010000:2.0:1716999788.044576:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5615 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044583:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044588:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044593:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5615 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044597:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5615 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044601:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044605:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5615 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044610:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8900 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999788.044612:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5615 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044617:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5615 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044626:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3c:0x0].0x0 (ffff8800990eaf00) 00010000:00010000:2.0:1716999788.044628:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999788.044630:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5615 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044634:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5615 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc3c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044647:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc560e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044651:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc560e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044655:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc560e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044659:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.044661:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc560e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044665:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc560e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044670:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3c:0x0].0x0 (ffff8800990eaf00) 00010000:00010000:2.0:1716999788.044672:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999788.044674:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc560e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044678:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc560e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044709:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5600 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044714:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5600 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044717:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5600 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044720:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.044722:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5600 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044725:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5600 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044729:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.044731:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.044732:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5600 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.044736:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5600 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999788.044741:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339ff100 reply state ffff88013201d000 transno 4294986004 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5607 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999788.044745:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999788.044780:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+739:11419:x1800404480693184:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 791us (928us total) trans 4294986004 rc 0/0 00000100:00100000:2.0:1716999788.044785:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45480 00000100:00100000:0.0:1716999788.044860:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.045035:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480693248 00000100:00100000:1.0:1716999788.045039:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480693248 00000100:00100000:1.0:1716999788.045066:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45481 00000100:00100000:1.0:1716999788.045070:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+739:11420:x1800404480693248:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.045078:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.045088:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc561c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65915 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.045113:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5623 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045119:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045124:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045134:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc562a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x86397a9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045138:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc562a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045143:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc562a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045174:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045178:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5623 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045182:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045186:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091367600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.045188:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045193:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5623 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045198:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.045200:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.045202:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5623 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045206:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5623 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045213:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc562a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045217:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc562a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045220:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc562a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045227:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.045229:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc562a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045233:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc562a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045237:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x86397a9e (ffff880135ac4a00) 00010000:00010000:1.0:1716999788.045238:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.045240:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc562a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045243:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc562a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.045271:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc561c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65915 expref: 740 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.045277:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc561c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65915 expref: 740 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.045285:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365440, rc 0) 00000100:00100000:1.0:1716999788.045304:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+739:11420:x1800404480693248:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 233us (444us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.045309:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45481 00010000:00010000:1.0:1716999788.046439:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5607 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.046445:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5607 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.046453:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5607 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.046458:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.046460:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5607 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.046465:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5607 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.046473:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x2253fa11 (ffff8800990ea700) 00010000:00010000:1.0:1716999788.046476:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.046478:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5607 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.046486:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5607 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999788.046794:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.046865:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480693312 00000100:00100000:2.0:1716999788.046870:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480693312 00000100:00100000:2.0:1716999788.047106:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45482 00000100:00100000:2.0:1716999788.047112:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+738:11419:x1800404480693312:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.047124:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.047134:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5631 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6591c expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.047162:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5638 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047170:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047175:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047184:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc563f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047188:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc563f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047193:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc563f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047235:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5638 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047239:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5638 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047243:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047247:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaf40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.047249:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5638 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047254:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5638 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047259:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.047261:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.047263:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047267:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047274:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc563f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047279:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc563f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047283:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc563f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047286:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.047288:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc563f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047292:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc563f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047297:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x52a89496 (ffff8800990ea600) 00010000:00010000:2.0:1716999788.047298:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.047300:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc563f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047305:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc563f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.047331:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5631 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6591c expref: 739 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.047337:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5631 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6591c expref: 739 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.047343:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8fc0, rc 0) 00000100:00100000:2.0:1716999788.047366:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+738:11419:x1800404480693312:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 254us (573us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.047371:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45482 00000100:00100000:0.0:1716999788.048908:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.048961:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.049068:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480693504 00000100:00100000:2.0:1716999788.049068:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480693440 00000100:00100000:3.0:1716999788.049073:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480693504 00000100:00100000:2.0:1716999788.049073:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480693440 00000100:00100000:2.0:1716999788.049103:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45483 00000100:00100000:2.0:1716999788.049108:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+739:11420:x1800404480693440:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:3.0:1716999788.049110:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45484 00000100:00100000:3.0:1716999788.049114:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+739:11419:x1800404480693504:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.049118:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.049119:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.049120:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1716999788.049128:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5646 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6592a expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.049136:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc55c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65907 expref: 740 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.049144:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6592a expref: 739 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.049146:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.049149:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999788.049152:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6592a expref: 739 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.049153:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc564d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65923 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.049157:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.049160:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.049162:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdfcc0, rc 0) 00000100:00100000:3.0:1716999788.049189:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+740:11419:x1800404480693504:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 73us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.049194:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45484 00010000:00010000:2.0:1716999788.049221:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5654 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.049228:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5654 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.049234:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5654 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.049242:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc565b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.049246:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc565b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.049249:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc565b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:2.0:1716999788.049786:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x605:0x0], index 1: 0 00000040:00080000:2.0:1716999788.049861:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11445, 184 off2047088 00010000:00010000:2.0:1716999788.050087:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5662 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.050094:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.050100:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.050123:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5654 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.050127:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5654 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.050131:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5654 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.050135:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.050138:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5654 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.050142:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5654 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.050149:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.050151:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.050153:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5654 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.050157:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5654 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999788.050165:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339fd500 reply state ffff880091f8d000 transno 4294986005 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc565b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999788.050170:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999788.050186:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc564d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65923 expref: 741 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.050194:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65923 expref: 740 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.050199:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc41:0x0].0x0 (ffff8800990eae00) 00010000:00010000:2.0:1716999788.050201:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999788.050203:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9f80, rc 0) 00000100:00100000:2.0:1716999788.050236:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+741:11420:x1800404480693440:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1127us (1330us total) trans 4294986005 rc 0/0 00000100:00100000:2.0:1716999788.050242:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45483 00000100:00100000:0.0:1716999788.051145:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.051331:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480693568 00000100:00100000:3.0:1716999788.051336:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480693568 00000100:00100000:3.0:1716999788.051370:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9071 00000100:00100000:3.0:1716999788.051374:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+741:11419:x1800404480693568:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:2.0:1716999788.052258:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc565b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.052266:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc565b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.052271:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc565b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.052276:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e86c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.052279:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc565b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.052284:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc565b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.052293:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x86397a9e (ffff8800990eaa00) 00010000:00010000:2.0:1716999788.052296:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.052298:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc565b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.052302:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc565b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999788.052646:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.053107:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480693632 00000100:00100000:3.0:1716999788.053112:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480693632 00000100:00100000:3.0:1716999788.053144:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9981 00000100:00100000:3.0:1716999788.053149:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+101:1958:x1800404480693632:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.053159:0:17700:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.053171:0:17700:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc5670 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65931 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999788.053186:0:17700:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x605:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999788.053366:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.053369:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.053375:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc5670 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65931 expref: 102 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.053385:0:17700:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc5670 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65931 expref: 102 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.053394:0:17700:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf600, rc 0) 00000100:00100000:3.0:1716999788.053428:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+102:1958:x1800404480693632:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 277us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.053434:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9981 00000100:00100000:3.0:1716999788.056187:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+740:11419:x1800404480693568:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4806us (5036us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.056196:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9071 00000100:00100000:1.0:1716999788.056489:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.056869:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480693760 00000100:00100000:3.0:1716999788.056876:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480693760 00000100:00100000:3.0:1716999788.057054:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9072 00000100:00100000:3.0:1716999788.057060:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+740:11420:x1800404480693760:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999788.057389:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11446, 168 off2047256 00000001:00080000:3.0:1716999788.057395:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986006 00000100:00100000:3.0:1716999788.057473:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+742:11420:x1800404480693760:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 413us (985us total) trans 4294986007 rc 0/0 00000100:00100000:3.0:1716999788.057480:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9072 00000020:00080000:3.0:1716999788.057483:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999788.060347:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.061554:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480693824 00000100:00100000:2.0:1716999788.061562:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480693824 00000100:00100000:2.0:1716999788.061606:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45485 00000100:00100000:2.0:1716999788.061612:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+742:11419:x1800404480693824:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.061627:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.061641:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5677 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65938 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.061685:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc567e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061697:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc567e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061705:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc567e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061716:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5685 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061721:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061726:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061774:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc567e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061779:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc567e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061784:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc567e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061789:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.061792:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc567e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061797:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc567e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061806:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.061809:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.061825:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc567e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061830:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc567e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061839:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061844:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5685 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061848:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061852:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaf40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.061855:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061860:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061866:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x52a89496 (ffff8800990ea600) 00010000:00010000:2.0:1716999788.061868:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.061870:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5685 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061874:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5685 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.061918:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5677 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65938 expref: 743 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.061925:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5677 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65938 expref: 743 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.061934:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8fc0, rc 0) 00000100:00100000:2.0:1716999788.061969:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+742:11419:x1800404480693824:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 356us (1626us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.061975:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45485 00000100:00100000:0.0:1716999788.062058:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.062167:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480693952 00000100:00100000:2.0:1716999788.062170:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480693952 00000100:00100000:2.0:1716999788.063092:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45486 00000100:00100000:2.0:1716999788.063098:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+742:11420:x1800404480693952:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.063108:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.063116:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc568c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6593f expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.063164:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5693 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.063172:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5693 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc41:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.063178:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5693 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc41:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:2.0:1716999788.063185:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc41:0x0]: returning size 0 00010000:00010000:2.0:1716999788.063265:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc568c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6593f expref: 745 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.063275:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5693 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc41:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6593f expref: 744 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.063284:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc41:0x0].0x0 (ffff8800990eae00) 00010000:00010000:2.0:1716999788.063287:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999788.063288:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eaac0, rc 0) 00000100:00100000:2.0:1716999788.063323:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+744:11420:x1800404480693952:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 224us (1264us total) trans 4294986008 rc 0/0 00000100:00100000:2.0:1716999788.063329:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45486 00000100:00100000:1.0:1716999788.067304:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.067352:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.067468:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694016 00000100:00100000:2.0:1716999788.067474:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694016 00000100:00100000:2.0:1716999788.067499:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45487 00000100:00100000:2.0:1716999788.067504:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+744:11419:x1800404480694016:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.067516:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.067527:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc56a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65946 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.067560:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc56a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067569:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc56a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067576:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc56a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067585:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc56af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067590:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc56af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067597:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc56af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067643:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc56a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067648:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc56a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067654:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc56a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067658:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.067661:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc56a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067667:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc56a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067675:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.067678:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.067681:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc56a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067685:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc56a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067694:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc56af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067699:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc56af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067707:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc56af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067711:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.067713:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc56af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067718:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc56af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067723:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x17a4f95f (ffff8800990eab00) 00010000:00010000:2.0:1716999788.067725:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.067727:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc56af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067731:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc56af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.067762:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc56a1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65946 expref: 745 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.067768:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc56a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65946 expref: 745 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.067775:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8900, rc 0) 00000100:00100000:2.0:1716999788.067807:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+744:11419:x1800404480694016:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 302us (507us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.067826:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45487 00000100:00100000:3.0:1716999788.067957:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694080 00000100:00100000:3.0:1716999788.067961:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694080 00000100:00100000:3.0:1716999788.067996:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9982 00000100:00100000:3.0:1716999788.068000:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+102:11420:x1800404480694080:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.068007:0:17700:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.068016:0:17700:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6594d expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.068031:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc5670 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65931 expref: 103 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.068050:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.068052:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.068055:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6594d expref: 103 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.068082:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc5670 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65931 expref: 103 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.068091:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc5670 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65931 expref: 103 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.068102:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e442a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483009664:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999788.068132:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e3bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.072825:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.072875:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.073024:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e442a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483009664:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999788.073048:0:17700:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6594d expref: 103 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.073061:0:17700:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcfc0, rc 0) 00000100:00100000:3.0:1716999788.073090:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+103:11420:x1800404480694080:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 5089us (5737us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.073097:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9982 00000100:00100000:2.0:1716999788.073418:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694144 00000100:00100000:2.0:1716999788.073424:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694144 00000100:00100000:2.0:1716999788.073461:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45488 00000100:00100000:2.0:1716999788.073466:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+744:11419:x1800404480694144:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.073481:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.073494:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc56bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65954 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.073537:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc56c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073548:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc56c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073556:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc56c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073601:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc56cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073608:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc56cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073614:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc56cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999788.073622:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694208 00000100:00100000:1.0:1716999788.073625:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694208 00010000:00010000:1.0:1716999788.073638:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc5670 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65931 expref: 103 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999788.073664:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc56c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073670:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc56c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073675:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc56c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073679:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.073682:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc56c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073688:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc56c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073696:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.073698:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.073700:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc56c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073704:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc56c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073713:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc56cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073717:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc56cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073721:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc56cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073724:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.073726:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc56cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073729:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc56cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073733:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x17f1f861 (ffff8800990eaf00) 00010000:00010000:2.0:1716999788.073735:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.073736:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc56cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073743:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc56cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.073769:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc56bd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65954 expref: 745 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.073775:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc56bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65954 expref: 745 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.073781:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e86c0, rc 0) 00000100:00100000:2.0:1716999788.073821:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+744:11419:x1800404480694144:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 345us (1002us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.073827:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45488 00000100:00100000:1.0:1716999788.074023:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4517 00000100:00100000:1.0:1716999788.074028:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+103:1956:x1800404480694208:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999788.074041:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999788.074055:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc5670 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65931 expref: 103 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.074064:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc5670 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65931 expref: 103 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.074076:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdf600/0x6d188eabd8dc5670 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65931 expref: 103 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.074088:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.074089:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.074094:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6594d expref: 102 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.074101:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6594d expref: 102 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.074124:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6594d expref: 102 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.074139:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483009728:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999788.074178:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800930efc00 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.075543:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.075611:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483009728:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999788.075623:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999788.075643:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+102:1956:x1800404480694208:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1615us (2768us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.075650:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4517 00000100:00100000:2.0:1716999788.075786:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694336 00000100:00100000:2.0:1716999788.075790:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694336 00000100:00100000:2.0:1716999788.075996:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45489 00000100:00100000:2.0:1716999788.076002:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+744:11419:x1800404480694336:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.076012:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.076023:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc56d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6595b expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.076081:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc56d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076090:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc56d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076097:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc56d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076110:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc56e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076114:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc56e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076119:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc56e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076147:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc56d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076152:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc56d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076162:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc56d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076166:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8801339fba80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.076169:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc56d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076175:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc56d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076183:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.076186:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.076188:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc56d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076192:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc56d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076199:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc56e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076203:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc56e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076208:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc56e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076211:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8801339f9f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.076213:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc56e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076217:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc56e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076222:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x17f1f861 (ffff8800990ead00) 00010000:00010000:2.0:1716999788.076224:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.076226:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc56e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076230:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc56e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.076252:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc56d2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6595b expref: 745 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.076259:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc56d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6595b expref: 745 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.076266:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb3c0, rc 0) 00000100:00100000:2.0:1716999788.076285:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+744:11419:x1800404480694336:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 284us (745us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.076403:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45489 00000100:00100000:0.0:1716999788.076906:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.076967:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694400 00000100:00100000:2.0:1716999788.076972:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694400 00000100:00100000:2.0:1716999788.077021:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45490 00000100:00100000:2.0:1716999788.077030:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+744:11420:x1800404480694400:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.077038:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.077046:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc56e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65962 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.077071:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc56ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077079:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc56ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077084:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc56ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077093:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc56f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077098:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc56f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077102:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc56f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077135:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc56ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077140:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc56ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077145:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc56ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077150:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a8903cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.077152:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc56ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077156:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc56ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077163:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.077165:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.077167:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc56ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077171:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc56ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077178:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc56f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077182:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc56f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077186:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc56f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077190:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a8901d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.077192:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc56f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077196:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc56f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077202:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x85ed8f9c (ffff8800990eaa00) 00010000:00010000:2.0:1716999788.077204:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.077206:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc56f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077210:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc56f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x85ed8f9c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.077242:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc56e7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65962 expref: 745 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.077248:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc56e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65962 expref: 745 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.077255:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801339f8240, rc 0) 00000100:00100000:2.0:1716999788.077286:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+744:11420:x1800404480694400:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 255us (380us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.077291:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45490 00000100:00100000:0.0:1716999788.077334:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.077350:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694464 00000100:00100000:3.0:1716999788.077354:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694464 00000100:00100000:3.0:1716999788.077370:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45491 00000100:00100000:3.0:1716999788.077375:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+744:11419:x1800404480694464:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.077382:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.077388:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc56fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65969 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.077408:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5703 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077414:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5703 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077420:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5703 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077429:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc570a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077435:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc570a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077440:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc570a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077466:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5703 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077471:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5703 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077475:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5703 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077479:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.077481:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5703 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077486:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5703 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077492:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.077494:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.077496:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5703 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077500:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5703 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077521:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc570a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077526:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc570a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077530:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc570a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077534:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.077536:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc570a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077541:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc570a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077546:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x17a4f95f (ffff88009439c200) 00010000:00010000:3.0:1716999788.077549:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.077551:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc570a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077555:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc570a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.077582:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc56fc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65969 expref: 745 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.077588:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc56fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65969 expref: 745 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.077594:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:3.0:1716999788.077626:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+744:11419:x1800404480694464:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 250us (292us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.077632:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45491 00000100:00100000:2.0:1716999788.078854:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.078910:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694528 00000100:00100000:0.0:1716999788.078914:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694528 00000100:00100000:0.0:1716999788.078944:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45492 00000100:00100000:0.0:1716999788.078950:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+744:11420:x1800404480694528:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.078958:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.078966:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5711 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65970 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.078979:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65970 expref: 745 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.078988:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65970 expref: 745 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.078994:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.078996:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.078998:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c240, rc 0) 00000100:00100000:0.0:1716999788.079025:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+745:11420:x1800404480694528:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 75us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.079029:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45492 00000100:00100000:0.0:1716999788.079400:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.079524:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694656 00000100:00100000:3.0:1716999788.079528:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694656 00000100:00100000:3.0:1716999788.079549:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45493 00000100:00100000:3.0:1716999788.079553:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+745:11419:x1800404480694656:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.079559:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.079566:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5718 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65977 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.079619:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc571f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079626:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc571f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079633:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc571f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079642:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079647:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079651:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079674:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc571f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079678:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc571f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079683:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc571f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079686:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.079688:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc571f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079693:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc571f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079699:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.079701:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.079703:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc571f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079707:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc571f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079713:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079717:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5726 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079722:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079725:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.079727:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079730:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5726 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079734:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x17a4f95f (ffff88009439cc00) 00010000:00010000:3.0:1716999788.079736:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.079737:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5726 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079740:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.079754:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5718 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65977 expref: 746 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.079760:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5718 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65977 expref: 746 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.079764:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde400, rc 0) 00000100:00100000:3.0:1716999788.079793:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+745:11419:x1800404480694656:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 239us (393us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.079797:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45493 00000100:00100000:0.0:1716999788.080578:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.080643:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694720 00000100:00100000:2.0:1716999788.080648:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694720 00000100:00100000:2.0:1716999788.080675:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9073 00000100:00100000:2.0:1716999788.080680:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+745:11420:x1800404480694720:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999788.081417:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.081695:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694784 00000100:00100000:1.0:1716999788.081699:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694784 00000100:00100000:1.0:1716999788.081731:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45494 00000100:00100000:1.0:1716999788.081735:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+747:11419:x1800404480694784:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.081743:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.081756:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc572d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6597e expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.081789:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5734 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.081798:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.081806:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.081827:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc573b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.081832:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc573b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.081837:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc573b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082308:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082314:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5734 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082319:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5734 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082324:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.082326:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5734 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082331:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5734 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082340:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.082342:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.082344:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5734 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082348:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5734 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082366:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc573b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082371:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc573b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082375:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc573b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082378:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091367600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.082381:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc573b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082385:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc573b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082391:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x17f1f861 (ffff880131c40b00) 00010000:00010000:1.0:1716999788.082393:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.082395:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc573b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082399:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc573b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.082430:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc572d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6597e expref: 748 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.082437:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc572d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6597e expref: 748 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.082446:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365440, rc 0) 00000100:00100000:1.0:1716999788.082473:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+747:11419:x1800404480694784:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 737us (1056us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.082479:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45494 00000100:00100000:3.0:1716999788.083268:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+745:11420:x1800404480694720:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2584us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.083279:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9073 00000100:00100000:0.0:1716999788.085210:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.085310:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694912 00000100:00100000:1.0:1716999788.085318:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694912 00000100:00100000:0.0:1716999788.085350:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.085429:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480694976 00000100:00100000:3.0:1716999788.085433:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480694976 00000100:00100000:3.0:1716999788.085765:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45495 00000100:00100000:3.0:1716999788.085773:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+746:11420:x1800404480694976:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:1.0:1716999788.085775:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45496 00000100:00100000:1.0:1716999788.085778:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+746:11419:x1800404480694912:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.085794:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.085799:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.085810:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5749 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6598c expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.085810:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5742 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65985 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.085928:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc5750 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.085938:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc5750 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.085950:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc5750 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.085962:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5757 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.085966:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.085971:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.086004:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc575e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086004:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc5750 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.086009:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc5750 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.086011:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc575e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086015:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc5750 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.086016:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc575e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086019:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.086022:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc5750 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.086025:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5765 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086027:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc5750 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.086030:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.086034:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086035:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.086037:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.086040:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc5750 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.086044:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc5750 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.086054:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.086058:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5757 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.086060:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc575e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086062:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5757 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.086064:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc575e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086066:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.086068:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5757 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.086069:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc575e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086072:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5757 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.086073:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddb00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.086075:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc575e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086077:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x17f1f861 (ffff880131c40d00) 00010000:00010000:3.0:1716999788.086079:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc575e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086079:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.086080:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5757 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.086084:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.086084:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc5757 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.086086:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.086088:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc575e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.086092:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc575e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.086097:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5765 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.086101:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5765 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.086104:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086105:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5742 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65985 expref: 748 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.086108:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.086110:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5765 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086111:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc5742 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65985 expref: 748 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.086114:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5765 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.086117:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364fc0, rc 0) 00010000:00010000:3.0:1716999788.086120:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xec6f74b7 (ffff8800a5486100) 00010000:00010000:3.0:1716999788.086121:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.086123:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5765 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.086126:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5765 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.086149:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5749 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6598c expref: 747 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.086155:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5749 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6598c expref: 747 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.086160:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde1c0, rc 0) 00000100:00100000:1.0:1716999788.086301:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+746:11419:x1800404480694912:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 519us (1096us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.086307:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45496 00000100:00100000:3.0:1716999788.086371:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+745:11420:x1800404480694976:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 599us (1020us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.086376:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45495 00000100:00100000:0.0:1716999788.088163:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.088326:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480695040 00000100:00100000:3.0:1716999788.088333:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480695040 00000100:00100000:3.0:1716999788.088373:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45497 00000100:00100000:3.0:1716999788.088379:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+745:11419:x1800404480695040:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.088395:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.088408:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc576c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65993 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.088450:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5773 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088463:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5773 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088471:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5773 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088482:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc577a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088487:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc577a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088492:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc577a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088543:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5773 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088549:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5773 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088554:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5773 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088558:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.088561:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5773 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088566:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5773 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088575:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.088577:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.088580:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5773 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088584:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5773 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088598:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc577a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088602:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc577a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088606:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc577a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088610:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.088612:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc577a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088616:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc577a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088622:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x17a4f95f (ffff88009240e200) 00010000:00010000:3.0:1716999788.088624:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.088626:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc577a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088630:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc577a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.088659:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc576c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65993 expref: 746 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.088666:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc576c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65993 expref: 746 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.088673:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcd80, rc 0) 00000100:00100000:3.0:1716999788.088718:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+745:11419:x1800404480695040:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 338us (559us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.088724:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45497 00000100:00100000:0.0:1716999788.090725:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.091336:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480695168 00000100:00100000:3.0:1716999788.091344:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480695168 00000100:00100000:3.0:1716999788.091375:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9074 00000100:00100000:3.0:1716999788.091382:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+745:11420:x1800404480695168:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999788.091707:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11447, 168 off2047424 00000001:00080000:3.0:1716999788.091712:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986009 00000100:00100000:3.0:1716999788.091795:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+747:11420:x1800404480695168:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 413us (1074us total) trans 4294986010 rc 0/0 00000100:00100000:3.0:1716999788.091802:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9074 00000020:00080000:3.0:1716999788.091806:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1716999788.091830:0:6811:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1716999788.093057:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.093179:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480695296 00000100:00100000:1.0:1716999788.093186:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480695296 00000100:00100000:1.0:1716999788.093222:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45498 00000100:00100000:1.0:1716999788.093227:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+747:11419:x1800404480695296:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.093238:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.093241:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999788.093259:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6592a expref: 747 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.093269:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.093272:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.093282:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5781 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6599a expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.093368:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5788 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.093378:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5788 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.093386:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5788 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.093395:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc578f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.093401:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc578f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.093408:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc578f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:1.0:1716999788.093767:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x605:0x0], index 0: 0 00000040:00080000:1.0:1716999788.093838:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11448, 184 off2047608 00010000:00010000:1.0:1716999788.093947:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.093954:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.093960:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.093980:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5788 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.093985:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5788 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.093990:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5788 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.093994:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091367600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.093997:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5788 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.094002:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5788 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.094009:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.094011:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.094014:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5788 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.094018:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc5788 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:1.0:1716999788.094026:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a6a0a80 reply state ffff8800b18fd000 transno 4294986011 ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc578f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999788.094031:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999788.094046:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5781 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6599a expref: 749 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.094056:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc42:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6599a expref: 748 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.094061:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc42:0x0].0x0 (ffff880135ac4e00) 00010000:00010000:1.0:1716999788.094063:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999788.094065:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364d80, rc 0) 00000100:00100000:1.0:1716999788.094098:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+749:11419:x1800404480695296:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 870us (1044us total) trans 4294986011 rc 0/0 00000100:00100000:1.0:1716999788.094104:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45498 00000100:00100000:0.0:1716999788.094525:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.094614:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480695424 00000100:00100000:3.0:1716999788.094619:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480695424 00000100:00100000:3.0:1716999788.094640:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45499 00000100:00100000:3.0:1716999788.094645:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+749:11420:x1800404480695424:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999788.094670:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1716999788.094681:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc5589 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc40:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658eb expref: 749 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.094694:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5551 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658c8 expref: 748 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.094705:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc40:0x0].0x0 (ffff880131c40100) 00010000:00010000:3.0:1716999788.094717:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5711 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65970 expref: 747 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.094724:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.094726:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999788.094738:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc57a4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.094745:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc57a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.094751:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc57a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.094759:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc57ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.094764:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc57ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.094768:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc57ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.094842:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc57b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.094848:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc57b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.094853:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc57b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:3.0:1716999788.095234:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1481, 64 off103040 00000040:00080000:3.0:1716999788.095249:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11449, 184 off2047792 00010000:00010000:3.0:1716999788.095295:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc57b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095301:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc57b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095307:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc57b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095312:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc57b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095316:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc57b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095321:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc57b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095326:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc57b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095330:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999788.095332:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc57b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095337:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc57b9 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095343:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc40:0x0].0x0 (ffff880091b4db00) 00010000:00010000:3.0:1716999788.095345:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999788.095347:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc57b9 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095352:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc57b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095366:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc57b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095371:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc57b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095375:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc57b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095379:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.095381:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc57b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095386:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc57b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095391:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc40:0x0].0x0 (ffff880091b4db00) 00010000:00010000:3.0:1716999788.095392:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999788.095394:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc57b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095398:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc57b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095427:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc57a4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095432:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc57a4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095435:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc57a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095439:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.095441:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc57a4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095445:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc57a4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095451:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.095452:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.095454:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc57a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.095459:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc57a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:3.0:1716999788.095464:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a6a3b80 reply state ffff8800926f1000 transno 4294986012 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc57ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999788.095469:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999788.095510:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+748:11420:x1800404480695424:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 858us (979us total) trans 4294986012 rc 0/0 00000100:00100000:3.0:1716999788.095516:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45499 00010000:00010000:1.0:1716999788.096563:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc578f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.096571:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc578f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.096575:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc578f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.096579:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.096582:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc578f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.096587:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc578f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.097342:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x17a4f95f (ffff880135ac4200) 00010000:00010000:1.0:1716999788.097345:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.097348:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc578f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.097354:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc578f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.097738:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc57ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.097745:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc57ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.097753:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc57ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.097757:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.097760:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc57ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.097765:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc57ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.097772:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x19f5fa5d (ffff88009240e800) 00010000:00010000:2.0:1716999788.097774:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.097776:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc57ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.097779:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc57ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x19f5fa5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999788.098808:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.098858:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.098953:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480695488 00000100:00100000:2.0:1716999788.098960:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480695488 00000100:00100000:2.0:1716999788.098991:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9983 00000100:00100000:2.0:1716999788.098997:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+97:1958:x1800404480695488:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.099011:0:17700:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.099026:0:17700:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc57c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659a1 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999788.099044:0:17700:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x605:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999788.099058:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.099060:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.099065:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc57c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659a1 expref: 98 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.099077:0:17700:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc57c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659a1 expref: 98 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.099086:0:17700:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8901d40, rc 0) 00000100:00100000:2.0:1716999788.099121:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+98:1958:x1800404480695488:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 124us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.099126:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9983 00000100:00100000:1.0:1716999788.099219:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480695616 00000100:00100000:1.0:1716999788.099223:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480695616 00000100:00100000:1.0:1716999788.099240:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9075 00000100:00100000:1.0:1716999788.099244:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+746:11420:x1800404480695616:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999788.099582:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11450, 168 off2047960 00000001:00080000:1.0:1716999788.099587:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986013 00000100:00100000:1.0:1716999788.099637:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+748:11420:x1800404480695616:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 392us (778us total) trans 4294986014 rc 0/0 00000100:00100000:1.0:1716999788.099643:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9075 00000020:00080000:1.0:1716999788.099646:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999788.101988:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.102031:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.102141:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480695744 00000100:00100000:2.0:1716999788.102149:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480695744 00000100:00100000:2.0:1716999788.102178:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45500 00000100:00100000:2.0:1716999788.102184:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+748:11420:x1800404480695744:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999788.102222:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999788.102241:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc549b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc3e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65890 expref: 748 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.102257:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc547f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6587b expref: 747 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.102265:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3e:0x0].0x0 (ffff8800910ce000) 00010000:00010000:2.0:1716999788.102272:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999788.102294:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc57c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102304:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc57c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102312:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc57c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102323:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc57ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102328:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc57ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102333:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc57ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102415:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc57d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102421:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc57d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102426:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc57d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:2.0:1716999788.102827:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1482, 64 off103104 00000040:00080000:2.0:1716999788.102900:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11452, 176 off2048176 00010000:00010000:2.0:1716999788.102954:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc57dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102961:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc57dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102967:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc57dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102972:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc57dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102976:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc57dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102985:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc57dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102990:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc57dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.102994:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8801339f8240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999788.102998:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc57dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103003:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc57dc lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103009:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3e:0x0].0x0 (ffff8800990ea700) 00010000:00010000:2.0:1716999788.103011:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999788.103013:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc57dc lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103018:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc57dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103034:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc57d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103038:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc57d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103042:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc57d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103046:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a8901680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.103048:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc57d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103055:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc57d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103060:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3e:0x0].0x0 (ffff8800990ea700) 00010000:00010000:2.0:1716999788.103062:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999788.103064:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc57d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103068:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc57d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103099:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc57c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103104:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc57c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103108:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc57c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103111:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a8903cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.103113:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc57c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103117:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc57c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103122:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.103124:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.103126:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc57c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.103130:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc57c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999788.103137:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a6a3800 reply state ffff8800925dd000 transno 4294986015 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc57ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999788.103142:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999788.103189:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+748:11420:x1800404480695744:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1004us (1207us total) trans 4294986015 rc 0/0 00000100:00100000:2.0:1716999788.103195:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45500 00000100:00100000:1.0:1716999788.103368:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480695872 00000100:00100000:1.0:1716999788.103373:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480695872 00000100:00100000:1.0:1716999788.103402:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9076 00000100:00100000:1.0:1716999788.103406:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+748:11419:x1800404480695872:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999788.103640:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11453, 168 off2048344 00000001:00080000:1.0:1716999788.103645:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986016 00000100:00100000:1.0:1716999788.105597:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+750:11419:x1800404480695872:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2182us (3557us total) trans 4294986017 rc 0/0 00000100:00100000:1.0:1716999788.105606:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9076 00000020:00080000:1.0:1716999788.105612:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1716999788.106742:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc57ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.106751:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc57ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.106757:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc57ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.106762:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a8900240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.106766:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc57ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.106771:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc57ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.106782:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x2253fa11 (ffff8800990ea600) 00010000:00010000:1.0:1716999788.106785:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.106788:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc57ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.106793:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc57ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x2253fa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999788.107448:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.107493:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480695936 00000100:00100000:3.0:1716999788.107501:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480695936 00000100:00100000:3.0:1716999788.107535:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45501 00000100:00100000:3.0:1716999788.107540:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+749:11420:x1800404480695936:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.107557:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.107569:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc57e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659a8 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.107615:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc57ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107624:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc57ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107632:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc57ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107641:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc57f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107646:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc57f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107651:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc57f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107707:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc57ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107713:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc57ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107717:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc57ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107721:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bddb00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.107723:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc57ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107728:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc57ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107738:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.107740:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.107742:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc57ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107747:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc57ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107769:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc57f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107773:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc57f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107778:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc57f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107781:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.107783:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc57f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107788:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc57f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107794:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x52a89496 (ffff880091b4d100) 00010000:00010000:3.0:1716999788.107796:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.107798:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc57f1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107802:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc57f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.107848:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc57e3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659a8 expref: 750 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.107855:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc57e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659a8 expref: 750 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.107862:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde640, rc 0) 00000100:00100000:3.0:1716999788.107926:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+749:11420:x1800404480695936:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 385us (478us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.107932:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45501 00000100:00100000:0.0:1716999788.108572:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.109261:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696064 00000100:00100000:2.0:1716999788.109266:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696064 00000100:00100000:2.0:1716999788.109353:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45502 00000100:00100000:2.0:1716999788.109358:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+749:11419:x1800404480696064:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.109369:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.109378:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc57f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659af expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.109432:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc57ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.109440:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc57ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc42:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.109446:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc57ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc42:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:2.0:1716999788.109453:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc42:0x0]: returning size 0 00010000:00010000:2.0:1716999788.109535:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc57f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659af expref: 752 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.109545:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc57ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc42:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659af expref: 751 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.109551:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc42:0x0].0x0 (ffff880135ac4e00) 00010000:00010000:2.0:1716999788.109553:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999788.109555:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801339fba80, rc 0) 00000100:00100000:2.0:1716999788.109895:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+751:11419:x1800404480696064:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 536us (1323us total) trans 4294986018 rc 0/0 00000100:00100000:2.0:1716999788.109901:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45502 00000100:00100000:0.0:1716999788.110710:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.110774:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696128 00000100:00100000:2.0:1716999788.110778:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696128 00000100:00100000:2.0:1716999788.111005:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45503 00000100:00100000:2.0:1716999788.111013:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+751:11420:x1800404480696128:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.111021:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.111030:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc580d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659b6 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.111045:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc580d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659b6 expref: 752 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.111052:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc580d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659b6 expref: 752 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.111057:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.111059:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.111061:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c52640, rc 0) 00000100:00100000:2.0:1716999788.111296:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+752:11420:x1800404480696128:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 282us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.111301:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45503 00000100:00100000:1.0:1716999788.111652:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.111822:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696192 00000100:00100000:2.0:1716999788.111826:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696192 00000100:00100000:2.0:1716999788.111845:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9984 00000100:00100000:2.0:1716999788.111850:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:107d663a-2216-406b-94c6-b2fcb1558728+98:11419:x1800404480696192:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.111857:0:11262:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.111867:0:11262:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659bd expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.111901:0:11262:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc57c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659a1 expref: 99 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.111908:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.111909:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.111912:0:11262:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659bd expref: 99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.111935:0:11262:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc57c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f659a1 expref: 99 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.111945:0:11262:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc57c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f659a1 expref: 99 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.111957:0:11262:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11262:1800404483009792:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.111997:0:11262:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.113406:0:11262:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11262:1800404483009792:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999788.113422:0:11262:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659bd expref: 99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.113436:0:11262:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c51b00, rc 0) 00000100:00100000:2.0:1716999788.113456:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:107d663a-2216-406b-94c6-b2fcb1558728+99:11419:x1800404480696192:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1606us (1804us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.113462:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9984 00000100:00100000:1.0:1716999788.114348:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.114484:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.114533:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696256 00000100:00100000:2.0:1716999788.114537:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696256 00000100:00100000:2.0:1716999788.114558:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9077 00000100:00100000:2.0:1716999788.114562:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+752:11420:x1800404480696256:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999788.115437:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696320 00000100:00100000:1.0:1716999788.115441:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696320 00010000:00010000:1.0:1716999788.115456:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc57c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f659a1 expref: 99 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999788.115486:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4518 00000100:00100000:1.0:1716999788.115491:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+99:1958:x1800404480696320:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999788.115499:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999788.115514:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc57c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f659a1 expref: 99 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.115523:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc57c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f659a1 expref: 99 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.115538:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc57c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f659a1 expref: 99 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.115549:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.115551:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.115556:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659bd expref: 98 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.115563:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659bd expref: 98 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.115586:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659bd expref: 98 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.115595:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483009856:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999788.115622:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6540 going to sleep for 11 seconds 00000100:00100000:3.0:1716999788.117030:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+752:11420:x1800404480696256:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2464us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.117039:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9077 00000100:00100000:1.0:1716999788.118346:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483009856:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999788.118362:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999788.118436:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+98:1958:x1800404480696320:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2944us (3951us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.118443:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4518 00000100:00100000:0.0:1716999788.122494:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.122581:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.122655:0:8347:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696384 00000100:00100000:3.0:1716999788.122663:0:8347:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696384 00002000:00100000:3.0:1716999788.122693:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x605:0x0] (0->4095) req@ffff880091107800 x1800404480696384/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:694/0 lens 4584/0 e 0 to 0 dl 1716999799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999788.122703:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091107800 with x1800404480696384 ext(0->4095) 00002000:00010000:3.0:1716999788.122708:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091107800 00000100:00100000:3.0:1716999788.122736:0:8347:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1432 00000100:00100000:3.0:1716999788.122741:0:8347:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+98:1958:x1800404480696384:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:3.0:1716999788.123128:0:8347:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091107800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+100:1958:x1800404480696384:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 386us (640us total) trans 4294970138 rc 0/0 00000100:00100000:3.0:1716999788.123135:0:8347:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1432 00002000:00100000:3.0:1716999788.123141:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x605:0x0] (0->4095) req@ffff880091107800 x1800404480696384/t4294970138(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:694/0 lens 4584/448 e 0 to 0 dl 1716999799 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999788.123148:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091107800 with x1800404480696384 ext(0->4095) 00002000:00010000:3.0:1716999788.123151:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091107800 00000100:00100000:3.0:1716999788.123175:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696448 00000100:00100000:3.0:1716999788.123178:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696448 00000100:00100000:3.0:1716999788.123196:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45504 00000100:00100000:3.0:1716999788.123200:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+752:11420:x1800404480696448:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.123209:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.123222:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc581b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659c4 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.123259:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5822 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.123269:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5822 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.123277:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5822 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.123288:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5829 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.123293:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.123297:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.123334:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5822 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.123340:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5822 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.123348:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5822 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.123352:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.123355:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5822 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.123360:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5822 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.123368:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.123370:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.123373:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5822 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.123377:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5822 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.124985:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.124994:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5829 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.125000:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5829 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.125004:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.125007:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5829 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.125012:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5829 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.125021:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x52a89496 (ffff880091b4da00) 00010000:00010000:3.0:1716999788.125023:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.125025:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5829 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.125030:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5829 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.125072:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc581b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659c4 expref: 753 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.125079:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc581b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659c4 expref: 753 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.125086:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf840, rc 0) 00000100:00100000:3.0:1716999788.125781:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+752:11420:x1800404480696448:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2577us (3198us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.125787:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45504 00000100:00100000:0.0:1716999788.126079:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.126388:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696512 00000100:00100000:3.0:1716999788.126394:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696512 00000100:00100000:3.0:1716999788.126421:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45505 00000100:00100000:3.0:1716999788.126427:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+752:11419:x1800404480696512:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:1.0:1716999788.130636:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.130657:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696576 00000100:00100000:1.0:1716999788.130662:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696576 00000100:00100000:1.0:1716999788.130688:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45506 00000100:00100000:1.0:1716999788.130693:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480696576:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.130705:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.130718:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5830 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659cb expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.130756:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5837 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130766:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5837 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130774:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5837 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130782:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc583e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130786:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc583e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130790:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc583e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130874:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5837 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130896:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5837 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130901:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5837 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130906:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.130908:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5837 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130913:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5837 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130921:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.130923:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.130926:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5837 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130930:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc5837 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130938:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc583e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130942:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc583e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130946:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc583e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130952:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091367600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.130954:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc583e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130958:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc583e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130962:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x17a4f95f (ffff880135ac4a00) 00010000:00010000:1.0:1716999788.130963:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.130965:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc583e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130968:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc583e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.130994:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5830 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659cb expref: 754 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.131000:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc5830 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659cb expref: 754 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.131006:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364900, rc 0) 00000100:00100000:1.0:1716999788.131035:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480696576:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 342us (406us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.131040:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45506 00000100:00100000:0.0:1716999788.137197:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.137220:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696640 00000100:00100000:0.0:1716999788.137227:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696640 00000100:00100000:0.0:1716999788.137262:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45507 00000100:00100000:0.0:1716999788.137268:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480696640:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.137281:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.137296:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5845 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659d2 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.137338:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc584c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137350:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc584c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137358:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc584c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137367:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137371:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137375:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137470:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc584c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137476:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc584c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137481:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc584c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137487:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.137490:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc584c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137495:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc584c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137503:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.137506:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.137509:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc584c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137513:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc584c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137523:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137528:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5853 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137532:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137535:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.137537:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137542:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5853 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137547:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x17f1f861 (ffff880094791e00) 00010000:00010000:0.0:1716999788.137549:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.137551:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5853 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137555:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.137585:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5845 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659d2 expref: 754 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.137591:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5845 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659d2 expref: 754 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.137597:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c240, rc 0) 00000100:00100000:0.0:1716999788.137629:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091105500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480696640:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 362us (437us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.137635:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45507 00000100:00100000:0.0:1716999788.146008:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.146032:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696768 00000100:00100000:0.0:1716999788.146039:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696768 00000100:00100000:0.0:1716999788.146074:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45508 00000100:00100000:0.0:1716999788.146080:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480696768:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.146097:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.146112:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc585a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659d9 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.146234:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5861 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146246:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5861 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146255:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5861 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146263:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146267:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146272:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146306:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5861 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146310:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5861 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146315:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5861 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146320:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.146324:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5861 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146329:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5861 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146337:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.146340:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.146342:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5861 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146347:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5861 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146353:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146357:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5868 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146360:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146364:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fa80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.146366:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146370:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5868 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146377:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x17f1f861 (ffff88012de9cb00) 00010000:00010000:0.0:1716999788.146379:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.146381:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5868 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146385:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.146405:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc585a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659d9 expref: 754 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.146411:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc585a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659d9 expref: 754 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.146417:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216eac0, rc 0) 00000100:00100000:0.0:1716999788.146498:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480696768:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 418us (497us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.146651:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45508 00000100:00100000:0.0:1716999788.150785:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.150808:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696832 00000100:00100000:0.0:1716999788.150834:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696832 00000100:00100000:0.0:1716999788.150864:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45509 00000100:00100000:0.0:1716999788.150871:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480696832:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.150903:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.150918:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc586f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659e0 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.150961:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5876 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.150971:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5876 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.150979:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5876 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.150987:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc587d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.150992:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc587d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.150997:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc587d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151050:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5876 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151060:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5876 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151065:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5876 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151069:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c6c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.151072:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5876 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151077:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5876 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151086:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.151088:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.151091:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151095:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151102:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc587d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151106:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc587d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151110:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc587d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151113:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.151115:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc587d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151122:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc587d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151127:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x17a4f95f (ffff880134241100) 00010000:00010000:0.0:1716999788.151128:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.151130:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc587d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151134:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc587d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.151164:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc586f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659e0 expref: 754 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.151171:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc586f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659e0 expref: 754 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.151178:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f3c0, rc 0) 00000100:00100000:0.0:1716999788.151218:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480696832:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 347us (437us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.151224:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45509 00000100:00100000:1.0:1716999788.154024:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.154237:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480696960 00000100:00100000:0.0:1716999788.154244:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480696960 00000100:00100000:0.0:1716999788.154328:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45510 00000100:00100000:0.0:1716999788.154334:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480696960:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.154347:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.154360:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5884 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659e7 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.154554:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc588b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154564:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc588b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154572:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc588b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154582:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154587:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154592:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154621:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc588b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154626:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc588b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154631:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc588b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154636:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.154639:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc588b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154645:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc588b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154656:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.154659:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.154661:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc588b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154665:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc588b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154672:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154677:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5892 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154681:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154685:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.154687:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154691:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5892 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154697:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x17a4f95f (ffff880134241d00) 00010000:00010000:0.0:1716999788.154698:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.154700:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5892 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154704:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.154724:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5884 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659e7 expref: 754 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.154730:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5884 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659e7 expref: 754 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.154736:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c240, rc 0) 00000100:00100000:0.0:1716999788.154805:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480696960:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 470us (924us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.154823:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45510 00000100:00100000:0.0:1716999788.159613:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.159656:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697024 00000100:00100000:0.0:1716999788.159663:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697024 00000100:00100000:0.0:1716999788.159693:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45511 00000100:00100000:0.0:1716999788.159699:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480697024:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.159713:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.159727:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5899 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659ee expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.160309:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc58a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160320:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc58a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160328:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc58a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160336:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc58a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160340:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc58a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160345:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc58a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160390:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc58a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160394:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc58a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160399:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc58a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160404:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.160406:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc58a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160411:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc58a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160418:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.160421:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.160423:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc58a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160963:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc58a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160972:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc58a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160976:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc58a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160984:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc58a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160987:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.160990:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc58a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.160994:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc58a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.161000:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x17f1f861 (ffff880134241c00) 00010000:00010000:0.0:1716999788.161003:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.161005:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc58a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.161008:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc58a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.161178:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5899 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659ee expref: 754 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.161186:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5899 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659ee expref: 754 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.161193:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216fcc0, rc 0) 00000100:00100000:0.0:1716999788.161238:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480697024:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1539us (1631us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.161243:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45511 00000100:00100000:1.0:1716999788.164495:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.164519:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697152 00000100:00100000:1.0:1716999788.164525:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697152 00000100:00100000:1.0:1716999788.164553:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45512 00000100:00100000:1.0:1716999788.164558:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480697152:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.164573:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.164586:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc58ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659f5 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.164655:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc58b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164666:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc58b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164674:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc58b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164683:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc58bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164688:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc58bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164692:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc58bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164725:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc58b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164731:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc58b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164736:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc58b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164740:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091367600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.164765:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc58b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164771:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc58b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164780:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.164782:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.164785:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc58b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164790:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc58b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164798:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc58bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164803:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc58bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164807:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc58bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164823:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.164826:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc58bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164830:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc58bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164836:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x17f1f861 (ffff880135ac4600) 00010000:00010000:1.0:1716999788.164838:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.164840:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc58bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164848:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc58bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17f1f861 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.164872:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc58ae lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659f5 expref: 754 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.164899:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc58ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659f5 expref: 754 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.164907:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364900, rc 0) 00000100:00100000:1.0:1716999788.164944:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480697152:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 385us (454us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.164950:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45512 00000100:00100000:2.0:1716999788.168312:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.168331:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697216 00000100:00100000:1.0:1716999788.168498:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697216 00000100:00100000:1.0:1716999788.168619:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45513 00000100:00100000:1.0:1716999788.168626:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480697216:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.168642:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.168656:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc58c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f659fc expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.168698:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc58ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.168709:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc58ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.168717:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc58ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.168951:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc58d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.168957:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc58d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.168962:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc58d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169017:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc58ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169022:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc58ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169027:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc58ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169031:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.169034:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc58ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169038:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc58ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169046:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.169048:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.169051:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc58ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169055:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc58ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169064:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc58d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169068:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc58d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169072:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc58d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169075:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.169077:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc58d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169081:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc58d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169085:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x17a4f95f (ffff880135ac4f00) 00010000:00010000:1.0:1716999788.169087:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.169088:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc58d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169091:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc58d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.169120:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc58c3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659fc expref: 754 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.169126:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc58c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659fc expref: 754 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.169132:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364fc0, rc 0) 00000100:00100000:1.0:1716999788.169166:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+753:11420:x1800404480697216:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 541us (858us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.169175:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45513 00000100:00100000:1.0:1716999788.171132:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+752:11419:x1800404480696512:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 44700us (45050us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.171139:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45505 00000001:00080000:1.0:1716999788.171163:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294985971 is committed 00000001:00080000:1.0:1716999788.171247:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986017 is committed 00000001:00080000:1.0:1716999788.171327:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986018 is committed 00000004:00080000:1.0:1716999788.171336:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 137 committed 00000004:00080000:1.0:1716999788.172384:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 131 committed 00000004:00080000:1.0:1716999788.172400:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 136 committed 00000100:00100000:2.0:1716999788.172541:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008af52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483009920:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999788.172577:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999788.172597:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483010176:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999788.172598:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483009984:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999788.172612:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999788.172615:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801339fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483010048:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999788.172628:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999788.172632:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483009920 00000100:00100000:2.0:1716999788.172637:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483009920 00000100:00100000:1.0:1716999788.172638:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483010304:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999788.172648:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999788.172657:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1716999788.172661:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483010176 00000100:00100000:1.0:1716999788.172661:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801339fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483010112:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999788.172663:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483010176 00000100:00100000:2.0:1716999788.172671:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483010048 00000100:00100000:2.0:1716999788.172673:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483010048 00000100:00100000:1.0:1716999788.172673:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999788.172681:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483010304 00000100:00100000:1.0:1716999788.172681:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483010368:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999788.172682:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483010304 00000100:00100000:2.0:1716999788.172691:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483010112 00000100:00100000:2.0:1716999788.172692:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483010112 00000100:00100000:1.0:1716999788.172692:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999788.172699:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483010368 00000100:00100000:2.0:1716999788.172700:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483010368 00000100:00100000:1.0:1716999788.172707:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9985 00000100:00100000:2.0:1716999788.172710:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9986 00000100:00100000:1.0:1716999788.172712:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3219:x1800404483009920:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999788.172714:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3219:x1800404483010176:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1716999788.172722:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1716999758 00000100:00100000:2.0:1716999788.172730:0:2535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9987 00000100:00100000:2.0:1716999788.172733:0:2535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+10:3217:x1800404483010048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999788.172733:0:8341:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1523 count 1 00002000:00080000:2.0:1716999788.172740:0:2535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1524 count 1 00010000:00010000:2.0:1716999788.172749:0:2535:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.172749:0:8341:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.172762:0:2535:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc3370 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e80 expref: 99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.172762:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc3251 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e25 expref: 99 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.172768:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999788.172768:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.172770:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999788.172770:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.172772:0:2535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.172772:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.172789:0:2535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc3370 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e80 expref: 99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.172789:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc3251 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e25 expref: 99 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.172799:0:2535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc3370 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e80 expref: 99 pid: 15837 timeout: 407 lvb_type: 0 00010000:00010000:1.0:1716999788.172799:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc3251 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e25 expref: 99 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.172807:0:2535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099582a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483010496:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999788.172807:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea9ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483010432:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.172846:0:2535:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20b600 going to sleep for 11 seconds 00000100:00100000:1.0:1716999788.172846:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219600 going to sleep for 11 seconds 00000100:00100000:1.0:1716999788.172855:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999788.172857:0:19209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9988 00000100:00100000:2.0:1716999788.172861:0:19209:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+10:3217:x1800404483010304:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999788.172865:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483010240:0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1716999788.172870:0:19209:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1529 count 1 00000100:00100000:1.0:1716999788.172877:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1716999788.172891:0:19209:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.172900:0:19209:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65151 expref: 99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.172905:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1716999788.172906:0:21818:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483009984 00010000:00010000:2.0:1716999788.172907:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999788.172909:0:19209:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.172909:0:21818:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483009984 00000100:00100000:1.0:1716999788.172920:0:21818:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483010240 00000100:00100000:1.0:1716999788.172921:0:21818:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483010240 00010000:00010000:2.0:1716999788.172922:0:19209:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65151 expref: 99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.172929:0:19209:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65151 expref: 99 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:1.0:1716999788.172930:0:21818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9989 00000100:00100000:1.0:1716999788.172934:0:21818:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+12:3217:x1800404483010112:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999788.172937:0:19209:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483010560:192.168.203.3@tcp:104: 00002000:00080000:1.0:1716999788.172942:0:21818:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1527 count 1 00010000:00010000:1.0:1716999788.172949:0:21818:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.172952:0:19209:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20b540 going to sleep for 11 seconds 00010000:00010000:1.0:1716999788.172958:0:21818:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3904 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65016 expref: 99 pid: 19195 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1716999788.172963:0:19205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9990 00010000:00010000:1.0:1716999788.172963:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.172964:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.172966:0:21818:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.172967:0:19205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+12:3217:x1800404483010368:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1716999788.172975:0:19205:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1530 count 1 00010000:00010000:1.0:1716999788.172978:0:21818:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3904 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65016 expref: 99 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.172982:0:19205:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.172985:0:21818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3904 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65016 expref: 99 pid: 19195 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999788.172989:0:19205:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f651b3 expref: 99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.172993:0:21818:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:21818:1800404483010624:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999788.172998:0:19205:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999788.172999:0:19205:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999788.173001:0:19205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.173006:0:21818:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219300 going to sleep for 11 seconds 00010000:00010000:2.0:1716999788.173014:0:19205:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651b3 expref: 99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.173020:0:19205:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651b3 expref: 99 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:1.0:1716999788.173021:0:17697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9991 00000100:00100000:1.0:1716999788.173025:0:17697:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3220:x1800404483009984:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999788.173027:0:19205:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:19205:1800404483010688:192.168.203.3@tcp:104: 00002000:00080000:1.0:1716999788.173033:0:17697:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1525 count 1 00000100:00100000:2.0:1716999788.173039:0:19205:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20b0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1716999788.173040:0:17697:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.173048:0:17697:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc34ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ef0 expref: 99 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999788.173057:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.173058:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.173061:0:17697:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.173073:0:17697:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc34ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ef0 expref: 99 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999788.173080:0:17697:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc34ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ef0 expref: 99 pid: 19195 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999788.173088:0:17697:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:17697:1800404483010752:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.173090:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9992 00000100:00100000:2.0:1716999788.173093:0:8342:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3220:x1800404483010240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1716999788.173102:0:8342:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1531 count 1 00000100:00100000:1.0:1716999788.173105:0:17697:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801362199c0 going to sleep for 11 seconds 00010000:00010000:2.0:1716999788.173109:0:8342:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1716999788.173116:0:11262:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1526 count 1 00010000:00010000:2.0:1716999788.173117:0:8342:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3f55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6520e expref: 99 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.173122:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.173122:0:11262:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.173123:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.173125:0:8342:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.173129:0:11262:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc36c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f75 expref: 99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.173134:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999788.173135:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999788.173136:0:11262:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.173142:0:8342:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3f55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6520e expref: 99 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.173148:0:8342:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3f55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6520e expref: 99 pid: 15837 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.173148:0:11262:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc36c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f75 expref: 99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.173156:0:8342:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8342:1800404483010816:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999788.173158:0:11262:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc36c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f75 expref: 99 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:1.0:1716999788.173164:0:11262:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11262:1800404483010880:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.173168:0:8342:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20b300 going to sleep for 11 seconds 00000100:00100000:1.0:1716999788.173175:0:11262:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219180 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.173566:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483010944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999788.173589:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999788.173770:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1716999788.173775:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483011008:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999788.173790:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999788.174377:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.174395:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483011264:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999788.174419:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697344 00000100:00100000:1.0:1716999788.174423:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697344 00000100:00100000:1.0:1716999788.174445:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45514 00000100:00100000:1.0:1716999788.174450:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480697344:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.174460:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.174463:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999788.174479:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc580d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659b6 expref: 569 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.174491:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.174495:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.174503:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc5910 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a03 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.174595:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5917 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.174604:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5917 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.174615:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5917 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.174624:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc591e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.174629:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc591e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.174741:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc591e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999788.174801:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483010944 00000100:00100000:0.0:1716999788.174806:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483010944 00000100:00100000:2.0:1716999788.174823:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483011200:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999788.174837:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483011008 00000100:00100000:0.0:1716999788.174839:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483011008 00000100:00100000:2.0:1716999788.174843:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999788.175018:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483011200 00000100:00100000:0.0:1716999788.175021:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483011200 00000100:00100000:0.0:1716999788.175036:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9993 00000100:00100000:0.0:1716999788.175040:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b87dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3219:x1800404483010944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1716999788.175051:0:17700:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1524 count 1 00010000:00010000:0.0:1716999788.175062:0:17700:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.175073:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918e8000/0x6d188eabd8dc32d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e41 expref: 101 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.175079:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.175081:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.175083:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.175098:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918e8000/0x6d188eabd8dc32d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e41 expref: 101 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.175106:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918e8000/0x6d188eabd8dc32d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e41 expref: 101 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.175113:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483011392:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.175136:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135481e40 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.175148:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9994 00000100:00100000:0.0:1716999788.175151:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+7:3219:x1800404483011008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1716999788.175161:0:19195:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1526 count 1 00010000:00010000:0.0:1716999788.175167:0:19195:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.175175:0:19195:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c95f80/0x6d188eabd8dc3561 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f05 expref: 101 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.175180:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.175181:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.175183:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.175193:0:19195:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090c95f80/0x6d188eabd8dc3561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f05 expref: 101 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.175199:0:19195:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090c95f80/0x6d188eabd8dc3561 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f05 expref: 101 pid: 15837 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.175205:0:19195:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19195:1800404483011456:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.175216:0:19195:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135481180 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.175227:0:17860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9995 00000100:00100000:0.0:1716999788.175231:0:17860:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+7:3219:x1800404483011200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1716999788.175240:0:17860:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1527 count 1 00000004:00080000:1.0:1716999788.175242:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x606:0x0], index 1: 0 00010000:00010000:0.0:1716999788.175246:0:17860:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.175254:0:17860:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc480/0x6d188eabd8dc3736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f9f expref: 101 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.175260:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999788.175262:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999788.175263:0:17860:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.175277:0:17860:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdc480/0x6d188eabd8dc3736 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f9f expref: 101 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.175284:0:17860:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdc480/0x6d188eabd8dc3736 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f9f expref: 101 pid: 19195 timeout: 407 lvb_type: 0 00000100:00100000:0.0:1716999788.175291:0:17860:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:17860:1800404483011520:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.175307:0:17860:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135481cc0 going to sleep for 11 seconds 00000040:00080000:1.0:1716999788.175541:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11454, 184 off2048528 00010000:00010000:1.0:1716999788.175638:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc593a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.175645:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc593a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.175651:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc593a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.175675:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5917 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.175680:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5917 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.175684:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5917 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.175689:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c973c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.175693:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5917 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.175698:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5917 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.175705:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.175708:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.175710:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5917 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.175715:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5917 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:1.0:1716999788.175722:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800996f8e00 reply state ffff88012e8a6000 transno 4294986019 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc591e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999788.175727:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999788.175745:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc5910 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a03 expref: 571 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.175755:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc593a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a03 expref: 570 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.175762:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc43:0x0].0x0 (ffff880135ac4500) 00010000:00010000:1.0:1716999788.175763:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999788.175765:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94480, rc 0) 00000100:00100000:1.0:1716999788.175793:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+571:11420:x1800404480697344:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1342us (1417us total) trans 4294986019 rc 0/0 00000100:00100000:1.0:1716999788.175799:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45514 00000100:00100000:1.0:1716999788.175834:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483011072:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999788.175854:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999788.175865:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483011328:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999788.175875:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999788.175898:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1716999788.175902:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483011136:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999788.175905:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483011072 00000100:00100000:2.0:1716999788.175909:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483011072 00000100:00100000:1.0:1716999788.175913:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999788.175926:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483011328 00000100:00100000:2.0:1716999788.175929:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483011328 00000100:00100000:2.0:1716999788.175943:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483011136 00000100:00100000:2.0:1716999788.175945:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483011136 00000100:00100000:2.0:1716999788.175956:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9996 00000100:00100000:2.0:1716999788.175959:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+10:3217:x1800404483011072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999788.175970:0:19200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1525 count 1 00010000:00010000:2.0:1716999788.175979:0:19200:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.175990:0:19200:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ea3 expref: 101 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.175995:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999788.175996:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999788.175998:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.176014:0:19200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ea3 expref: 101 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.176022:0:19200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ea3 expref: 101 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:2.0:1716999788.176030:0:19200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483011584:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.176049:0:19200:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20b480 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.176062:0:19193:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9997 00000100:00100000:2.0:1716999788.176065:0:19193:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+10:3217:x1800404483011328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999788.176075:0:19193:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1534 count 1 00010000:00010000:2.0:1716999788.176087:0:19193:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.176096:0:19193:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c96640/0x6d188eabd8dc4758 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6548b expref: 101 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.176100:0:19193:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.176105:0:19193:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.176107:0:19193:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.176121:0:19193:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090c96640/0x6d188eabd8dc4758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6548b expref: 101 pid: 15837 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.176127:0:19193:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090c96640/0x6d188eabd8dc4758 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6548b expref: 101 pid: 15837 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.176134:0:19193:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:19193:1800404483011648:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.176150:0:19193:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20b240 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.176163:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9998 00000100:00100000:2.0:1716999788.176167:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3217:x1800404483011136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999788.176176:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1528 count 1 00010000:00010000:2.0:1716999788.176184:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.176191:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc39dd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6504e expref: 101 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.176196:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.176197:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.176199:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.176218:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc39dd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6504e expref: 101 pid: 19195 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.176230:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc39dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6504e expref: 101 pid: 19195 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.176237:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483011712:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.176254:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20b9c0 going to sleep for 11 seconds 00000100:00080000:2.0:1716999788.176263:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1716999758 00000100:00100000:2.0:1716999788.176359:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999788.176518:0:17473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483011264 00000100:00100000:0.0:1716999788.176522:0:17473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483011264 00000100:00100000:0.0:1716999788.176535:0:17473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9999 00000100:00100000:0.0:1716999788.176539:0:17473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3220:x1800404483011264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1716999788.176549:0:17473:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1530 count 1 00010000:00010000:0.0:1716999788.176558:0:17473:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.176566:0:17473:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc3e13 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6519e expref: 101 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.176571:0:17473:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.176572:0:17473:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.176574:0:17473:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.176588:0:17473:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc3e13 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6519e expref: 101 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.176596:0:17473:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc3e13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6519e expref: 101 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.176604:0:17473:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:17473:1800404483011776:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.176624:0:17473:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801354813c0 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.176850:0:8341:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012ea9ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483010432:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.176870:0:8341:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.177003:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.177007:0:11262:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800996f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11262:1800404483010880:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.177016:0:11262:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.177017:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.177028:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.177039:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.177049:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.177053:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697472 00000100:00100000:0.0:1716999788.177055:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697472 00000100:00100000:1.0:1716999788.177059:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999788.177067:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc3370 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e80 expref: 100 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:1.0:1716999788.177070:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.177076:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697600 00000100:00100000:0.0:1716999788.177078:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697600 00010000:00010000:0.0:1716999788.177083:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65151 expref: 101 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:0.0:1716999788.177090:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697728 00000100:00100000:0.0:1716999788.177092:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697728 00010000:00010000:0.0:1716999788.177097:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651b3 expref: 102 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:0.0:1716999788.177103:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697856 00000100:00100000:0.0:1716999788.177104:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697856 00000100:00100000:1.0:1716999788.177107:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999788.177110:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3f55 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6520e expref: 103 pid: 15837 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.177116:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697536 00000100:00100000:0.0:1716999788.177117:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697536 00000100:00100000:1.0:1716999788.177118:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697664 00000100:00100000:1.0:1716999788.177121:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697664 00010000:00010000:0.0:1716999788.177123:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc3251 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e25 expref: 104 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.177129:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697792 00000100:00100000:0.0:1716999788.177130:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697792 00010000:00010000:1.0:1716999788.177132:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3904 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65016 expref: 105 pid: 19195 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.177136:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc34ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ef0 expref: 106 pid: 19195 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999788.177142:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697920 00000100:00100000:1.0:1716999788.177144:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697920 00000100:00100000:0.0:1716999788.177144:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4519 00000100:00100000:0.0:1716999788.177148:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+107:1957:x1800404480697472:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999788.177150:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc36c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f75 expref: 107 pid: 15837 timeout: 407 lvb_type: 0 00010000:00010000:0.0:1716999788.177154:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999788.177157:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc3370 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e80 expref: 107 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:1.0:1716999788.177159:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4520 00000100:00100000:1.0:1716999788.177163:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+107:1957:x1800404480697600:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999788.177164:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc3370 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e80 expref: 107 pid: 15837 timeout: 407 lvb_type: 0 00010000:00010000:1.0:1716999788.177169:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999788.177172:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65151 expref: 107 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:0.0:1716999788.177175:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.177176:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.177179:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65151 expref: 107 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:0.0:1716999788.177179:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177184:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.177188:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.177189:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.177192:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177192:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.177197:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.177206:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999788.177209:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996faa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+107:1957:x1800404480697472:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 60us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.177214:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4519 00000100:00100000:1.0:1716999788.177221:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+106:1957:x1800404480697600:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 57us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.177223:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4521 00000100:00100000:0.0:1716999788.177226:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+106:1957:x1800404480697728:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1716999788.177227:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4520 00010000:00010000:0.0:1716999788.177231:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999788.177234:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651b3 expref: 105 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:1.0:1716999788.177238:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4522 00010000:00010000:0.0:1716999788.177240:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651b3 expref: 105 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:1.0:1716999788.177242:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+105:1957:x1800404480697856:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999788.177248:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999788.177248:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.177249:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.177251:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3f55 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6520e expref: 105 pid: 15837 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.177251:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177256:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.177258:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3f55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6520e expref: 105 pid: 15837 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.177263:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.177267:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.177269:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.177271:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.177272:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+105:1957:x1800404480697728:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 45us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.177276:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4521 00010000:00010000:1.0:1716999788.177277:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.177284:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4523 00010000:00010000:1.0:1716999788.177286:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999788.177288:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+104:1957:x1800404480697536:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999788.177293:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999788.177295:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc3251 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e25 expref: 104 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999788.177301:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+104:1957:x1800404480697856:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 58us (261us total) trans 0 rc 0/0 00010000:00010000:0.0:1716999788.177301:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc3251 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e25 expref: 104 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999788.177306:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4522 00010000:00010000:0.0:1716999788.177309:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc3251 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e25 expref: 104 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.177316:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.177317:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1716999788.177319:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4524 00010000:00010000:0.0:1716999788.177319:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.177322:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+102:1957:x1800404480697664:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999788.177324:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.177328:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999788.177331:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3904 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65016 expref: 102 pid: 19195 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.177332:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.177337:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3904 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65016 expref: 102 pid: 19195 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.177341:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+102:1957:x1800404480697536:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 52us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.177345:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4523 00010000:00010000:1.0:1716999788.177346:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.177347:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.177349:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.177352:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4525 00010000:00010000:1.0:1716999788.177354:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.177355:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+101:1957:x1800404480697792:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999788.177360:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999788.177362:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc34ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ef0 expref: 101 pid: 19195 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.177366:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999788.177367:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4526 00010000:00010000:0.0:1716999788.177368:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc34ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ef0 expref: 101 pid: 19195 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.177374:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+101:1957:x1800404480697920:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999788.177375:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.177376:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.177378:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.177380:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+101:1957:x1800404480697664:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 57us (320us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999788.177382:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999788.177382:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.177385:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4524 00010000:00010000:3.0:1716999788.177386:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc36c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f75 expref: 101 pid: 15837 timeout: 407 lvb_type: 0 00010000:00010000:0.0:1716999788.177388:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999788.177397:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69aac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+100:1957:x1800404480697792:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 40us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.177401:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4525 00010000:00010000:3.0:1716999788.177405:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc36c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f75 expref: 100 pid: 15837 timeout: 407 lvb_type: 0 00010000:00010000:1.0:1716999788.177410:0:17697:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc34ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ef0 expref: 99 pid: 19195 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.177416:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc36c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f75 expref: 99 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:1.0:1716999788.177421:0:17697:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800996fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:17697:1800404483010752:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999788.177426:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.177427:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.177429:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.177431:0:17697:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.177435:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.177437:0:17697:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.177446:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.177448:0:17697:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.177453:0:17697:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.177464:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+97:1957:x1800404480697920:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 91us (356us total) trans 0 rc 0/0 00010000:00010000:1.0:1716999788.177464:0:17697:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.177469:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4526 00010000:00010000:1.0:1716999788.177469:0:17697:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.177478:0:17697:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366880 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999788.177480:0:17697:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.177486:0:17697:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177492:0:11262:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.177494:0:17697:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.177498:0:17697:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091366880/0x6d188eabd8dc58fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177499:0:11262:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177506:0:11262:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177511:0:11262:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177516:0:11262:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177521:0:11262:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366ac0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.177523:0:11262:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177529:0:11262:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177537:0:11262:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177542:0:11262:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc5909 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.177657:0:19205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c133600/0x6d188eabd8dc3e44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f651b3 expref: 96 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:2.0:1716999788.177667:0:19205:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:19205:1800404483010688:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999788.177685:0:19205:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.177691:0:19205:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.177696:0:19205:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.177710:0:17697:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3220:x1800404483009984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4683us (4852us total) trans 4294970139 rc 0/0 00000100:00100000:1.0:1716999788.177720:0:17697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9991 00000100:00100000:0.0:1716999788.177729:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3219:x1800404483010176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5012us (5115us total) trans 4294970140 rc 0/0 00000004:00080000:3.0:1716999788.177731:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009c2c7100/2, rc 0, transno 2843 00000100:00100000:0.0:1716999788.177734:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9986 00000100:00100000:3.0:1716999788.177738:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009c2c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483009984:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1716999788.177749:0:8341:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177756:0:8341:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177762:0:8341:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177767:0:8341:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177773:0:8341:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.177774:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1716999788.177777:0:8341:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365b00 already unused, calling callback (ffffffffa0864a40) 00000100:00100000:3.0:1716999788.177780:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483011840:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1716999788.177780:0:8341:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177786:0:8341:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.177793:0:8341:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.177797:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1716999788.177799:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091365b00/0x6d188eabd8dc58d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.177945:0:19205:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.177950:0:19205:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.177959:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3219:x1800404483009920:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5246us (5382us total) trans 4294970141 rc 0/0 00010000:00010000:2.0:1716999788.177960:0:19205:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.177965:0:19205:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa0864a40) 00000100:00100000:0.0:1716999788.177965:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9985 00010000:00010000:2.0:1716999788.177967:0:19205:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.177971:0:19205:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.177974:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483011840 00000100:00100000:0.0:1716999788.177977:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483011840 00010000:00010000:2.0:1716999788.177979:0:19205:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.177983:0:19205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc58f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.177990:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10000 00000100:00100000:0.0:1716999788.177993:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3217:x1800404483011840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1716999788.178002:0:8341:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1535 count 1 00010000:00010000:0.0:1716999788.178012:0:8341:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.178021:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4942 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6553a expref: 95 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.178026:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.178028:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.178029:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.178042:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4942 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6553a expref: 95 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.178049:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4942 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6553a expref: 95 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.178057:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483011904:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.178076:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135481300 going to sleep for 11 seconds 00000004:00080000:0.0:1716999788.178094:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131d5ed80/2, rc 0, transno 2844 00000100:00100000:0.0:1716999788.178112:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483010176:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1716999788.178122:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008af52300/2, rc 0, transno 2845 00000100:00100000:0.0:1716999788.178125:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008af52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483009920:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1716999788.178286:0:21818:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc3904 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65016 expref: 95 pid: 19195 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999788.178294:0:21818:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012ea9e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:21818:1800404483010624:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999788.178310:0:21818:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.178316:0:21818:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.178323:0:21818:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.178329:0:21818:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.178334:0:21818:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.178339:0:21818:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.178343:0:21818:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365d40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999788.178345:0:21818:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.178351:0:21818:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.178358:0:21818:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.178363:0:21818:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091365d40/0x6d188eabd8dc58ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.179399:0:21818:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+15:3217:x1800404483010112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6462us (6723us total) trans 4294970143 rc 0/0 00000100:00100000:1.0:1716999788.179406:0:21818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9989 00000100:00100000:2.0:1716999788.179507:0:19205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+14:3217:x1800404483010368:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6538us (6812us total) trans 4294970142 rc 0/0 00000100:00100000:2.0:1716999788.179519:0:19205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9990 00010000:00010000:2.0:1716999788.179545:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c132640/0x6d188eabd8dc3f55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6520e expref: 94 pid: 15837 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.179554:0:8342:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8342:1800404483010816:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999788.179566:0:8342:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179577:0:8342:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179583:0:8342:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179589:0:8342:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179595:0:8342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179600:0:8342:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179605:0:8342:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52880 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999788.179608:0:8342:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179613:0:8342:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179621:0:8342:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179626:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5902 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.179772:0:8342:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3220:x1800404483010240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6677us (6893us total) trans 4294970144 rc 0/0 00000100:00100000:2.0:1716999788.179776:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9992 00010000:00010000:2.0:1716999788.179799:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc3d48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65151 expref: 93 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:2.0:1716999788.179806:0:19209:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483010560:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999788.179831:0:19209:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179836:0:19209:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179842:0:19209:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179848:0:19209:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179852:0:19209:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179857:0:19209:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179866:0:19209:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999788.179868:0:19209:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179872:0:19209:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179893:0:19209:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.179898:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc58e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.179998:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483012032:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999788.180021:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1716999788.180039:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9fdf80/2, rc 0, transno 2848 00000100:00100000:3.0:1716999788.180045:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483010240:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999788.180052:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1716999788.180056:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483011968:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999788.180071:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1716999788.180091:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801339fed80/2, rc 0, transno 2847 00000100:00100000:3.0:1716999788.180095:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801339fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483010112:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1716999788.180102:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9fd880/2, rc 0, transno 2846 00000100:00100000:3.0:1716999788.180104:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483010368:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999788.180134:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483012096:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999788.180149:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999788.180159:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1716999788.180163:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483012160:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999788.180177:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999788.181443:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483012032 00000100:00100000:0.0:1716999788.181448:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483012032 00000100:00100000:0.0:1716999788.181468:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483011968 00000100:00100000:0.0:1716999788.181470:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483011968 00000100:00100000:1.0:1716999788.181513:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.181710:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483012096 00000100:00100000:0.0:1716999788.181714:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483012096 00000100:00100000:0.0:1716999788.181727:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483012160 00000100:00100000:0.0:1716999788.181729:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483012160 00000100:00100000:0.0:1716999788.181736:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697408 00000100:00100000:0.0:1716999788.181738:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697408 00000100:00100000:0.0:1716999788.181748:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10001 00000100:00100000:0.0:1716999788.181753:0:8342:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3220:x1800404483012032:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999788.181757:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00002000:00080000:0.0:1716999788.181770:0:8342:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1537 count 1 00000100:00100000:1.0:1716999788.181771:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999788.181782:0:8342:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.181835:0:19209:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+18:3217:x1800404483010304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8972us (9184us total) trans 4294970145 rc 0/0 00000004:00080000:3.0:1716999788.181839:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9fc700/2, rc 0, transno 2849 00000100:00100000:2.0:1716999788.181841:0:19209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9988 00000100:00100000:3.0:1716999788.181847:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483010304:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999788.181857:0:19209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10002 00000100:00100000:2.0:1716999788.181861:0:19209:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+17:3220:x1800404483011968:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999788.181864:0:19197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10003 00000100:00100000:3.0:1716999788.181868:0:19197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+17:3217:x1800404483012096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1716999788.181871:0:19209:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1533 count 1 00002000:00080000:3.0:1716999788.181892:0:19197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1534 count 1 00010000:00010000:2.0:1716999788.181892:0:19209:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.181901:0:19197:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.181903:0:19209:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6544c expref: 93 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.181909:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999788.181911:0:19197:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65517 expref: 93 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.181911:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999788.181913:0:19209:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.181916:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999788.181918:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999788.181920:0:19197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.181935:0:19197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65517 expref: 93 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.181935:0:19209:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6544c expref: 93 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.181943:0:19197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65517 expref: 93 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:2.0:1716999788.181943:0:19209:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6544c expref: 93 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:3.0:1716999788.181952:0:19197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19197:1800404483012288:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.181953:0:19209:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483012224:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.181995:0:8342:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4edd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656f3 expref: 93 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.182001:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.182002:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.182004:0:8342:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.182019:0:8342:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4edd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f656f3 expref: 93 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.182031:0:8342:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4edd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f656f3 expref: 93 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.182038:0:8342:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8342:1800404483012352:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999788.182210:0:19197:0:(client.c:2542:ptlrpc_set_wait()) set ffff880090c37f00 going to sleep for 11 seconds 00000100:00100000:3.0:1716999788.182223:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480697984 00000100:00100000:3.0:1716999788.182226:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480697984 00010000:00010000:3.0:1716999788.182240:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918e8000/0x6d188eabd8dc32d6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e41 expref: 102 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.182254:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698112 00000100:00100000:3.0:1716999788.182256:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698112 00010000:00010000:3.0:1716999788.182263:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdc480/0x6d188eabd8dc3736 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f9f expref: 103 pid: 19195 timeout: 407 lvb_type: 0 00000100:00100000:3.0:1716999788.182274:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4527 00000100:00100000:3.0:1716999788.182278:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+103:1958:x1800404480697984:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999788.182286:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.182289:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918e8000/0x6d188eabd8dc32d6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e41 expref: 103 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.182301:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918e8000/0x6d188eabd8dc32d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e41 expref: 103 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.182313:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.182315:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.182318:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.182323:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.182332:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999788.182347:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+103:1958:x1800404480697984:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 68us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.182352:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4527 00000100:00100000:3.0:1716999788.182362:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4528 00000100:00100000:3.0:1716999788.182365:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+102:1957:x1800404480698112:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999788.182370:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.182374:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdc480/0x6d188eabd8dc3736 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f9f expref: 102 pid: 19195 timeout: 407 lvb_type: 0 00010000:00010000:3.0:1716999788.182380:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdc480/0x6d188eabd8dc3736 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f9f expref: 102 pid: 19195 timeout: 407 lvb_type: 0 00010000:00010000:3.0:1716999788.182388:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.182389:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.182392:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.182397:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.182404:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999788.182415:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a692a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+102:1957:x1800404480698112:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 49us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.182419:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4528 00000100:00100000:0.0:1716999788.182713:0:8342:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135481780 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.182714:0:19209:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20b540 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.182730:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10004 00000100:00100000:0.0:1716999788.182734:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+17:3217:x1800404483012160:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1716999788.182740:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc3370 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e80 expref: 93 pid: 15837 timeout: 407 lvb_type: 0 00002000:00080000:0.0:1716999788.182745:0:19196:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1538 count 1 00010000:00010000:0.0:1716999788.182753:0:19196:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.182761:0:2535:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099582a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483010496:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.182762:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65804 expref: 92 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.182767:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999788.182768:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999788.182770:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.182775:0:2535:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.182783:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65804 expref: 92 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.182787:0:2535:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.182790:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65804 expref: 92 pid: 17700 timeout: 407 lvb_type: 0 00010000:00010000:2.0:1716999788.182793:0:2535:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.182797:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483012416:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999788.182800:0:2535:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.182810:0:2535:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.182824:0:2535:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.182828:0:2535:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa0864a40) 00000100:00100000:0.0:1716999788.182828:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135481480 going to sleep for 11 seconds 00010000:00010000:2.0:1716999788.182831:0:2535:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.182836:0:2535:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.182842:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10005 00010000:00010000:2.0:1716999788.182844:0:2535:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.182846:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+92:1959:x1800404480697408:12345-192.168.203.3@tcp:16:dbench.0 00010000:00010000:2.0:1716999788.182849:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc58df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.182905:0:19195:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19195:1800404483011456:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.182916:0:19195:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.182933:0:17860:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc480/0x6d188eabd8dc3736 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f9f expref: 101 pid: 19195 timeout: 407 lvb_type: 0 00000100:00100000:0.0:1716999788.182942:0:17860:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e71180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:17860:1800404483011520:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.182950:0:17860:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.182956:0:17860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.182961:0:17860:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.182967:0:17860:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.182973:0:17860:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.182983:0:17860:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.182987:0:17860:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.182990:0:17860:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.182995:0:17860:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.183004:0:17860:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.183009:0:17860:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009216e640/0x6d188eabd8dc5933 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.183152:0:2535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+18:3217:x1800404483010048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10417us (10522us total) trans 4294970146 rc 0/0 00000100:00100000:2.0:1716999788.183158:0:2535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9987 00000004:00080000:3.0:1716999788.183172:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8801339fd880/2, rc 0, transno 2850 00000100:00100000:3.0:1716999788.183178:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8801339fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483010048:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999788.183248:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.183380:0:17860:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+12:3219:x1800404483011200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8146us (8534us total) trans 4294970181 rc 0/0 00000100:00100000:0.0:1716999788.183386:0:17860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9995 00000004:00080000:1.0:1716999788.183403:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091106d80/2, rc 0, transno 2885 00000100:00100000:1.0:1716999788.183412:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091106d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483011200:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1716999788.183493:0:17700:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918e8000/0x6d188eabd8dc32d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e41 expref: 100 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.183501:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483011392:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.183511:0:17700:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.183521:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999788.183521:0:17700:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.183526:0:17700:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.183532:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999788.183532:0:17700:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.183537:0:17700:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.183542:0:17700:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.183545:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999788.183547:0:17700:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.183549:0:17700:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.183555:0:17700:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.183563:0:17700:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.183567:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999788.183567:0:17700:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009216c240/0x6d188eabd8dc5925 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.183596:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.183697:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b87dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3219:x1800404483010944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8656us (10106us total) trans 4294970182 rc 0/0 00000100:00100000:0.0:1716999788.183702:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9993 00000100:00100000:3.0:1716999788.183736:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698048 00000100:00100000:3.0:1716999788.183740:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698048 00010000:00010000:3.0:1716999788.183750:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090c95f80/0x6d188eabd8dc3561 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f05 expref: 100 pid: 15837 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.183762:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698240 00000100:00100000:3.0:1716999788.183764:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698240 00010000:00010000:3.0:1716999788.183770:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090c96640/0x6d188eabd8dc4758 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6548b expref: 101 pid: 15837 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.183777:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698176 00000100:00100000:3.0:1716999788.183779:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698176 00010000:00010000:3.0:1716999788.183784:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ea3 expref: 102 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:3.0:1716999788.183790:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698304 00000100:00100000:3.0:1716999788.183792:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698304 00010000:00010000:3.0:1716999788.183798:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc39dd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6504e expref: 103 pid: 19195 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.183804:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698368 00000100:00100000:3.0:1716999788.183806:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698368 00010000:00010000:3.0:1716999788.183824:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc3e13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6519e expref: 104 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.183833:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4529 00000100:00100000:3.0:1716999788.183837:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+104:1956:x1800404480698048:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999788.183843:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.183846:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090c95f80/0x6d188eabd8dc3561 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f05 expref: 104 pid: 15837 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.183852:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090c95f80/0x6d188eabd8dc3561 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f05 expref: 104 pid: 15837 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999788.183854:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc591e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.183861:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090c95f80/0x6d188eabd8dc3561 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64f05 expref: 104 pid: 15837 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999788.183861:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc591e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.183869:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.183869:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc591e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.183870:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.183873:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.183873:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.183875:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc591e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.183893:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.183897:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc591e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.183905:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x17a4f95f (ffff880135ac4c00) 00010000:00010000:3.0:1716999788.183908:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999788.183908:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.183910:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc591e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.183914:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc591e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999788.183924:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+103:1956:x1800404480698048:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 86us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.183929:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4529 00000100:00100000:3.0:1716999788.183939:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4530 00000100:00100000:0.0:1716999788.184073:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698432 00000100:00100000:0.0:1716999788.184076:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698432 00000100:00100000:3.0:1716999788.184115:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+103:1956:x1800404480698240:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1716999788.184115:0:19193:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:19193:1800404483011648:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999788.184121:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.184124:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090c96640/0x6d188eabd8dc4758 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6548b expref: 103 pid: 15837 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999788.184129:0:19193:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.184131:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090c96640/0x6d188eabd8dc4758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5fe:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6548b expref: 103 pid: 15837 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.184139:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090c96640/0x6d188eabd8dc4758 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6548b expref: 103 pid: 15837 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999788.184149:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4531 00000100:00100000:0.0:1716999788.184150:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10006 00000100:00100000:0.0:1716999788.184154:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+102:1959:x1800404480698432:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:1.0:1716999788.184155:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+102:1957:x1800404480698176:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999788.184160:0:17700:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.184162:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999788.184166:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ea3 expref: 102 pid: 15837 timeout: 407 lvb_type: 0 00010000:00010000:0.0:1716999788.184168:0:17700:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc5987 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a0a expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.184173:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ea3 expref: 102 pid: 15837 timeout: 407 lvb_type: 0 00002000:00010000:0.0:1716999788.184180:0:17700:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x606:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1716999788.184183:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.184185:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.184187:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184187:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.184188:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.184191:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc5987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a0a expref: 103 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999788.184196:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184199:0:17700:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc5987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a0a expref: 103 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999788.184206:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999788.184206:0:17700:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216eac0, rc 0) 00000100:00100000:0.0:1716999788.184219:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:107d663a-2216-406b-94c6-b2fcb1558728+103:1959:x1800404480698432:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 65us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.184223:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10006 00000100:00100000:1.0:1716999788.184224:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+103:1957:x1800404480698176:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 69us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.184230:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4531 00000100:00100000:0.0:1716999788.184238:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4532 00000100:00100000:1.0:1716999788.184241:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4533 00000100:00100000:0.0:1716999788.184242:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+101:1957:x1800404480698304:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1716999788.184245:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+101:1957:x1800404480698368:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999788.184246:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999788.184250:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc39dd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6504e expref: 101 pid: 19195 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.184251:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999788.184254:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc3e13 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6519e expref: 101 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.184256:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc39dd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6504e expref: 101 pid: 19195 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.184262:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc3e13 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6519e expref: 101 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.184264:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.184265:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.184267:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.184271:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.184272:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.184273:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.184275:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184279:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.184281:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.184287:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+101:1957:x1800404480698304:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 45us (742us total) trans 0 rc 0/0 00010000:00010000:1.0:1716999788.184289:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999788.184291:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4532 00000100:00100000:1.0:1716999788.184303:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+100:1957:x1800404480698368:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 57us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.184308:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4533 00000100:00100000:0.0:1716999788.184309:0:8341:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483011904:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.184317:0:8341:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184331:0:17473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090c96880/0x6d188eabd8dc3e13 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6519e expref: 99 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.184342:0:17473:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:17473:1800404483011776:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.184348:0:17473:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184353:0:17473:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184358:0:17473:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184363:0:17473:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184368:0:17473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184373:0:17473:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184377:0:17473:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f840 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.184379:0:17473:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184384:0:17473:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184395:0:17473:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.184396:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.184397:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.184400:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.184400:0:17473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009216f840/0x6d188eabd8dc595d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.184405:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184413:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090c97600/0x6d188eabd8dc39dd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6504e expref: 98 pid: 19195 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.184417:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999788.184422:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483011712:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999788.184431:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+97:1956:x1800404480698240:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 487us (911us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999788.184432:0:17365:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.184436:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4530 00010000:00010000:2.0:1716999788.184442:0:17365:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184447:0:17365:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184454:0:17365:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184459:0:17365:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.184460:0:19195:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184464:0:17365:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.184466:0:19195:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184469:0:17365:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999788.184471:0:17365:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.184472:0:19195:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.184477:0:19195:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184477:0:17365:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.184483:0:19195:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184485:0:17365:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.184488:0:19195:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e1c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999788.184490:0:19195:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184490:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc5956 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.184495:0:19195:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.184503:0:19195:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.184512:0:19195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009216e1c0/0x6d188eabd8dc592c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184532:0:19193:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.184538:0:17473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3220:x1800404483011264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7997us (8178us total) trans 4294970183 rc 0/0 00010000:00010000:2.0:1716999788.184539:0:19193:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.184543:0:17473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9999 00010000:00010000:2.0:1716999788.184545:0:19193:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184550:0:19193:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184555:0:19193:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184559:0:19193:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999788.184562:0:19193:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1716999788.184564:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131e73100/2, rc 0, transno 2887 00010000:00010000:2.0:1716999788.184567:0:19193:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.184570:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483011264:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999788.184575:0:19193:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.184580:0:19193:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c51440/0x6d188eabd8dc594f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.184650:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:3219:x1800404483011008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9497us (10858us total) trans 4294970184 rc 0/0 00000100:00100000:3.0:1716999788.184655:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9994 00000100:00100000:2.0:1716999788.184726:0:19193:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+12:3217:x1800404483011328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8658us (8848us total) trans 4294970185 rc 0/0 00000100:00100000:2.0:1716999788.184731:0:19193:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9997 00000004:00080000:3.0:1716999788.184734:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131e70700/2, rc 0, transno 2889 00000100:00100000:3.0:1716999788.184737:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483011328:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999788.185135:0:19200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c131200/0x6d188eabd8dc33e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ea3 expref: 96 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:3.0:1716999788.185144:0:19200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483011584:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999788.185154:0:19200:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185159:0:19200:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185164:0:19200:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185169:0:19200:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185173:0:19200:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.185175:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999788.185178:0:19200:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185182:0:19200:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999788.185184:0:19200:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185188:0:19200:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185195:0:19200:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185199:0:19200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5948 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.185244:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.185264:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.185274:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.185300:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.185313:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698496 00000100:00100000:1.0:1716999788.185316:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698496 00010000:00010000:1.0:1716999788.185328:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4942 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6553a expref: 93 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.185334:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+13:3217:x1800404483011072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9373us (9479us total) trans 4294970187 rc 0/0 00000100:00100000:3.0:1716999788.185339:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9996 00000100:00100000:1.0:1716999788.185341:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698560 00000100:00100000:1.0:1716999788.185343:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698560 00010000:00010000:1.0:1716999788.185350:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65517 expref: 94 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:3.0:1716999788.185352:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698688 00000100:00100000:3.0:1716999788.185355:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698688 00000100:00100000:1.0:1716999788.185359:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698624 00000100:00100000:1.0:1716999788.185362:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698624 00010000:00010000:3.0:1716999788.185364:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6544c expref: 96 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:1.0:1716999788.185369:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4edd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f656f3 expref: 96 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.185373:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698752 00000100:00100000:3.0:1716999788.185375:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698752 00000100:00100000:1.0:1716999788.185379:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4534 00010000:00010000:3.0:1716999788.185381:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65804 expref: 97 pid: 17700 timeout: 407 lvb_type: 0 00000100:00100000:1.0:1716999788.185383:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+97:1959:x1800404480698496:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1716999788.185389:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4535 00010000:00010000:1.0:1716999788.185389:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999788.185392:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4942 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6553a expref: 97 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.185393:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+97:1956:x1800404480698560:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999788.185398:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.185401:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65517 expref: 97 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:1.0:1716999788.185404:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4942 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6553a expref: 97 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.185408:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65517 expref: 97 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:1.0:1716999788.185414:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc4942 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6553a expref: 97 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.185417:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.185418:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.185421:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.185423:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.185425:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.185426:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.185427:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185433:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.185433:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.185444:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999788.185448:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+96:1956:x1800404480698560:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 54us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.185453:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4535 00000100:00100000:1.0:1716999788.185459:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+95:1959:x1800404480698496:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 75us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.185462:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4536 00000100:00100000:3.0:1716999788.185466:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+95:1958:x1800404480698688:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1716999788.185466:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4534 00010000:00010000:3.0:1716999788.185471:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.185475:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6544c expref: 94 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:1.0:1716999788.185477:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4537 00000100:00100000:1.0:1716999788.185480:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+94:1958:x1800404480698624:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999788.185482:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6544c expref: 94 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:1.0:1716999788.185486:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999788.185489:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4edd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f656f3 expref: 94 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.185490:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.185492:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.185494:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.185497:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4edd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f656f3 expref: 94 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.185500:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.185506:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.185507:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.185507:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.185509:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.185515:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.185519:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+94:1958:x1800404480698688:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 53us (255us total) trans 0 rc 0/0 00010000:00010000:1.0:1716999788.185523:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999788.185524:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4536 00000100:00100000:3.0:1716999788.185533:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4538 00000100:00100000:1.0:1716999788.185536:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+93:1958:x1800404480698624:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 55us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.185537:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+93:1956:x1800404480698752:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1716999788.185541:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4537 00010000:00010000:3.0:1716999788.185542:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.185546:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65804 expref: 93 pid: 17700 timeout: 407 lvb_type: 0 00010000:00010000:3.0:1716999788.185553:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65804 expref: 92 pid: 17700 timeout: 407 lvb_type: 0 00010000:00010000:3.0:1716999788.185561:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000004:00080000:1.0:1716999788.185561:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091107100/2, rc 0, transno 2888 00010000:00010000:3.0:1716999788.185563:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1716999788.185564:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091107100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483011008:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999788.185565:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185571:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999788.185571:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091106680/2, rc 0, transno 2886 00000100:00100000:1.0:1716999788.185573:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091106680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483010944:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999788.185578:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999788.185589:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+92:1956:x1800404480698752:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 51us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.185594:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4538 00000004:00080000:3.0:1716999788.185613:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091106a00/2, rc 0, transno 2891 00000100:00100000:3.0:1716999788.185619:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091106a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483011072:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999788.185674:0:19197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c131680/0x6d188eabd8dc48d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65517 expref: 91 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:3.0:1716999788.185682:0:19197:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19197:1800404483012288:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999788.185691:0:19197:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185697:0:19197:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185702:0:19197:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185708:0:19197:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185714:0:19197:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185719:0:19197:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.185722:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5328 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65804 expref: 90 pid: 17700 timeout: 407 lvb_type: 0 00010000:00010000:3.0:1716999788.185723:0:19197:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999788.185726:0:19197:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185731:0:19197:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.185731:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e70a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483012416:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999788.185739:0:19197:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.185741:0:19196:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.185744:0:19197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5979 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.185746:0:19196:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.185751:0:19196:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.185757:0:19196:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.185763:0:19196:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.185768:0:19196:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.185773:0:19196:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c6c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.185776:0:19196:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.185781:0:19196:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.185789:0:19196:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.185795:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5980 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.185960:0:19197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+19:3217:x1800404483012096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4090us (5809us total) trans 4294970147 rc 0/0 00000100:00100000:3.0:1716999788.185965:0:19197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10003 00000100:00100000:0.0:1716999788.185971:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+18:3217:x1800404483012160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3236us (5793us total) trans 4294970148 rc 0/0 00000100:00100000:0.0:1716999788.185977:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10004 00000004:00080000:3.0:1716999788.185985:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e442680/2, rc 0, transno 2852 00000100:00100000:3.0:1716999788.185991:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483012160:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1716999788.185997:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e442d80/2, rc 0, transno 2851 00000100:00100000:3.0:1716999788.185999:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e442d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483012096:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1716999788.187409:0:8341:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.187418:0:8341:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.187426:0:8341:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.187431:0:8341:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.187436:0:8341:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.187440:0:8341:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f3c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.187442:0:8341:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.187447:0:8341:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.187457:0:8341:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.187461:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5964 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.187646:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3217:x1800404483011840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9650us (9847us total) trans 4294970149 rc 0/0 00000100:00100000:0.0:1716999788.187652:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10000 00000004:00080000:3.0:1716999788.187675:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e442a00/2, rc 0, transno 2853 00010000:00010000:0.0:1716999788.187677:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc4edd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f656f3 expref: 89 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.187682:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e442a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483011840:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999788.187686:0:8342:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8342:1800404483012352:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.187696:0:8342:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.187757:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.187792:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480698880 00000100:00100000:3.0:1716999788.187797:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480698880 00000100:00100000:3.0:1716999788.187832:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9078 00000100:00100000:3.0:1716999788.187836:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480698880:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:1.0:1716999788.187968:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc469b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6544c expref: 88 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:1.0:1716999788.187977:0:19209:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483012224:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999788.187988:0:19209:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.187994:0:19209:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.188000:0:19209:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.188006:0:19209:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.188011:0:19209:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.188016:0:19209:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.188021:0:19209:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53a80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999788.188023:0:19209:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.188029:0:19209:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.188038:0:19209:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.188043:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc5972 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1716999788.188127:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11455, 168 off2048696 00000001:00080000:3.0:1716999788.188133:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986020 00000100:00100000:3.0:1716999788.188199:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+572:11420:x1800404480698880:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 361us (441us total) trans 4294986021 rc 0/0 00000100:00100000:3.0:1716999788.188204:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9078 00000020:00080000:3.0:1716999788.188207:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1716999788.188211:0:8342:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.188217:0:8342:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.188222:0:8342:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.188228:0:8342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.188233:0:8342:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.188238:0:8342:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.188240:0:8342:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.188245:0:8342:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.188257:0:8342:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.188263:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009216d440/0x6d188eabd8dc596b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999788.188453:0:19209:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+19:3220:x1800404483011968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6591us (8380us total) trans 4294970150 rc 0/0 00000100:00100000:1.0:1716999788.188460:0:19209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10002 00000100:00100000:0.0:1716999788.189183:0:8342:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3220:x1800404483012032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7428us (9160us total) trans 4294970151 rc 0/0 00000100:00100000:0.0:1716999788.189189:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10001 00000004:00080000:0.0:1716999788.189214:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e440700/2, rc 0, transno 2854 00000100:00100000:0.0:1716999788.189221:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483011968:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1716999788.189229:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e443800/2, rc 0, transno 2855 00000100:00100000:0.0:1716999788.189233:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483012032:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999788.189285:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3217:x1800404483011136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13116us (13370us total) trans 4294970186 rc 0/0 00000100:00100000:2.0:1716999788.189291:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9998 00000004:00080000:3.0:1716999788.189294:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880091104000/2, rc 0, transno 2890 00000100:00100000:3.0:1716999788.189302:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091104000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483011136:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999788.192742:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.192761:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699008 00000100:00100000:0.0:1716999788.192766:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699008 00000100:00100000:0.0:1716999788.192789:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45515 00000100:00100000:0.0:1716999788.192795:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+572:11420:x1800404480699008:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.192809:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.192830:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc598e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a11 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.192902:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5995 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.192912:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5995 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc43:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.192920:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5995 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc43:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:0.0:1716999788.192927:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc43:0x0]: returning size 0 00010000:00010000:0.0:1716999788.192995:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc598e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a11 expref: 575 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.193006:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5995 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc43:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a11 expref: 574 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.193012:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc43:0x0].0x0 (ffff880135ac4500) 00010000:00010000:0.0:1716999788.193014:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1716999788.193017:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216d8c0, rc 0) 00000100:00100000:0.0:1716999788.193043:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11420:x1800404480699008:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 248us (307us total) trans 4294986022 rc 0/0 00000100:00100000:0.0:1716999788.193048:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45515 00000100:00100000:0.0:1716999788.197050:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.197838:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699072 00000100:00100000:2.0:1716999788.197844:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699072 00000100:00100000:2.0:1716999788.197874:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10007 00000100:00100000:2.0:1716999788.197896:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+96:11420:x1800404480699072:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.197910:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.197924:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a18 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.197945:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc5987 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a0a expref: 97 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.197952:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.197954:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.197957:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a18 expref: 97 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.197980:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc5987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a0a expref: 97 pid: 17700 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.197989:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc5987 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a0a expref: 97 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.198000:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483012480:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.198039:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1716999788.200179:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483012480:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999788.200201:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a18 expref: 97 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.200214:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c53a80, rc 0) 00000100:00100000:3.0:1716999788.200242:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+97:11420:x1800404480699072:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2362us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.200248:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10007 00000100:00100000:0.0:1716999788.200800:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.201205:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699136 00000100:00100000:2.0:1716999788.201211:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699136 00010000:00010000:2.0:1716999788.201232:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc5987 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a0a expref: 97 pid: 17700 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.201251:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4539 00000100:00100000:2.0:1716999788.201255:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+97:1958:x1800404480699136:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999788.201265:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999788.201282:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc5987 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a0a expref: 97 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999788.201291:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc5987 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a0a expref: 97 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999788.201982:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009216eac0/0x6d188eabd8dc5987 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a0a expref: 97 pid: 17700 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999788.201995:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.201996:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.202001:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a18 expref: 96 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.202009:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a18 expref: 96 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.202197:0:15839:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a18 expref: 96 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.202209:0:15839:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483012544:192.168.203.3@tcp:105: 00000100:00100000:2.0:1716999788.202244:0:15839:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20b240 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.204546:0:15839:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c12a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483012544:192.168.203.3@tcp:105: 00010000:00010000:2.0:1716999788.204559:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999788.204637:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+96:1958:x1800404480699136:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3379us (3836us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.204645:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4539 00000100:00100000:1.0:1716999788.207739:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.207786:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699200 00000100:00100000:0.0:1716999788.207793:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699200 00002000:00100000:0.0:1716999788.207833:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x606:0x0] (0->4095) req@ffff88009a692a00 x1800404480699200/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:694/0 lens 4584/0 e 0 to 0 dl 1716999799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:0.0:1716999788.207842:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a692a00 with x1800404480699200 ext(0->4095) 00002000:00010000:0.0:1716999788.207847:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a692a00 00000100:00100000:0.0:1716999788.207867:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1433 00000100:00100000:0.0:1716999788.207872:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+96:1959:x1800404480699200:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:0.0:1716999788.208257:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+98:1959:x1800404480699200:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 384us (521us total) trans 4294970188 rc 0/0 00000100:00100000:0.0:1716999788.208264:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1433 00002000:00100000:0.0:1716999788.208269:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x606:0x0] (0->4095) req@ffff88009a692a00 x1800404480699200/t4294970188(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:694/0 lens 4584/448 e 0 to 0 dl 1716999799 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:0.0:1716999788.208638:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a692a00 with x1800404480699200 ext(0->4095) 00002000:00010000:0.0:1716999788.208660:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a692a00 00000100:00100000:1.0:1716999788.211449:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.211516:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699264 00000100:00100000:0.0:1716999788.211521:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699264 00000100:00100000:0.0:1716999788.211546:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45516 00000100:00100000:0.0:1716999788.211551:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+574:11420:x1800404480699264:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:0.0:1716999788.233983:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+87:1959:x1800404480697408:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 51128us (52462us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.233994:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10005 00000001:00080000:1.0:1716999788.234402:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970141 is committed 00000001:00080000:1.0:1716999788.234412:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970137 is committed 00000001:00080000:1.0:1716999788.234428:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970143 is committed 00000001:00080000:1.0:1716999788.234442:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970146 is committed 00000001:00080000:1.0:1716999788.234451:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970138 is committed 00000001:00080000:2.0:1716999788.234988:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986022 is committed 00000100:00100000:0.0:1716999788.235375:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480699264:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 23821us (23928us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.235383:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45516 00000100:00100000:1.0:1716999788.237438:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.238221:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699328 00000100:00100000:0.0:1716999788.238228:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699328 00000100:00100000:0.0:1716999788.238272:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45517 00000100:00100000:0.0:1716999788.238277:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480699328:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.238290:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.238304:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc59aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a1f expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.238347:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc59b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238357:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc59b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238365:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc59b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238374:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc59b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238379:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc59b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238383:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc59b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238444:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc59b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238449:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc59b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238455:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc59b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238460:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fa80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.238462:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc59b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238468:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc59b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238479:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.238482:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.238485:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc59b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238489:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc59b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238497:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc59b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238501:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc59b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238505:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc59b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238509:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.238510:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc59b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238514:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc59b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238520:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x60ff3b22 (ffff880135ac4c00) 00010000:00010000:0.0:1716999788.238522:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.238524:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc59b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238527:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc59b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.238559:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc59aa lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a1f expref: 571 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.238565:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc59aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a1f expref: 571 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.238571:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216eac0, rc 0) 00000100:00100000:0.0:1716999788.238616:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480699328:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 338us (1181us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.238622:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45517 00000100:00100000:2.0:1716999788.240208:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.240235:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.240835:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699392 00000100:00100000:0.0:1716999788.240841:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699392 00000100:00100000:0.0:1716999788.240867:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10008 00000100:00100000:0.0:1716999788.240872:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+98:1958:x1800404480699392:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:0.0:1716999788.240963:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699456 00000100:00100000:0.0:1716999788.240967:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699456 00000100:00100000:0.0:1716999788.240993:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45518 00000100:00100000:0.0:1716999788.240998:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480699456:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.241005:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.241016:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc59bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a26 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.241092:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc59bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a26 expref: 571 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.241150:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc59bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a26 expref: 571 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.241157:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.241160:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.241163:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f3c0, rc 0) 00000100:00100000:0.0:1716999788.241190:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480699456:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 192us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.241195:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45518 00000100:00100000:0.0:1716999788.242774:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.242829:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699520 00000100:00100000:3.0:1716999788.242834:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699520 00000100:00100000:3.0:1716999788.242857:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9079 00000100:00100000:3.0:1716999788.242862:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480699520:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999788.247536:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480699520:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4665us (4784us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.247547:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9079 00000100:00100000:2.0:1716999788.250636:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.250658:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699648 00000100:00100000:2.0:1716999788.250664:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699648 00000100:00100000:2.0:1716999788.250692:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45519 00000100:00100000:2.0:1716999788.250698:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480699648:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.250712:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.250726:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc59c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a2d expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.250804:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc59cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.250827:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc59cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.250836:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc59cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.250847:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc59d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.250853:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc59d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.250858:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc59d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251025:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc59cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251031:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc59cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251036:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc59cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251041:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.251044:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc59cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251049:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc59cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251061:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.251064:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.251067:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc59cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251071:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc59cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251078:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc59d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251083:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc59d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251087:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc59d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251090:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.251092:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc59d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251097:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc59d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251102:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x60ff3b22 (ffff880134241a00) 00010000:00010000:2.0:1716999788.251104:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.251106:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc59d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251110:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc59d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.251129:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc59c6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a2d expref: 572 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.251136:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc59c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a2d expref: 572 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.251143:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c52ac0, rc 0) 00000100:00100000:2.0:1716999788.251180:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480699648:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 482us (547us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.251186:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45519 00000100:00100000:2.0:1716999788.252739:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.252774:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699712 00000100:00100000:0.0:1716999788.252779:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699712 00000100:00100000:0.0:1716999788.252810:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45520 00000100:00100000:0.0:1716999788.252825:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480699712:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.252835:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.252846:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc59db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a34 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.252876:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc59e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253118:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc59e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253125:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc59e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253135:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc59e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253139:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc59e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253143:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc59e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253182:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc59e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253186:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc59e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253190:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc59e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253194:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.253196:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc59e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253200:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc59e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253207:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.253209:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.253212:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc59e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253215:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc59e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253223:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc59e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253406:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc59e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253411:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc59e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253417:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.253419:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc59e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253424:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc59e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253430:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x60b23c20 (ffff880135ac4c00) 00010000:00010000:0.0:1716999788.253432:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.253434:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc59e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253437:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc59e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.253470:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc59db lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a34 expref: 572 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.253476:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc59db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a34 expref: 572 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.253510:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c6c0, rc 0) 00000100:00100000:0.0:1716999788.253554:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480699712:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 729us (816us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.253560:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45520 00000100:00100000:0.0:1716999788.255385:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.255461:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699840 00000100:00100000:2.0:1716999788.255466:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699840 00000100:00100000:2.0:1716999788.255486:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45521 00000100:00100000:2.0:1716999788.255490:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480699840:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.255500:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.255509:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc59f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a3b expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.255858:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc59f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.255868:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc59f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.255875:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc59f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.255907:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc59fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256184:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc59fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256192:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc59fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256229:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc59f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256235:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc59f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256240:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc59f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256245:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.256248:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc59f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256253:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc59f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256262:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.256264:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.256267:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc59f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256392:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc59f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256402:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc59fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256406:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc59fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256410:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc59fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256414:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.256416:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc59fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256420:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc59fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256425:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x60b23c20 (ffff880134241b00) 00010000:00010000:2.0:1716999788.256427:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.256429:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc59fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256432:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc59fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.256451:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc59f0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a3b expref: 572 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.256457:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc59f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a3b expref: 572 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.256463:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50fc0, rc 0) 00000100:00100000:2.0:1716999788.256683:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480699840:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1190us (1298us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.256690:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45521 00000100:00100000:0.0:1716999788.259506:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.260169:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480699904 00000100:00100000:1.0:1716999788.260176:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480699904 00000100:00100000:1.0:1716999788.260203:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45522 00000100:00100000:1.0:1716999788.260209:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480699904:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.260221:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.260233:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5a05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a42 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.260272:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc5a0c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260282:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc5a0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260290:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc5a0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260298:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc5a13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260302:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc5a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260308:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc5a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260353:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc5a0c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260358:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc5a0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260363:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc5a0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260368:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.260371:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc5a0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260580:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc5a0c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260591:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.260593:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.260596:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc5a0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260600:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc5a0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260611:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc5a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260615:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc5a13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260619:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc5a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260624:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.260626:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc5a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260630:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc5a13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260635:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x60ff3b22 (ffff8800939bac00) 00010000:00010000:1.0:1716999788.260637:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.260639:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc5a13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260642:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc5a13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.260675:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5a05 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a42 expref: 572 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.260681:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc5a05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a42 expref: 572 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.260689:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95b00, rc 0) 00000100:00100000:1.0:1716999788.260727:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480699904:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 518us (1227us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.260733:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45522 00000100:00100000:0.0:1716999788.263351:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.263374:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480700032 00000100:00100000:0.0:1716999788.263380:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480700032 00000100:00100000:0.0:1716999788.263408:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45523 00000100:00100000:0.0:1716999788.263413:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480700032:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.263426:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.263438:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a49 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.263506:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5a21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.263516:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5a21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.263537:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5a21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264320:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc5a28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264327:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc5a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264336:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc5a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264372:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5a21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264376:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5a21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264381:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5a21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264386:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.264388:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5a21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264393:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5a21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264401:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.264403:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.264405:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5a21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264409:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5a21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264415:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc5a28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264419:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc5a28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264423:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc5a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264427:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.264429:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc5a28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264432:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc5a28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264437:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x60ff3b22 (ffff8800910ce000) 00010000:00010000:1.0:1716999788.264439:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.264440:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc5a28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264444:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc5a28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.264466:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a1a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a49 expref: 572 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.264472:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a49 expref: 572 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.264479:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216e640, rc 0) 00000100:00100000:1.0:1716999788.264514:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480700032:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1101us (1168us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.264520:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45523 00000100:00100000:2.0:1716999788.266796:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.267531:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480700096 00000100:00100000:0.0:1716999788.267538:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480700096 00000100:00100000:0.0:1716999788.267563:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45524 00000100:00100000:0.0:1716999788.267569:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480700096:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.267581:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.267593:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5a2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a50 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.267631:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5a36 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267642:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267649:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267659:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5a3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267664:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267668:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267711:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5a36 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267716:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5a36 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267720:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267724:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.267727:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5a36 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267731:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5a36 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267738:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.267740:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.267743:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5a36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267747:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5a36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267755:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267760:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5a3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267764:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267768:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.267770:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267774:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5a3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267778:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x60b23c20 (ffff880135ac4a00) 00010000:00010000:0.0:1716999788.267780:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.267782:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5a3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267786:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5a3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.267831:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5a2f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a50 expref: 572 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.267837:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5a2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a50 expref: 572 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.267845:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216fcc0, rc 0) 00000100:00100000:0.0:1716999788.267891:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480700096:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 310us (1087us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.267899:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45524 00000100:00100000:0.0:1716999788.271358:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.271382:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480700224 00000100:00100000:0.0:1716999788.271389:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480700224 00000100:00100000:0.0:1716999788.271416:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45525 00000100:00100000:0.0:1716999788.271421:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480700224:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.271435:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.271437:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1716999788.271455:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc59bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a26 expref: 571 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.271465:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.271469:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999788.271479:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5a44 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a57 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.271570:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5a4b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.271579:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5a4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.271586:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5a4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.271595:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.271600:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.271608:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:0.0:1716999788.272066:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x606:0x0], index 0: 0 00000040:00080000:0.0:1716999788.272161:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11456, 184 off2048880 00010000:00010000:0.0:1716999788.272254:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc5a59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.272261:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc5a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.272266:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc5a59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.272287:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5a4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.272291:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5a4b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.272296:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5a4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.272301:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.272304:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5a4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.272309:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5a4b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.272316:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.272318:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.272320:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5a4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.272324:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5a4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999788.272332:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131e70000 reply state ffff8800943bf000 transno 4294986023 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999788.272337:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999788.272354:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5a44 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a57 expref: 573 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.272364:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc5a59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a57 expref: 572 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.272369:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc44:0x0].0x0 (ffff880135ac4400) 00010000:00010000:0.0:1716999788.272371:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999788.272373:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8901d40, rc 0) 00000100:00100000:0.0:1716999788.272412:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+573:11419:x1800404480700224:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 990us (1059us total) trans 4294986023 rc 0/0 00000100:00100000:0.0:1716999788.272418:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45525 00010000:00010000:1.0:1716999788.275228:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.275238:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.275246:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.275250:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fa80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.275391:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.275401:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.275413:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x60b23c20 (ffff880135ac4f00) 00010000:00010000:1.0:1716999788.275416:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.275418:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.275422:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999788.275759:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.276269:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480700288 00000100:00100000:2.0:1716999788.276278:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480700288 00000100:00100000:2.0:1716999788.276713:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10009 00000100:00100000:2.0:1716999788.276720:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+71:1958:x1800404480700288:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.276731:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.277046:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5a67 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a5e expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999788.277068:0:17365:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x606:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999788.277082:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.277084:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.277090:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5a67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a5e expref: 72 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.277102:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5a67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a5e expref: 72 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.277111:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50900, rc 0) 00000100:00100000:2.0:1716999788.277147:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+72:1958:x1800404480700288:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 427us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.277153:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10009 00000100:00100000:0.0:1716999788.281617:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.281689:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480700416 00000100:00100000:2.0:1716999788.281696:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480700416 00000100:00100000:2.0:1716999788.281725:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9080 00000100:00100000:2.0:1716999788.281731:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+572:11419:x1800404480700416:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999788.282070:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11457, 168 off2049048 00000001:00080000:2.0:1716999788.282075:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986024 00000100:00100000:2.0:1716999788.282144:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480700416:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 412us (531us total) trans 4294986025 rc 0/0 00000100:00100000:2.0:1716999788.282151:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9080 00000020:00080000:2.0:1716999788.282155:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999788.286055:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.286266:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480700544 00000100:00100000:0.0:1716999788.286273:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480700544 00000100:00100000:0.0:1716999788.286335:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45526 00000100:00100000:0.0:1716999788.286342:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480700544:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.286358:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.286372:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc5a6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a65 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.286438:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc5a75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.286448:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc5a75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc44:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.286457:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc5a75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc44:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:0.0:1716999788.286465:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc44:0x0]: returning size 0 00010000:00010000:0.0:1716999788.286972:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc5a6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a65 expref: 577 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.286982:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc5a75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc44:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a65 expref: 576 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.286989:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc44:0x0].0x0 (ffff880135ac4400) 00010000:00010000:0.0:1716999788.286992:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1716999788.286994:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8903cc0, rc 0) 00000100:00100000:0.0:1716999788.287030:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480700544:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 689us (978us total) trans 4294986026 rc 0/0 00000100:00100000:0.0:1716999788.287036:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45526 00000100:00100000:2.0:1716999788.291126:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.291448:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480700608 00000100:00100000:3.0:1716999788.291455:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480700608 00000100:00100000:3.0:1716999788.291484:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10010 00000100:00100000:3.0:1716999788.291490:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+72:11419:x1800404480700608:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.291596:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.291611:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a6c expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.291633:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5a67 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a5e expref: 73 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.291640:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.291642:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.291645:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a6c expref: 73 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.291668:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5a67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a5e expref: 73 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.291681:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5a67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a5e expref: 73 pid: 17365 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.291691:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483012608:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999788.292005:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009c108cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.294432:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.294518:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483012608:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999788.294538:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a6c expref: 73 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.294550:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bddb00, rc 0) 00000100:00100000:3.0:1716999788.294580:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+73:11419:x1800404480700608:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 3089us (3458us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.294587:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10010 00000100:00100000:0.0:1716999788.294642:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480700672 00000100:00100000:0.0:1716999788.294648:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480700672 00010000:00010000:0.0:1716999788.294679:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5a67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a5e expref: 73 pid: 17365 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.294697:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4540 00000100:00100000:0.0:1716999788.294701:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+73:1958:x1800404480700672:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999788.294711:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999788.294728:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5a67 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a5e expref: 73 pid: 17365 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.294737:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5a67 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a5e expref: 73 pid: 17365 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.294752:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5a67 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a5e expref: 73 pid: 17365 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.294760:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.294762:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.294766:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a6c expref: 72 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.294773:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a6c expref: 72 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.294806:0:15839:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a6c expref: 72 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.294826:0:15839:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e71500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:15839:1800404483012672:192.168.203.3@tcp:105: 00000100:00100000:0.0:1716999788.294853:0:15839:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96780 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.296824:0:15839:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e71500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:15839:1800404483012672:192.168.203.3@tcp:105: 00010000:00010000:0.0:1716999788.296836:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999788.296860:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+72:1958:x1800404480700672:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2158us (2432us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.296868:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4540 00000100:00100000:0.0:1716999788.298893:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.298923:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480700736 00000100:00100000:0.0:1716999788.298928:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480700736 00000100:00100000:0.0:1716999788.298953:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45527 00000100:00100000:0.0:1716999788.298958:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480700736:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.298972:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.298984:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc5a8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a73 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.299422:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299432:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299440:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299449:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299455:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299461:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299725:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299731:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299737:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299742:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fa80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.299745:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299750:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299759:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.299761:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.299763:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299767:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5a91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299775:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299779:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299783:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299786:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.299788:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299792:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299797:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x98b08880 (ffff8800939ba800) 00010000:00010000:0.0:1716999788.299798:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.299800:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299804:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5a98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.299845:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc5a8a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a73 expref: 577 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.299853:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc5a8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a73 expref: 577 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.299860:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8901680, rc 0) 00000100:00100000:0.0:1716999788.299910:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480700736:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 951us (1031us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.299916:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45527 00000100:00100000:0.0:1716999788.302748:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.302764:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480700800 00000100:00100000:2.0:1716999788.302771:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480700800 00000100:00100000:2.0:1716999788.302796:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45528 00000100:00100000:2.0:1716999788.302802:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480700800:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.302824:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.302837:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5a9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a7a expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.302859:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5a9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a7a expref: 577 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.302868:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5a9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a7a expref: 577 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.302874:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.302876:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.302895:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c52640, rc 0) 00000100:00100000:2.0:1716999788.302923:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480700800:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 121us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.302927:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45528 00000100:00100000:3.0:1716999788.304742:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.304873:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480700864 00000100:00100000:0.0:1716999788.304897:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480700864 00000100:00100000:0.0:1716999788.305137:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9081 00000100:00100000:0.0:1716999788.305143:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480700864:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999788.307806:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480700864:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2657us (3061us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.307827:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9081 00000100:00100000:0.0:1716999788.311112:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.311188:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480700992 00000100:00100000:2.0:1716999788.311195:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480700992 00000100:00100000:2.0:1716999788.311223:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45529 00000100:00100000:2.0:1716999788.311229:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480700992:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.311242:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.311255:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5aa6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a81 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.311280:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+98:1958:x1800404480699392:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 70406us (71074us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.311288:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10008 00000001:00080000:3.0:1716999788.311308:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970188 is committed 00000001:00080000:3.0:1716999788.311317:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970183 is committed 00010000:00010000:2.0:1716999788.311327:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5aad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311337:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5aad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311345:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5aad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311354:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5ab4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311358:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311363:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311393:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5aad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311398:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5aad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311402:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5aad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311406:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.311409:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5aad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311414:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5aad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311424:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.311426:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.311429:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5aad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311433:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5aad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311441:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5ab4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311445:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5ab4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311450:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311453:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.311455:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5ab4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311460:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5ab4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311466:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x98b08880 (ffff880134241b00) 00010000:00010000:2.0:1716999788.311467:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.311469:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5ab4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311473:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5ab4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.311495:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5aa6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a81 expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.311502:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5aa6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a81 expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.311507:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50900, rc 0) 00000100:00100000:2.0:1716999788.311523:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480700992:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 295us (416us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.311528:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45529 00000001:00080000:3.0:1716999788.311671:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970186 is committed 00000001:00080000:3.0:1716999788.311688:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970187 is committed 00000100:00100000:2.0:1716999788.313687:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.313746:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480701056 00000100:00100000:0.0:1716999788.313752:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480701056 00000100:00100000:0.0:1716999788.314655:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45530 00000100:00100000:0.0:1716999788.314662:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480701056:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.314676:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.314688:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5abb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a88 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.314724:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ac2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314733:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ac2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314741:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ac2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314751:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5ac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314756:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314761:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314805:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ac2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314821:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ac2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314935:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ac2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314940:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216eac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.314943:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ac2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314949:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ac2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314957:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.314959:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.314962:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ac2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314966:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ac2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314985:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314990:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5ac9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314994:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.314997:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.314999:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.315003:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.315008:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x4bb1867f (ffff8800939ba500) 00010000:00010000:0.0:1716999788.315010:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.315012:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5ac9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.315016:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5ac9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.315044:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5abb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a88 expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.315049:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5abb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a88 expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.315053:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216e1c0, rc 0) 00000100:00100000:0.0:1716999788.315105:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480701056:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 444us (1421us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.315109:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45530 00000100:00100000:0.0:1716999788.316304:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.316459:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.316555:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480701120 00000100:00100000:2.0:1716999788.316560:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480701120 00000100:00100000:2.0:1716999788.316591:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45531 00000100:00100000:2.0:1716999788.316597:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480701120:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.316605:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.316616:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5ad0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a8f expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.316644:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5ad7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316652:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316658:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316668:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316673:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316678:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316729:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316734:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5ad7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316739:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316743:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.316746:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316750:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5ad7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316758:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.316761:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.316763:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5ad7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316767:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5ad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316774:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316778:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5ade lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316783:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316787:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.316789:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316793:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316799:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x60ff3b22 (ffff880134241f00) 00010000:00010000:2.0:1716999788.316800:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.316802:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5ade lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316806:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.316851:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5ad0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a8f expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.316858:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5ad0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a8f expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.316865:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c53cc0, rc 0) 00000100:00100000:2.0:1716999788.316921:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480701120:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 324us (618us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.316927:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45531 00000100:00100000:1.0:1716999788.317015:0:6818:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480701184 00000100:00100000:1.0:1716999788.317020:0:6818:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480701184 00000100:00100000:1.0:1716999788.317044:0:6818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 285 00000100:00100000:1.0:1716999788.317049:0:6818:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb23a41-fd22-43b9-8f02-427ab7f7699a+9:1957:x1800404480701184:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1716999788.317071:0:6818:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb23a41-fd22-43b9-8f02-427ab7f7699a+9:1957:x1800404480701184:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 22us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.317076:0:6818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 285 00000100:00100000:3.0:1716999788.317083:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.317099:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480701312 00000100:00100000:3.0:1716999788.317102:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480701312 00000100:00080000:2.0:1716999788.317161:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1716999758 00000100:00100000:3.0:1716999788.317244:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45532 00000100:00100000:3.0:1716999788.317249:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012feff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480701312:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.317255:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.317262:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5ae5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a96 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.317304:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5aec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317311:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5aec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317319:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5aec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317328:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5af3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317333:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317337:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317362:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5aec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317367:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5aec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317371:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317374:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.317376:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5aec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317381:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5aec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317387:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.317388:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.317391:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5aec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317395:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5aec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317403:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317407:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5af3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317411:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5af3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317415:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.317417:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5af3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317422:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5af3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317427:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x4bb1867f (ffff88009330d100) 00010000:00010000:3.0:1716999788.317429:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.317431:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5af3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317435:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5af3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.317452:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5ae5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a96 expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.317459:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5ae5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a96 expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.317465:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdef40, rc 0) 00000100:00100000:3.0:1716999788.317495:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012feff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480701312:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 245us (412us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.317501:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45532 00000100:00100000:3.0:1716999788.318936:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.318953:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.319010:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480701376 00000100:00100000:1.0:1716999788.319015:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480701376 00000100:00100000:1.0:1716999788.319047:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480701440 00000100:00100000:1.0:1716999788.319050:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480701440 00000100:00100000:1.0:1716999788.319075:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45533 00000100:00100000:0.0:1716999788.319085:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45534 00000100:00100000:0.0:1716999788.319091:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+578:11419:x1800404480701440:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.319100:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.319110:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5afa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65aa4 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.319136:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319144:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319150:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319157:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319162:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319166:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319198:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319203:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319207:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319211:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.319214:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319218:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319224:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.319226:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.319228:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319232:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319238:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319242:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319246:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319250:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.319251:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319255:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319259:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x98b08880 (ffff8800939ba100) 00010000:00010000:0.0:1716999788.319260:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.319262:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319265:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.319287:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5afa lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65aa4 expref: 579 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.319293:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5afa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65aa4 expref: 579 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.319299:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f3c0, rc 0) 00000100:00100000:0.0:1716999788.319323:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+578:11419:x1800404480701440:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 232us (368us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.319328:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45534 00000100:00100000:1.0:1716999788.319960:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+578:11420:x1800404480701376:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.319971:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.319980:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5b0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65a9d expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.319997:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a9d expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.320005:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5b0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a9d expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.320011:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.320013:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.320016:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97600, rc 0) 00000100:00100000:1.0:1716999788.320031:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+578:11420:x1800404480701376:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 951us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.320036:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45533 00000100:00100000:0.0:1716999788.322013:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.322531:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.322575:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480701632 00000100:00100000:1.0:1716999788.322581:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480701632 00000100:00100000:3.0:1716999788.322588:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480701568 00000100:00100000:3.0:1716999788.322592:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480701568 00000100:00100000:3.0:1716999788.323042:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45535 00000100:00100000:3.0:1716999788.323049:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+579:11419:x1800404480701568:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.323063:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1716999788.323069:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9082 00000100:00100000:0.0:1716999788.323074:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480701632:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:3.0:1716999788.323076:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5b16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65aab expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.323142:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5b1d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323151:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5b1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323158:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5b1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323166:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5b24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323170:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323175:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323200:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5b1d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323205:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5b1d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323209:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5b1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323212:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.323215:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5b1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323219:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5b1d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323226:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.323228:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.323230:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5b1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323234:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc5b1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323242:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323246:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5b24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323249:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323252:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdfcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.323254:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323260:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5b24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323265:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x98b08880 (ffff88009330da00) 00010000:00010000:3.0:1716999788.323266:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.323268:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5b24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323272:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc5b24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.323289:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5b16 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65aab expref: 580 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.323295:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5b16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65aab expref: 580 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.323301:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde1c0, rc 0) 00000100:00100000:3.0:1716999788.324058:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+580:11419:x1800404480701568:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1007us (2048us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.324064:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45535 00000100:00100000:2.0:1716999788.326096:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.326250:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480701696 00000100:00100000:3.0:1716999788.326256:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480701696 00000100:00100000:3.0:1716999788.326278:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45536 00000100:00100000:3.0:1716999788.326284:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+579:11419:x1800404480701696:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.326296:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.326307:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5b2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ab2 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.326346:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5b32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326355:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5b32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326362:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5b32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326369:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5b39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326374:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326378:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326419:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5b32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326423:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5b32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326427:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5b32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326431:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.326433:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5b32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326438:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5b32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326448:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.326450:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.326452:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5b32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326456:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5b32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326463:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326467:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5b39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326470:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326473:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.326474:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326478:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5b39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326481:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x4bb1867f (ffff88009330d900) 00010000:00010000:3.0:1716999788.326483:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.326484:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5b39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326487:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5b39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.326513:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5b2b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ab2 expref: 580 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.326519:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5b2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ab2 expref: 580 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.326524:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcd80, rc 0) 00000100:00100000:3.0:1716999788.326549:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+579:11419:x1800404480701696:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 265us (457us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.326553:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45536 00000100:00100000:0.0:1716999788.326646:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+578:11420:x1800404480701632:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3571us (4114us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.326653:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9082 00000100:00100000:3.0:1716999788.329224:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.329253:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.329266:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480701824 00000100:00100000:2.0:1716999788.329272:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480701824 00000100:00100000:2.0:1716999788.329303:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480701952 00000100:00100000:2.0:1716999788.329305:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480701952 00000100:00100000:0.0:1716999788.329316:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45537 00000100:00100000:2.0:1716999788.329322:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45538 00000100:00100000:0.0:1716999788.329323:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+579:11419:x1800404480701824:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:2.0:1716999788.329326:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480701952:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.329343:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.329345:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1716999788.329348:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.329365:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5b40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ac0 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.329430:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5a9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a7a expref: 580 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.329436:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5b47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329445:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5b47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329452:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5b47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.329457:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.329461:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999788.329462:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5b4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329467:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.329468:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5b55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ab9 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.329472:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329502:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5b47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329507:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5b47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329512:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5b47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329517:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.329519:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5b47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.329520:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5b5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.329524:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5b47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.329526:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5b5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.329531:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.329531:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5b5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.329533:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.329535:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5b47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329539:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5b47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.329539:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5b63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.329547:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.329552:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.329562:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5b4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329567:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5b4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329571:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329574:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.329576:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5b4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329580:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5b4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329585:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x60ff3b22 (ffff880134241f00) 00010000:00010000:2.0:1716999788.329587:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.329590:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5b4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329594:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5b4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.329614:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5b40 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ac0 expref: 580 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.329620:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5b40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ac0 expref: 580 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.329626:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c53cc0, rc 0) 00000100:00100000:2.0:1716999788.329654:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480701952:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 326us (399us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.329659:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45538 00000004:00080000:0.0:1716999788.329978:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x607:0x0], index 1: 0 00000040:00080000:0.0:1716999788.330034:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11458, 184 off2049232 00010000:00010000:0.0:1716999788.330117:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc5b6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.330124:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc5b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.330130:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc5b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.330150:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5b5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.330154:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5b5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.330159:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5b5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.330163:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c6c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.330165:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5b5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.330169:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5b5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.330175:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.330178:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.330180:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5b5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.330184:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc5b5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999788.330191:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800995a1c00 reply state ffff88008f5eb000 transno 4294986027 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999788.330197:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999788.330210:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc5b55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ab9 expref: 580 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.330219:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc5b6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ab9 expref: 579 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.330224:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc45:0x0].0x0 (ffff8800939ba100) 00010000:00010000:0.0:1716999788.330226:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999788.330228:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f840, rc 0) 00000100:00100000:0.0:1716999788.330251:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+580:11419:x1800404480701824:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 929us (1031us total) trans 4294986027 rc 0/0 00000100:00100000:0.0:1716999788.330257:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45537 00000100:00100000:2.0:1716999788.332538:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.332644:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480702016 00000100:00100000:0.0:1716999788.332650:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480702016 00000100:00100000:0.0:1716999788.332677:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45539 00000100:00100000:0.0:1716999788.332683:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+580:11420:x1800404480702016:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.332695:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.332705:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5b78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ac7 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.332744:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.332753:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.332760:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.332769:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.332774:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.332780:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.332927:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.332933:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.332938:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.332942:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.332945:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.332950:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.332961:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.332964:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.332966:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.332971:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc5b7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.333179:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5b63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.333186:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5b63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.333191:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.333195:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.333197:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5b63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.333201:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5b63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.333209:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x4bb1867f (ffff8800939bac00) 00010000:00010000:3.0:1716999788.333211:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.333213:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5b63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.333220:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc5b63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.334319:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.334327:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.334333:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.334336:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.334338:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.334343:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.334349:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x60b23c20 (ffff8800939ba800) 00010000:00010000:0.0:1716999788.334352:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.334354:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.334359:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc5b86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999788.334367:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999788.334405:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5b78 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ac7 expref: 580 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.334412:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480702080 00010000:00010000:0.0:1716999788.334412:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc5b78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ac7 expref: 580 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.334418:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480702080 00010000:00010000:0.0:1716999788.334419:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f3c0, rc 0) 00000100:00100000:0.0:1716999788.334448:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480702016:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1765us (1916us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.334454:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45539 00000100:00100000:3.0:1716999788.335064:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10011 00000100:00100000:3.0:1716999788.335070:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+76:1959:x1800404480702080:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.335080:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.335092:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdef40/0x6d188eabd8dc5b8d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ace expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999788.335109:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x607:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999788.335121:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.335123:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.335128:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdef40/0x6d188eabd8dc5b8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ace expref: 77 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.335138:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bdef40/0x6d188eabd8dc5b8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ace expref: 77 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.335145:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdef40, rc 0) 00000100:00100000:3.0:1716999788.335163:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480702080:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 93us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.335168:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10011 00000100:00100000:3.0:1716999788.337167:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.337206:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.337209:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480702208 00000100:00100000:0.0:1716999788.337216:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480702208 00000100:00100000:1.0:1716999788.337252:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480702336 00000100:00100000:1.0:1716999788.337257:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480702336 00000100:00100000:1.0:1716999788.337277:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9083 00000100:00100000:1.0:1716999788.337282:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+580:11419:x1800404480702336:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999788.337408:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45540 00000100:00100000:0.0:1716999788.337413:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+581:11420:x1800404480702208:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.337421:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.337433:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5b94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ad5 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.337491:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5b9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337501:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5b9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337509:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5b9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337518:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337523:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337532:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337563:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5b9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337569:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5b9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337574:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5b9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337578:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.337580:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5b9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337586:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5b9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337593:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00000040:00080000:1.0:1716999788.337595:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11459, 168 off2049400 00010000:00010000:0.0:1716999788.337596:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.337598:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5b9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000001:00080000:1.0:1716999788.337600:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986028 00010000:00010000:0.0:1716999788.337602:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc5b9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337610:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337614:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337618:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337622:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216eac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.337624:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337628:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337633:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x60b23c20 (ffff8800939ba500) 00010000:00010000:0.0:1716999788.337635:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.337637:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ba2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337641:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc5ba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.337661:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5b94 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ad5 expref: 583 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.337668:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc5b94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ad5 expref: 583 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.337674:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216e1c0, rc 0) 00000100:00100000:1.0:1716999788.337678:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+582:11419:x1800404480702336:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 395us (471us total) trans 4294986029 rc 0/0 00000100:00100000:1.0:1716999788.337685:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9083 00000020:00080000:1.0:1716999788.337688:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999788.337692:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+582:11420:x1800404480702208:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 279us (529us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.337697:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45540 00000100:00100000:3.0:1716999788.339016:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.339052:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480702400 00000100:00100000:2.0:1716999788.339057:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480702400 00000100:00100000:2.0:1716999788.339084:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45541 00000100:00100000:2.0:1716999788.339089:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+581:11420:x1800404480702400:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.339098:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.339108:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5ba9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65adc expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.339135:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5bb0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339147:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339153:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339164:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5bb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339170:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339174:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339213:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5bb0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339218:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5bb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339222:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339225:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.339228:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5bb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339233:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5bb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339239:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.339241:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.339244:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5bb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339248:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5bb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339268:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339273:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5bb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339276:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339279:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.339281:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339285:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339290:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x60ff3b22 (ffff880134241b00) 00010000:00010000:2.0:1716999788.339292:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.339294:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5bb7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339299:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5bb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.339327:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5ba9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65adc expref: 582 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.339334:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5ba9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65adc expref: 582 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.339340:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50900, rc 0) 00000100:00100000:2.0:1716999788.339364:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+581:11420:x1800404480702400:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 275us (351us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.339369:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45541 00000100:00100000:0.0:1716999788.341195:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.341786:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480702528 00000100:00100000:2.0:1716999788.341793:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480702528 00000100:00100000:2.0:1716999788.341836:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45542 00000100:00100000:2.0:1716999788.341842:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+581:11419:x1800404480702528:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.341855:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.341868:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc5bbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ae3 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.341944:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5bc5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.341954:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5bc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc45:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.341961:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5bc5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc45:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:2.0:1716999788.341970:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc45:0x0]: returning size 0 00010000:00010000:2.0:1716999788.342058:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc5bbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ae3 expref: 584 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.342069:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5bc5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc45:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ae3 expref: 583 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.342078:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc45:0x0].0x0 (ffff8800939ba100) 00010000:00010000:2.0:1716999788.342080:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999788.342083:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c53cc0, rc 0) 00000100:00100000:2.0:1716999788.342127:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+583:11419:x1800404480702528:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 285us (934us total) trans 4294986030 rc 0/0 00000100:00100000:2.0:1716999788.342132:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45542 00000100:00100000:3.0:1716999788.343689:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.343743:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480702656 00000100:00100000:0.0:1716999788.343747:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480702656 00000100:00100000:0.0:1716999788.343776:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45543 00000100:00100000:0.0:1716999788.343782:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+583:11420:x1800404480702656:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.343792:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.343802:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5bd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65aea expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.343868:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5bda lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.343876:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5bda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.343994:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5bda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344006:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc5be1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344011:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc5be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344016:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc5be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344050:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5bda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344056:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5bda lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344060:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5bda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344066:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fa80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.344068:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5bda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344074:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5bda lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344082:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.344084:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.344087:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5bda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344092:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc5bda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344100:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc5be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344104:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc5be1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344108:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc5be1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344112:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8801339f9f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.344114:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc5be1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344118:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc5be1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344123:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x60ff3b22 (ffff8800908c6400) 00010000:00010000:0.0:1716999788.344124:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.344126:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc5be1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344130:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc5be1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60ff3b22 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.344148:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5bd3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65aea expref: 584 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.344154:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc5bd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65aea expref: 584 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.344160:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216e640, rc 0) 00000100:00100000:0.0:1716999788.344539:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+583:11420:x1800404480702656:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 755us (850us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.344545:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45543 00000100:00100000:3.0:1716999788.345672:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.345904:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480702720 00000100:00100000:0.0:1716999788.345917:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480702720 00000100:00100000:0.0:1716999788.345951:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10012 00000100:00100000:0.0:1716999788.345956:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+77:11419:x1800404480702720:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.345966:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.345976:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65af1 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.345995:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdef40/0x6d188eabd8dc5b8d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ace expref: 78 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.346002:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.346003:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.346005:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af1 expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.346029:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdef40/0x6d188eabd8dc5b8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ace expref: 78 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.346041:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdef40/0x6d188eabd8dc5b8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ace expref: 78 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.346052:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483012736:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.346093:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96f00 going to sleep for 11 seconds 00000100:00100000:1.0:1716999788.346563:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.346690:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480702784 00000100:00100000:0.0:1716999788.346694:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480702784 00000100:00100000:2.0:1716999788.347185:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45544 00000100:00100000:2.0:1716999788.347192:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+583:11420:x1800404480702784:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.347204:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.347215:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5bef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65af8 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.347250:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5bf6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347259:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347266:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347277:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5bfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347281:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347285:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347341:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5bf6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347346:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5bf6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347351:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347355:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.347358:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5bf6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347363:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5bf6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347372:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.347375:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.347378:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5bf6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347382:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5bf6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347391:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5bfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347395:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5bfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347400:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347407:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.347408:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5bfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347413:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5bfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347418:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x60b23c20 (ffff880134241a00) 00010000:00010000:2.0:1716999788.347419:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.347421:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5bfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347425:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5bfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.347457:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5bef lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af8 expref: 584 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.347463:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5bef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af8 expref: 584 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.347471:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c52ac0, rc 0) 00000100:00100000:2.0:1716999788.347496:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+583:11420:x1800404480702784:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 305us (934us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.347502:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45544 00000100:00100000:0.0:1716999788.348545:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483012736:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.348563:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af1 expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.348573:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801339f8240, rc 0) 00000100:00100000:0.0:1716999788.348605:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+78:11419:x1800404480702720:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2648us (2934us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.348611:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10012 00000100:00100000:3.0:1716999788.348989:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.349096:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480702848 00000100:00100000:0.0:1716999788.349101:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480702848 00010000:00010000:0.0:1716999788.349118:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdef40/0x6d188eabd8dc5b8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ace expref: 78 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.349246:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4541 00000100:00100000:0.0:1716999788.349252:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+78:1958:x1800404480702848:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999788.349261:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999788.349277:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdef40/0x6d188eabd8dc5b8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ace expref: 78 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.349286:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdef40/0x6d188eabd8dc5b8d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ace expref: 78 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.349299:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdef40/0x6d188eabd8dc5b8d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ace expref: 78 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.349308:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.349309:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.349314:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af1 expref: 77 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.349321:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af1 expref: 77 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.349341:0:15839:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af1 expref: 77 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.349351:0:15839:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e70e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483012800:192.168.203.3@tcp:105: 00000100:00100000:0.0:1716999788.349498:0:15839:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96f00 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.351084:0:15839:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e70e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483012800:192.168.203.3@tcp:105: 00010000:00010000:0.0:1716999788.351097:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999788.351133:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+77:1958:x1800404480702848:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1880us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.351141:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4541 00000100:00100000:3.0:1716999788.351663:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.351744:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480702976 00000100:00100000:0.0:1716999788.351749:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480702976 00000100:00100000:0.0:1716999788.352198:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45545 00000100:00100000:0.0:1716999788.352203:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+583:11420:x1800404480702976:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.352216:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.352219:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1716999788.352234:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5b0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a9d expref: 583 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.352245:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.352248:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999788.352257:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5c04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65aff expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.352353:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5c0b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.352362:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5c0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.352370:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5c0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.352380:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5c12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.352385:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5c12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.352389:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5c12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:0.0:1716999788.352763:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x607:0x0], index 0: 0 00000040:00080000:0.0:1716999788.352942:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11460, 184 off2049584 00010000:00010000:0.0:1716999788.353030:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5c19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.353037:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.353042:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5c19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.353066:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5c0b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.353071:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5c0b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.353075:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5c0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.353080:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eba80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.353083:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5c0b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.353089:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5c0b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.353095:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.353097:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.353100:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5c0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.353104:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5c0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999788.353111:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012cdee300 reply state ffff88008e4f0000 transno 4294986031 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5c12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999788.353116:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999788.353134:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5c04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65aff expref: 585 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.353143:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5c19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65aff expref: 584 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.353148:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc46:0x0].0x0 (ffff880135ac4f00) 00010000:00010000:0.0:1716999788.353149:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999788.353151:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9440, rc 0) 00000100:00100000:0.0:1716999788.353190:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+585:11420:x1800404480702976:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 985us (1527us total) trans 4294986031 rc 0/0 00000100:00100000:0.0:1716999788.353197:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45545 00000100:00100000:1.0:1716999788.353371:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.353802:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480703040 00000100:00100000:2.0:1716999788.353808:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480703040 00000100:00100000:2.0:1716999788.353848:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45546 00000100:00100000:2.0:1716999788.353853:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+585:11419:x1800404480703040:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.353862:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.353871:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5c27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b06 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.353913:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.353920:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.353926:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.353936:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.353940:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.353945:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.353978:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.353983:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.353988:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.353993:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.353995:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.354000:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.354006:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.354008:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.354010:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.354164:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.354173:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.354177:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.354181:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.354185:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.354187:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.354191:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.354198:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x98b08880 (ffff880134241f00) 00010000:00010000:2.0:1716999788.354200:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.354202:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.354205:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.354393:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5c27 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b06 expref: 586 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.354400:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5c27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b06 expref: 586 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.354407:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50900, rc 0) 00000100:00100000:2.0:1716999788.354430:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+585:11419:x1800404480703040:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 577us (1060us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.354435:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45546 00000100:00100000:1.0:1716999788.356351:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.356413:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.356470:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480703104 00000100:00100000:0.0:1716999788.356476:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480703104 00000100:00100000:3.0:1716999788.356499:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480703168 00000100:00100000:0.0:1716999788.356500:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10013 00000100:00100000:3.0:1716999788.356502:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480703168 00000100:00100000:0.0:1716999788.356505:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+72:1958:x1800404480703104:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.356516:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1716999788.356518:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45547 00000100:00100000:3.0:1716999788.356521:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+585:11419:x1800404480703168:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.356529:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5c3c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b0d expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.356530:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.356538:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5c43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b14 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1716999788.356546:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x607:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999788.356555:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b14 expref: 586 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.356555:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.356556:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.356561:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5c3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b0d expref: 73 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.356564:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b14 expref: 586 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.356570:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.356572:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.356574:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf600, rc 0) 00010000:00010000:0.0:1716999788.356574:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5c3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b0d expref: 73 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.356580:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9200, rc 0) 00010000:00010000:2.0:1716999788.356711:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5c12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.356718:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5c12 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.356722:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5c12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.356726:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.356729:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5c12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.356733:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5c12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.356741:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x60b23c20 (ffff8800a660cf00) 00010000:00010000:2.0:1716999788.356743:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.356745:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5c12 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.356751:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5c12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999788.356798:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+73:1958:x1800404480703104:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 292us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.356804:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10013 00000100:00100000:3.0:1716999788.357176:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+585:11419:x1800404480703168:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 652us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.357182:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45547 00000100:00100000:3.0:1716999788.360932:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.360979:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.361033:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480703232 00000100:00100000:1.0:1716999788.361039:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480703232 00000100:00100000:1.0:1716999788.361245:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480703360 00000100:00100000:1.0:1716999788.361248:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480703360 00000100:00100000:0.0:1716999788.361342:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9084 00000100:00100000:0.0:1716999788.361349:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+586:11419:x1800404480703232:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999788.362040:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9085 00000100:00100000:1.0:1716999788.362046:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+586:11420:x1800404480703360:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999788.362357:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11461, 168 off2049752 00000001:00080000:1.0:1716999788.362362:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986032 00000100:00100000:1.0:1716999788.362434:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+588:11420:x1800404480703360:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 387us (1454us total) trans 4294986033 rc 0/0 00000100:00100000:1.0:1716999788.362441:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9085 00000020:00080000:1.0:1716999788.362444:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999788.366326:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.366374:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480703488 00000100:00100000:0.0:1716999788.366381:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480703488 00000100:00100000:0.0:1716999788.366424:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45548 00000100:00100000:0.0:1716999788.366430:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480703488:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.366447:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.366461:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5c4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b1b expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.366522:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5c51 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.366532:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5c51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc46:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.366540:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5c51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc46:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:0.0:1716999788.366548:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc46:0x0]: returning size 0 00010000:00010000:0.0:1716999788.366637:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5c4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b1b expref: 592 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.368043:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5c51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc46:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b1b expref: 591 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.368052:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc46:0x0].0x0 (ffff880135ac4f00) 00010000:00010000:0.0:1716999788.368055:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1716999788.368057:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e86c0, rc 0) 00000100:00100000:0.0:1716999788.368156:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480703488:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1725us (1835us total) trans 4294986034 rc 0/0 00000100:00100000:0.0:1716999788.368162:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45548 00000100:00100000:0.0:1716999788.369311:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11419:x1800404480703232:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 7959us (8382us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.369319:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9084 00000100:00100000:1.0:1716999788.373683:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.373752:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480703552 00000100:00100000:0.0:1716999788.373760:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480703552 00000100:00100000:0.0:1716999788.373802:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10014 00000100:00100000:0.0:1716999788.373809:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+73:11420:x1800404480703552:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.373830:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.373844:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b22 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.373867:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5c3c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b0d expref: 74 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.373873:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.373875:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.373894:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b22 expref: 74 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.373930:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5c3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b0d expref: 74 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.373939:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5c3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b0d expref: 74 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.373950:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483012864:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.373987:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96300 going to sleep for 11 seconds 00000100:00100000:3.0:1716999788.378143:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.378204:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480703680 00000100:00100000:2.0:1716999788.378210:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480703680 00000100:00100000:2.0:1716999788.378980:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45549 00000100:00100000:2.0:1716999788.378986:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11419:x1800404480703680:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.379003:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.379017:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5c66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b29 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.379094:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379104:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379112:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379122:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379126:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379131:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379161:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379169:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379174:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379179:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.379182:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379187:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379195:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.379197:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.379200:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379203:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5c6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379214:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379217:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379221:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379224:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.379225:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379232:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379236:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x98b08880 (ffff880134241f00) 00010000:00010000:2.0:1716999788.379237:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.379239:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379243:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5c74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.379263:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5c66 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b29 expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.379269:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5c66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b29 expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.379275:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50900, rc 0) 00000100:00100000:2.0:1716999788.380210:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11419:x1800404480703680:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1220us (2334us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.380217:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45549 00000100:00100000:1.0:1716999788.380592:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.380664:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483012864:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.380682:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b22 expref: 74 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.380694:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb840, rc 0) 00000100:00100000:0.0:1716999788.380728:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+74:11420:x1800404480703552:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 6919us (7051us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.380735:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10014 00000100:00100000:2.0:1716999788.380934:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480703744 00000100:00100000:2.0:1716999788.380939:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480703744 00010000:00010000:2.0:1716999788.380955:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5c3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b0d expref: 74 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.380973:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4542 00000100:00100000:2.0:1716999788.380977:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480703744:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999788.380988:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999788.381004:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5c3c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b0d expref: 74 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999788.381012:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5c3c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b0d expref: 74 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999788.381026:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5c3c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b0d expref: 74 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999788.381034:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.381035:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.381040:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b22 expref: 73 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.381046:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b22 expref: 73 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.381069:0:15839:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b22 expref: 73 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.381080:0:15839:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c13100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:15839:1800404483012928:192.168.203.3@tcp:105: 00000100:00100000:2.0:1716999788.381105:0:15839:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012cde99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1716999788.385762:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.385824:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480703808 00000100:00100000:0.0:1716999788.385831:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480703808 00000100:00100000:0.0:1716999788.385868:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45550 00000100:00100000:0.0:1716999788.385875:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480703808:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.385914:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.385930:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5c7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b30 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.385974:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5c82 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.385983:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5c82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.385991:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5c82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386001:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5c89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386006:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386010:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386062:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5c82 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386067:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5c82 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386071:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5c82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386076:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.386079:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5c82 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386084:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5c82 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386094:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.386096:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.386099:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5c82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386103:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5c82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386116:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386120:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5c89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386124:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5c89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386127:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.386129:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5c89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386133:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5c89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386138:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x98b08880 (ffff880135ac4c00) 00010000:00010000:0.0:1716999788.386139:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.386141:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5c89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386145:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5c89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.386180:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5c7b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b30 expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.386187:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5c7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b30 expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.386193:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb3c0, rc 0) 00000100:00100000:0.0:1716999788.386228:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480703808:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 353us (472us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.386234:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45550 00000100:00100000:2.0:1716999788.386782:0:15839:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c13100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:15839:1800404483012928:192.168.203.3@tcp:105: 00010000:00010000:2.0:1716999788.386798:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999788.386869:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480703744:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 5889us (6275us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.386877:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4542 00000100:00100000:3.0:1716999788.388079:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.388148:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.388196:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480704000 00000100:00100000:1.0:1716999788.388202:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480704000 00000100:00100000:1.0:1716999788.388237:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45551 00000100:00100000:1.0:1716999788.388243:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480704000:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.388253:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.388264:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5c90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b37 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.388283:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5c90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b37 expref: 590 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.388292:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5c90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b37 expref: 590 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.388298:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.388301:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.388303:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97600, rc 0) 00000100:00100000:1.0:1716999788.388327:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+590:11420:x1800404480704000:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 84us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.388332:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45551 00000100:00100000:0.0:1716999788.388469:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480703936 00000100:00100000:0.0:1716999788.388473:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480703936 00000100:00100000:0.0:1716999788.388500:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9086 00000100:00100000:0.0:1716999788.388504:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+590:11419:x1800404480703936:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999788.388992:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11462, 168 off2049920 00000001:00080000:0.0:1716999788.388997:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986035 00000100:00100000:0.0:1716999788.389058:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480703936:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 552us (980us total) trans 4294986036 rc 0/0 00000100:00100000:0.0:1716999788.389065:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9086 00000020:00080000:0.0:1716999788.389068:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999788.391531:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.391850:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480704128 00000100:00100000:2.0:1716999788.391857:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480704128 00000100:00100000:3.0:1716999788.391937:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.392191:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45552 00000100:00100000:1.0:1716999788.392197:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480704128:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999788.392240:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1716999788.392258:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5bc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc45:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ae3 expref: 592 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.392289:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc5b6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ab9 expref: 591 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.392298:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc45:0x0].0x0 (ffff8800939ba100) 00010000:00010000:1.0:1716999788.392311:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5c43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b14 expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.392321:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.392323:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.392342:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc5c97 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.392351:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc5c97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.392357:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc5c97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.392366:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc5c9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.392371:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc5c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.392376:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc5c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.392453:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5ca5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.392459:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5ca5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.392464:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5ca5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:1.0:1716999788.392906:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1484, 64 off103232 00000004:00080000:1.0:1716999788.392911:0:7785:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307592030757ns, next at 308592029359ns, rc = 0 00000040:00080000:1.0:1716999788.392930:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11463, 184 off2050104 00010000:00010000:1.0:1716999788.392980:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5cac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.392988:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5cac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.392994:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5cac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.392999:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5cac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393003:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5cac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393007:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5cac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393011:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5cac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393016:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999788.393019:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5cac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393024:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5cac lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393030:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc45:0x0].0x0 (ffff88008a83f100) 00010000:00010000:1.0:1716999788.393033:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999788.393035:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5cac lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393039:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc5cac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393058:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5ca5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393062:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5ca5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393066:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5ca5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393069:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c973c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.393071:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5ca5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393075:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5ca5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393079:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc45:0x0].0x0 (ffff88008a83f100) 00010000:00010000:1.0:1716999788.393081:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999788.393083:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5ca5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393086:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc5ca5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393118:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc5c97 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393122:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc5c97 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393126:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc5c97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393130:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.393132:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc5c97 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393136:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc5c97 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393143:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.393145:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.393147:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc5c97 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.393151:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc5c97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999788.393156:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012cdefb80 reply state ffff88012e8a3000 transno 4294986037 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc5c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999788.393161:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999788.393207:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480704128:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1009us (1680us total) trans 4294986037 rc 0/0 00000100:00100000:1.0:1716999788.393214:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45552 00000100:00100000:0.0:1716999788.394068:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480704192 00000100:00100000:0.0:1716999788.394074:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480704192 00000100:00100000:0.0:1716999788.394098:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9087 00000100:00100000:0.0:1716999788.394104:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480704192:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:2.0:1716999788.396097:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc5c9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.396106:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc5c9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.396112:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc5c9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.396116:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.396120:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc5c9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.396126:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc5c9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.396136:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x4bb1867f (ffff88008a83f200) 00010000:00010000:2.0:1716999788.396138:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.396141:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc5c9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.396145:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc5c9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999788.397471:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.398057:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480704256 00000100:00100000:0.0:1716999788.398063:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480704256 00000100:00100000:0.0:1716999788.398089:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45553 00000100:00100000:0.0:1716999788.398093:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480704256:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.398110:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.398121:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5cb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b3e expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.398159:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5cba lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398168:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398176:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398184:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5cc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60b25030 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398188:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398192:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398236:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398240:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5cba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398245:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398249:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.398252:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398257:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5cba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398264:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.398266:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.398269:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5cba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398273:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5cba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398280:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398285:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398290:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398293:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.398295:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398299:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398304:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x60b25030 (ffff880135ac4200) 00010000:00010000:0.0:1716999788.398306:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.398308:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5cc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398312:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.398340:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5cb3 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b3e expref: 593 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.398347:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5cb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b3e expref: 593 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.398354:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8900, rc 0) 00000100:00100000:0.0:1716999788.399635:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480704256:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1537us (2163us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.399644:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45553 00000100:00100000:1.0:1716999788.400393:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+590:11420:x1800404480704192:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 6287us (8453us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.400401:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9087 00000100:00100000:2.0:1716999788.403479:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.403533:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.403581:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480704384 00000100:00100000:3.0:1716999788.403588:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480704384 00000100:00100000:3.0:1716999788.403610:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480704448 00000100:00100000:3.0:1716999788.403611:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480704448 00000100:00100000:3.0:1716999788.403968:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45554 00000100:00100000:3.0:1716999788.403975:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480704384:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.403990:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.404004:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5cc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b45 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.404085:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5ccf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404096:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5ccf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404104:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5ccf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404116:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404120:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404125:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404160:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5ccf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404165:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5ccf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404170:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5ccf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404174:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.404177:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5ccf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404182:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5ccf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404191:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.404193:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.404196:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5ccf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404200:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5ccf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404212:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404216:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404220:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404226:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.404228:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404233:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404238:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x98b08880 (ffff88009330d300) 00010000:00010000:3.0:1716999788.404240:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.404242:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5cd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404246:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5cd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.404273:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5cc8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b45 expref: 592 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.404279:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5cc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b45 expref: 592 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.404285:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf600, rc 0) 00000100:00100000:3.0:1716999788.404320:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480704384:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 345us (846us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.404325:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45554 00000100:00100000:3.0:1716999788.404338:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45555 00000100:00100000:3.0:1716999788.404342:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+590:11419:x1800404480704448:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.404347:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.404353:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc5cdd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b4c expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.404365:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc5cdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b4c expref: 591 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.404373:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc5cdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b4c expref: 591 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.404378:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.404380:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.404381:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd8c0, rc 0) 00000100:00100000:3.0:1716999788.404394:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480704448:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 52us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.404398:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45555 00000100:00100000:3.0:1716999788.408322:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.408368:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.408558:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480704512 00000100:00100000:1.0:1716999788.408565:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480704512 00000100:00100000:1.0:1716999788.408603:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9088 00000100:00100000:1.0:1716999788.408610:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480704512:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999788.409119:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480704576 00000100:00100000:0.0:1716999788.409123:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480704576 00000100:00100000:0.0:1716999788.409152:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45556 00000100:00100000:0.0:1716999788.409157:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480704576:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.409166:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.409180:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5ce4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b53 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.409218:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ceb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409228:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ceb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409235:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ceb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409244:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5cf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409249:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409254:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409302:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ceb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409306:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ceb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409311:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ceb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409315:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.409318:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ceb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409323:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ceb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409330:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.409332:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.409335:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ceb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409338:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ceb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409347:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409351:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5cf2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409356:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409360:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.409361:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409365:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409369:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x4bb1867f (ffff880135ac4c00) 00010000:00010000:0.0:1716999788.409370:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.409372:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5cf2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409375:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5cf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.409399:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5ce4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b53 expref: 593 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.409404:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5ce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b53 expref: 593 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.409409:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb3c0, rc 0) 00000100:00100000:0.0:1716999788.410120:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+593:11420:x1800404480704576:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 960us (1749us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.410126:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45556 00000100:00100000:2.0:1716999788.413237:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.413921:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480704704 00000100:00100000:0.0:1716999788.413927:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480704704 00000100:00100000:0.0:1716999788.413959:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45557 00000100:00100000:0.0:1716999788.413965:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480704704:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.413978:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.413992:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5cf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b5a expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.414066:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5d00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414076:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5d00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414084:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5d00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414094:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5d07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414099:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5d07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414104:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5d07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414130:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5d00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414136:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5d00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414141:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5d00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414146:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.414149:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5d00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414155:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5d00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414164:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.414166:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.414168:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5d00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414172:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5d00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414180:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5d07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414184:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5d07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414188:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5d07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414192:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eaf40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.414193:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5d07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414198:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5d07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414203:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x4bb1867f (ffff880135ac4200) 00010000:00010000:0.0:1716999788.414205:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.414207:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5d07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414214:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5d07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.414234:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5cf9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b5a expref: 593 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.414241:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5cf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b5a expref: 593 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.414246:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea1c0, rc 0) 00000100:00100000:1.0:1716999788.414877:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480704512:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 6265us (6559us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.414900:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9088 00000100:00100000:0.0:1716999788.414971:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480704704:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1005us (1739us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.414976:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45557 00000100:00100000:3.0:1716999788.419469:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.419819:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480704768 00000100:00100000:0.0:1716999788.419827:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480704768 00000100:00100000:0.0:1716999788.419867:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45558 00000100:00100000:0.0:1716999788.419873:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480704768:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.419924:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.419939:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5d0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b61 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.419983:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5d15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.419993:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5d15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420000:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5d15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420013:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5d1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420017:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420022:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420074:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5d15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420079:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5d15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420084:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5d15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420089:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.420092:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5d15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420097:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5d15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420104:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.420107:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.420109:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5d15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420113:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5d15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420122:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5d1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420127:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5d1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420131:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420134:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.420135:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5d1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420139:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5d1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420144:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x98b08880 (ffff880135ac4c00) 00010000:00010000:0.0:1716999788.420145:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.420147:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5d1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420150:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5d1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.420182:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5d0e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b61 expref: 592 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.420188:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5d0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b61 expref: 592 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.420194:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9680, rc 0) 00000100:00100000:0.0:1716999788.420228:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480704768:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 355us (767us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.420237:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45558 00000100:00100000:3.0:1716999788.420347:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.420390:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480704832 00000100:00100000:3.0:1716999788.420393:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480704832 00000100:00100000:3.0:1716999788.420417:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45559 00000100:00100000:3.0:1716999788.420421:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480704832:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.420428:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.420436:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5d23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b68 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.420458:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5d2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420464:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5d2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420470:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5d2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420477:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5d31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420481:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420485:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420515:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5d2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420519:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5d2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420523:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5d2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420526:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcb40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.420528:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5d2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420533:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5d2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420539:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.420540:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.420543:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5d2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420546:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5d2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420559:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420563:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5d31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420566:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420570:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc6c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.420572:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420576:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420581:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xec6f74b7 (ffff88009330db00) 00010000:00010000:3.0:1716999788.420583:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.420585:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5d31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420589:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5d31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.420614:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5d23 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b68 expref: 592 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.420620:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5d23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b68 expref: 592 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.420627:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde400, rc 0) 00000100:00100000:3.0:1716999788.420647:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480704832:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 225us (300us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.420652:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45559 00000100:00100000:3.0:1716999788.423782:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.423833:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480704896 00000100:00100000:0.0:1716999788.423842:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480704896 00000100:00100000:0.0:1716999788.423900:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45560 00000100:00100000:0.0:1716999788.423907:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480704896:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.423921:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.423934:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b6f expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.423973:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5d3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.423983:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5d3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.423990:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5d3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.423999:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424004:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424008:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424054:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5d3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424058:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5d3f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424064:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5d3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424068:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.424071:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5d3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424075:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5d3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424083:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.424085:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.424087:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5d3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424091:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5d3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424098:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424102:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424106:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424109:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.424111:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424114:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424119:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x45949197 (ffff88012ecfab00) 00010000:00010000:0.0:1716999788.424121:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.424122:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424126:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.424147:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d38 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b6f expref: 592 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.424153:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b6f expref: 592 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.424158:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9b00, rc 0) 00000100:00100000:3.0:1716999788.425727:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.426232:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480705024 00000100:00100000:1.0:1716999788.426237:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480705024 00000100:00100000:0.0:1716999788.426294:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480704896:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2385us (2516us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.426300:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45560 00000100:00100000:0.0:1716999788.426316:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45561 00000100:00100000:0.0:1716999788.426320:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480705024:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.426331:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.426342:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5d4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b76 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.426401:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5d54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426410:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5d54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426417:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5d54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426424:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5d5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426429:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5d5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426433:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5d5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426454:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5d54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426459:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5d54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426463:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5d54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426467:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.426469:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5d54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426474:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5d54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426481:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.426483:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.426485:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5d54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426488:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5d54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426496:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5d5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426500:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5d5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426503:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5d5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426507:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.426508:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5d5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426512:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5d5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426516:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x98b08880 (ffff880131c40100) 00010000:00010000:0.0:1716999788.426517:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.426519:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5d5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426522:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5d5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.426537:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5d4d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b76 expref: 592 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.426542:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5d4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b76 expref: 592 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.426547:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea880, rc 0) 00000100:00100000:0.0:1716999788.426569:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480705024:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 249us (845us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.426574:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45561 00000100:00100000:2.0:1716999788.429743:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.429837:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480705088 00000100:00100000:3.0:1716999788.429845:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480705088 00000100:00100000:3.0:1716999788.430326:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45562 00000100:00100000:3.0:1716999788.430333:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480705088:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.430347:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.430361:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5d62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b7d expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.430402:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5d69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430412:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5d69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430420:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5d69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430429:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5d70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430435:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430443:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430496:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5d69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430501:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5d69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430507:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5d69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430511:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.430514:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5d69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430519:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5d69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430528:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.430531:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.430534:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5d69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430539:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5d69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430548:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430553:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5d70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430557:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430561:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.430563:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430567:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5d70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430573:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x45949197 (ffff88009330de00) 00010000:00010000:3.0:1716999788.430574:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.430576:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5d70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430580:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5d70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.430608:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5d62 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b7d expref: 592 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.430614:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5d62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b7d expref: 592 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.430620:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf840, rc 0) 00000100:00100000:3.0:1716999788.430664:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480705088:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 330us (926us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.430670:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45562 00000100:00100000:3.0:1716999788.435410:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.436009:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.436070:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480705152 00000100:00100000:1.0:1716999788.436078:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480705152 00000100:00100000:1.0:1716999788.436110:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45563 00000100:00100000:1.0:1716999788.436116:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480705152:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.436131:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.436146:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5d77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b84 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.436189:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5d7e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436199:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5d7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436206:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5d7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436217:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5d85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436221:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436225:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436275:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5d7e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436284:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5d7e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436289:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5d7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436293:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.436296:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5d7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436301:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5d7e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436314:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.436317:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.436319:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5d7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436323:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5d7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999788.436335:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480705280 00000100:00100000:0.0:1716999788.436339:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480705280 00010000:00010000:1.0:1716999788.436347:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5d85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436352:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5d85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436356:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436361:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.436363:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5d85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999788.436367:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9089 00010000:00010000:1.0:1716999788.436369:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5d85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999788.436372:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480705280:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:1.0:1716999788.436375:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x4bb1867f (ffff88008a83ff00) 00010000:00010000:1.0:1716999788.436377:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.436378:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5d85 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436382:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5d85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.436421:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5d77 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b84 expref: 593 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.436427:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5d77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b84 expref: 593 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.436434:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95d40, rc 0) 00000100:00100000:1.0:1716999788.436470:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480705152:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 353us (1067us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.436476:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45563 00000040:00080000:0.0:1716999788.436676:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11464, 168 off2050272 00000001:00080000:0.0:1716999788.436692:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986038 00000100:00100000:0.0:1716999788.436763:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480705280:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 390us (754us total) trans 4294986039 rc 0/0 00000100:00100000:0.0:1716999788.436769:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9089 00000020:00080000:0.0:1716999788.436772:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999788.440780:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.440846:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.442111:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480705536 00000100:00100000:0.0:1716999788.442119:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480705536 00000100:00100000:0.0:1716999788.442149:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480705408 00000100:00100000:0.0:1716999788.442151:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480705408 00000100:00100000:0.0:1716999788.442166:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45564 00000100:00100000:0.0:1716999788.442173:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480705536:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999788.442214:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999788.442233:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc57ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc42:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659af expref: 594 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.442247:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc5796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc42:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6599a expref: 593 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.442257:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc42:0x0].0x0 (ffff880135ac4e00) 00010000:00010000:0.0:1716999788.442267:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc5cdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b4c expref: 592 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.442273:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.442275:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999788.442295:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5d8c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442303:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5d8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442310:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5d8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442319:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442323:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442327:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442399:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442404:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442409:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999788.442774:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1483, 64 off103168 00000040:00080000:0.0:1716999788.442795:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11465, 184 off2050456 00010000:00010000:0.0:1716999788.442857:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5da1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442864:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5da1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442870:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5da1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442875:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5da1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442897:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5da1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442901:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5da1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442906:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5da1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442912:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8900 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.442914:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5da1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442919:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5da1 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442926:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc42:0x0].0x0 (ffff880131c40d00) 00010000:00010000:0.0:1716999788.442928:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999788.442931:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5da1 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442935:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5da1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc42:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442953:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442957:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442961:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442964:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.442966:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442971:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442976:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc42:0x0].0x0 (ffff880131c40d00) 00010000:00010000:0.0:1716999788.442978:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999788.442980:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.442984:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5d9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443019:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5d8c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443024:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5d8c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443028:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5d8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443032:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eba80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.443034:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5d8c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443040:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5d8c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443046:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.443047:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.443049:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5d8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443052:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5d8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999788.443058:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008927ce00 reply state ffff880136335000 transno 4294986040 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999788.443064:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999788.443112:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480705536:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 939us (2338us total) trans 4294986040 rc 0/0 00000100:00100000:0.0:1716999788.443118:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45564 00000100:00100000:0.0:1716999788.443133:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45565 00000100:00100000:0.0:1716999788.443137:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480705408:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.443145:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.443147:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1716999788.443156:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5c90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b37 expref: 592 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.443163:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.443166:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999788.443172:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5da8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b8b expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.443233:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5daf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443239:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5daf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443245:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5daf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443252:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5db6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443257:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443261:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:0.0:1716999788.443520:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x608:0x0], index 1: 0 00000040:00080000:0.0:1716999788.443561:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11466, 184 off2050640 00010000:00010000:0.0:1716999788.443630:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5dbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443636:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443641:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443659:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5daf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443663:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5daf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443668:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5daf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443671:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.443673:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5daf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443677:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5daf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443682:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.443683:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.443685:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5daf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.443688:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5daf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999788.443695:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008927fb80 reply state ffff8800a6701000 transno 4294986041 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999788.443699:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999788.443713:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5da8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b8b expref: 594 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.443722:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b8b expref: 593 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.443726:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc47:0x0].0x0 (ffff880094791e00) 00010000:00010000:0.0:1716999788.443728:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999788.443729:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea1c0, rc 0) 00000100:00100000:0.0:1716999788.443748:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+594:11420:x1800404480705408:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 610us (2902us total) trans 4294986041 rc 0/0 00000100:00100000:0.0:1716999788.443753:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45565 00000100:00100000:2.0:1716999788.450703:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999788.450740:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5db6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.450748:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5db6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.450754:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5db6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.450758:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.450762:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5db6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.450767:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5db6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.450777:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x4bb1867f (ffff880091b4db00) 00010000:00010000:2.0:1716999788.450780:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.450782:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5db6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.450786:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5db6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999788.451351:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480705600 00000100:00100000:1.0:1716999788.451359:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480705600 00000100:00100000:1.0:1716999788.451387:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45566 00000100:00100000:1.0:1716999788.451393:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480705600:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.451408:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.451419:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5dcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b92 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.451464:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5dd2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451474:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451481:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451489:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5dd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451494:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451499:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451542:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5dd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451546:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5dd2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451550:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5dd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451554:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.451556:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5dd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451560:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5dd2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451569:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.451570:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.451573:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5dd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451576:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5dd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451585:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5dd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451589:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5dd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451593:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451596:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.451598:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5dd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451602:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5dd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451606:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x54f6b75a (ffff88008a83ff00) 00010000:00010000:1.0:1716999788.451607:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.451609:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5dd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.451612:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5dd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.452338:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.452345:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.452348:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.452352:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.452355:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.452359:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.452366:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x17a4f95f (ffff880131c40b00) 00010000:00010000:3.0:1716999788.452368:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.452371:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.452374:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5d93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999788.452460:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999788.452516:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5dcb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b92 expref: 593 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.452522:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5dcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b92 expref: 593 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.452530:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95d40, rc 0) 00000100:00100000:2.0:1716999788.452566:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480705600:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1173us (1869us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.452573:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45566 00000100:00100000:3.0:1716999788.452894:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480705664 00000100:00100000:3.0:1716999788.452900:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480705664 00000100:00100000:3.0:1716999788.453663:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10015 00000100:00100000:3.0:1716999788.453669:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+77:1958:x1800404480705664:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.453678:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.453691:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdf840/0x6d188eabd8dc5de0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65b99 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999788.453709:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x608:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999788.453720:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.453721:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.453726:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdf840/0x6d188eabd8dc5de0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b99 expref: 78 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.453735:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bdf840/0x6d188eabd8dc5de0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b99 expref: 78 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.453743:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf840, rc 0) 00000100:00100000:3.0:1716999788.453760:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+78:1958:x1800404480705664:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 91us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.453764:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10015 00000100:00100000:2.0:1716999788.455543:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.455863:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480705728 00000100:00100000:0.0:1716999788.455870:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480705728 00000100:00100000:0.0:1716999788.456770:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45567 00000100:00100000:0.0:1716999788.456777:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480705728:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.456794:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.456808:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5de7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ba0 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.456840:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ba0 expref: 593 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.456849:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ba0 expref: 593 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.456856:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.456858:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.456860:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eaf40, rc 0) 00000100:00100000:0.0:1716999788.456933:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480705728:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 155us (1393us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.456938:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45567 00000100:00100000:2.0:1716999788.457456:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.457567:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480705856 00000100:00100000:0.0:1716999788.457573:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480705856 00000100:00100000:0.0:1716999788.457622:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9090 00000100:00100000:0.0:1716999788.457627:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+593:11420:x1800404480705856:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999788.457980:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11467, 168 off2050808 00000001:00080000:0.0:1716999788.457986:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986042 00000100:00100000:0.0:1716999788.458055:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+595:11420:x1800404480705856:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 426us (600us total) trans 4294986043 rc 0/0 00000100:00100000:0.0:1716999788.458060:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9090 00000020:00080000:0.0:1716999788.458063:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999788.460095:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.460927:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480705920 00000100:00100000:1.0:1716999788.460934:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480705920 00000100:00100000:1.0:1716999788.460965:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9091 00000100:00100000:1.0:1716999788.460972:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+595:11419:x1800404480705920:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999788.462727:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.462992:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480706048 00000100:00100000:3.0:1716999788.462998:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480706048 00000100:00100000:3.0:1716999788.463109:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45568 00000100:00100000:3.0:1716999788.463115:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:11420:x1800404480706048:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.463129:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.463143:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5dee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ba7 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.463203:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5df5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.463213:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5df5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc47:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.463225:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5df5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc47:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:3.0:1716999788.463233:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc47:0x0]: returning size 0 00010000:00010000:3.0:1716999788.463312:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5dee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ba7 expref: 599 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.463339:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5df5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc47:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ba7 expref: 598 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.463345:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc47:0x0].0x0 (ffff880094791e00) 00010000:00010000:3.0:1716999788.463348:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1716999788.463350:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde640, rc 0) 00000100:00100000:3.0:1716999788.464133:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:11420:x1800404480706048:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1016us (1407us total) trans 4294986044 rc 0/0 00000100:00100000:1.0:1716999788.464134:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480705920:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3161us (4041us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.464139:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45568 00000100:00100000:1.0:1716999788.464142:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9091 00000100:00100000:2.0:1716999788.472102:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.472145:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.472188:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480706112 00000100:00100000:0.0:1716999788.472196:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480706112 00000100:00100000:0.0:1716999788.472231:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10016 00000100:00100000:0.0:1716999788.472237:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+78:11420:x1800404480706112:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.472252:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.472267:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65bae expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.472290:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdf840/0x6d188eabd8dc5de0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b99 expref: 79 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.472297:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.472298:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.472301:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bae expref: 79 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.472326:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdf840/0x6d188eabd8dc5de0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b99 expref: 79 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.472336:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdf840/0x6d188eabd8dc5de0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b99 expref: 79 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.472351:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483012992:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.472394:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96780 going to sleep for 11 seconds 00000100:00100000:3.0:1716999788.472474:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480706176 00000100:00100000:3.0:1716999788.472479:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480706176 00000100:00100000:3.0:1716999788.472501:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45569 00000100:00100000:3.0:1716999788.472505:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:11419:x1800404480706176:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.472516:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.472526:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5e0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65bb5 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.472562:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5e11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472571:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5e11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472580:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5e11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472591:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5e18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472596:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472602:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472655:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5e11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472660:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5e11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472665:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5e11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472670:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.472673:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5e11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472678:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5e11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472686:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.472689:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.472692:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5e11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472696:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc5e11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472719:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472724:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5e18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472728:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472732:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc6c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.472734:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472739:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472744:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x54f6b75a (ffff88009330de00) 00010000:00010000:3.0:1716999788.472746:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.472748:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5e18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472752:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc5e18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.472786:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5e0a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bb5 expref: 598 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.472793:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc5e0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bb5 expref: 598 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.472799:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf3c0, rc 0) 00000100:00100000:3.0:1716999788.472857:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:11419:x1800404480706176:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 350us (710us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.472862:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45569 00000100:00100000:0.0:1716999788.479757:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483012992:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.479784:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bae expref: 79 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.479798:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb3c0, rc 0) 00000100:00100000:2.0:1716999788.480182:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.481537:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+79:11420:x1800404480706112:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 9295us (9438us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.481545:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10016 00000100:00100000:3.0:1716999788.481675:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480706240 00000100:00100000:3.0:1716999788.481681:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480706240 00010000:00010000:3.0:1716999788.481704:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdf840/0x6d188eabd8dc5de0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b99 expref: 79 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:3.0:1716999788.481727:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4543 00000100:00100000:3.0:1716999788.481732:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480706240:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999788.481741:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.481760:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdf840/0x6d188eabd8dc5de0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b99 expref: 79 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.481766:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999788.481769:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdf840/0x6d188eabd8dc5de0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b99 expref: 79 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.481783:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480706304 00010000:00010000:3.0:1716999788.481785:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdf840/0x6d188eabd8dc5de0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b99 expref: 79 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.481786:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480706304 00010000:00010000:3.0:1716999788.481795:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.481797:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.481802:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bae expref: 78 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.481817:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bae expref: 78 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.481846:0:15839:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bae expref: 78 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.481856:0:15839:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008927d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483013056:192.168.203.3@tcp:105: 00000100:00100000:3.0:1716999788.481907:0:15839:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009c108c00 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.483261:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45570 00000100:00100000:2.0:1716999788.483268:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:11419:x1800404480706304:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.483283:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.483297:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5e1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65bbc expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.483336:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483345:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483352:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483361:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483370:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483375:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483425:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483430:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483435:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483440:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.483443:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483448:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483456:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.483458:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.483460:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483464:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483490:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483495:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483499:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483503:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.483506:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483510:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483516:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x522b8500 (ffff880134241a00) 00010000:00010000:2.0:1716999788.483518:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.483520:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483524:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.483556:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5e1f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bbc expref: 598 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.483562:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5e1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bbc expref: 598 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.483569:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c52ac0, rc 0) 00000100:00100000:2.0:1716999788.483613:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:11419:x1800404480706304:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 344us (1846us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.483619:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45570 00000100:00100000:3.0:1716999788.487009:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.487098:0:15839:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008927d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483013056:192.168.203.3@tcp:105: 00010000:00010000:0.0:1716999788.487118:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999788.487151:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480706240:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 5417us (6969us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.487162:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4543 00000100:00100000:2.0:1716999788.487466:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480706368 00000100:00100000:2.0:1716999788.487472:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480706368 00000100:00100000:2.0:1716999788.487638:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45571 00000100:00100000:2.0:1716999788.487644:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:11420:x1800404480706368:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.487660:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.487674:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc5e34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65bc3 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.487713:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5e3b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487722:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5e3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487730:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5e3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487740:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5e42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487745:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487750:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487802:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5e3b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487807:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5e3b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487822:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5e3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487827:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.487830:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5e3b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487835:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5e3b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487843:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.487845:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.487847:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5e3b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487851:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5e3b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487860:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487864:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5e42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487868:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5e42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487871:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.487873:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5e42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487877:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5e42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487900:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x98b08880 (ffff880134241f00) 00010000:00010000:2.0:1716999788.487902:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.487904:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5e42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487920:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5e42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.487954:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc5e34 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bc3 expref: 598 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.487961:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc5e34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bc3 expref: 598 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.487967:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c51440, rc 0) 00000100:00100000:2.0:1716999788.487987:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:11420:x1800404480706368:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 344us (986us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.487992:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45571 00000100:00100000:3.0:1716999788.488183:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.488300:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480706432 00000100:00100000:1.0:1716999788.488304:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480706432 00000100:00100000:1.0:1716999788.488326:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45572 00000100:00100000:1.0:1716999788.488330:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+597:11419:x1800404480706432:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.488338:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.488344:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5e49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65bca expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.488364:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5e50 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488370:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5e50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488375:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5e50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488383:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5e57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488387:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488391:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488423:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5e50 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488428:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5e50 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488432:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5e50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488436:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.488438:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5e50 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488442:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5e50 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488448:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.488450:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.488452:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5e50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488456:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5e50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488466:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488470:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5e57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488473:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5e57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488480:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.488482:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5e57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488486:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5e57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488491:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x52788402 (ffff88008a83fa00) 00010000:00010000:1.0:1716999788.488493:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.488495:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5e57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488499:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5e57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.488528:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5e49 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bca expref: 598 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.488535:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5e49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bca expref: 598 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.488542:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95d40, rc 0) 00000100:00100000:1.0:1716999788.488559:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+597:11419:x1800404480706432:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 228us (378us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.488564:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45572 00000100:00100000:3.0:1716999788.493993:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.494034:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.494819:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480706496 00000100:00100000:0.0:1716999788.494827:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480706496 00000100:00100000:0.0:1716999788.495165:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480706624 00000100:00100000:0.0:1716999788.495168:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480706624 00000100:00100000:2.0:1716999788.495230:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45573 00000100:00100000:2.0:1716999788.495237:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:11420:x1800404480706496:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.495253:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.495268:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5e5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65bd1 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.495293:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bd1 expref: 599 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.495303:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bd1 expref: 599 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.495310:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.495312:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.495315:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c52ac0, rc 0) 00000100:00100000:0.0:1716999788.495393:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45574 00000100:00100000:0.0:1716999788.495398:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+599:11419:x1800404480706624:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.495405:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.495413:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5e65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65bd8 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.495490:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5e6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495498:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5e6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495504:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5e6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495514:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5e73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495519:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495524:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495554:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5e6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495560:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5e6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495565:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5e6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495570:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.495573:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5e6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495578:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5e6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495589:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.495591:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.495593:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5e6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495598:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5e6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495617:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5e73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495621:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5e73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495625:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5e73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495629:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.495631:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5e73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495635:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5e73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495641:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x52788402 (ffff880094791d00) 00010000:00010000:0.0:1716999788.495643:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.495645:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5e73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495648:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5e73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.495669:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5e65 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bd8 expref: 600 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.495676:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5e65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bd8 expref: 600 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.495682:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8fc0, rc 0) 00000100:00100000:2.0:1716999788.495935:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+599:11420:x1800404480706496:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 696us (1948us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.495941:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45573 00000100:00100000:0.0:1716999788.496137:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480706624:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 738us (2101us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.496143:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45574 00000100:00100000:0.0:1716999788.501614:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.501651:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.501694:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480706752 00000100:00100000:1.0:1716999788.501704:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480706752 00000100:00100000:1.0:1716999788.501752:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9092 00000100:00100000:1.0:1716999788.501760:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+598:11420:x1800404480706752:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999788.502306:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480706688 00000100:00100000:2.0:1716999788.502311:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480706688 00000100:00100000:2.0:1716999788.502340:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45575 00000100:00100000:2.0:1716999788.502344:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+599:11419:x1800404480706688:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.502353:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.502366:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65bdf expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.502403:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502413:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502421:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502429:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502434:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502438:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502485:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502494:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502499:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502503:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.502506:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502511:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502519:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.502522:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.502525:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502529:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5e81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502540:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502545:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502549:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502553:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.502555:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502563:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502568:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x522b8500 (ffff880134241d00) 00010000:00010000:2.0:1716999788.502570:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.502572:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502576:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.502604:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e7a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bdf expref: 600 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.502610:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bdf expref: 600 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.502617:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c53180, rc 0) 00000100:00100000:2.0:1716999788.504912:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+600:11419:x1800404480706688:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2556us (3294us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.504922:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45575 00000100:00100000:2.0:1716999788.511776:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+598:11420:x1800404480706752:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 10007us (10114us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.511788:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9092 00000100:00100000:3.0:1716999788.517593:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.518987:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.519380:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480706880 00000100:00100000:2.0:1716999788.519388:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480706880 00000100:00100000:2.0:1716999788.519434:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45576 00000100:00100000:2.0:1716999788.519440:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480706880:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.519458:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.519476:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5e8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65be6 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.519559:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519571:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519579:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519590:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519595:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519600:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519630:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519635:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519639:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519643:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.519646:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519652:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519660:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.519663:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.519666:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519670:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5e96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519690:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519695:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519700:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519704:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.519706:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519710:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519716:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x522b8500 (ffff880134241100) 00010000:00010000:2.0:1716999788.519718:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.519719:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519723:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.519748:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5e8f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65be6 expref: 599 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.519755:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5e8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65be6 expref: 599 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.519762:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c52880, rc 0) 00000100:00100000:2.0:1716999788.519797:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480706880:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 357us (2211us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.519803:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45576 00000100:00100000:0.0:1716999788.520311:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480707008 00000100:00100000:0.0:1716999788.520322:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480707008 00000100:00100000:0.0:1716999788.520368:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45577 00000100:00100000:0.0:1716999788.520375:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:11420:x1800404480707008:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.520389:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.520404:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5ea4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65bed expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.520484:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5eab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520495:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5eab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520504:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5eab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520515:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5eb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520524:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520529:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520560:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5eab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520566:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5eab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520571:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5eab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520576:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.520578:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5eab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520683:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5eab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520692:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.520695:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.520698:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5eab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520702:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5eab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520723:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5eb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520728:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5eb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520734:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520738:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.520740:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5eb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520744:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5eb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520750:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x98b08880 (ffff880094791100) 00010000:00010000:0.0:1716999788.520752:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.520754:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5eb2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520758:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5eb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x98b08880 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.520781:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5ea4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bed expref: 599 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.520788:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5ea4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bed expref: 599 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.520794:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eba80, rc 0) 00000100:00100000:0.0:1716999788.520842:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:11420:x1800404480707008:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 467us (1857us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.520849:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45577 00000100:00100000:1.0:1716999788.528734:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.528776:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.528839:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480707072 00000100:00100000:0.0:1716999788.528848:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480707072 00000100:00100000:0.0:1716999788.528924:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45578 00000100:00100000:0.0:1716999788.528931:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480707072:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.528947:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.528963:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5eb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65bf4 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.529008:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5ec0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529018:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529026:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529036:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5ec7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529042:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529047:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529098:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5ec0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529103:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5ec0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529108:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529113:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.529117:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5ec0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529122:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5ec0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529130:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.529133:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.529136:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5ec0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529140:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc5ec0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529148:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5ec7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529152:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5ec7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529155:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529159:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.529166:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5ec7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529171:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5ec7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529176:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x52788402 (ffff880094791f00) 00010000:00010000:0.0:1716999788.529178:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.529181:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5ec7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529188:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc5ec7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.529217:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5eb9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bf4 expref: 599 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.529223:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc5eb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bf4 expref: 599 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.529230:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea880, rc 0) 00000100:00100000:0.0:1716999788.529271:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480707072:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 341us (545us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.529276:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45578 00000100:00100000:2.0:1716999788.529632:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480707200 00000100:00100000:2.0:1716999788.529637:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480707200 00000100:00100000:2.0:1716999788.529655:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9093 00000100:00100000:2.0:1716999788.529659:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+598:11420:x1800404480707200:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:2.0:1716999788.529961:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986045 00000040:00080000:2.0:1716999788.530073:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11468, 168 off2050976 00000001:00080000:2.0:1716999788.530077:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986046 00000100:00100000:2.0:1716999788.531107:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+601:11420:x1800404480707200:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1443us (2326us total) trans 4294986047 rc 0/0 00000100:00100000:2.0:1716999788.531114:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9093 00000020:00080000:2.0:1716999788.531119:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1716999788.531576:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.531626:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480707328 00000100:00100000:0.0:1716999788.531631:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480707328 00000100:00100000:0.0:1716999788.531652:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45579 00000100:00100000:0.0:1716999788.531657:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480707328:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.531668:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.531679:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ece lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65bfb expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.531740:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5ed5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531751:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531758:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531769:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5edc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531774:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531780:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531822:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5ed5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531827:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5ed5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531831:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531836:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.531839:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5ed5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531844:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5ed5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531852:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.531854:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.531857:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5ed5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531862:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5ed5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531876:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5edc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531898:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5edc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531902:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5edc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531906:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.531908:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5edc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531913:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5edc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531919:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x52788402 (ffff880094791a00) 00010000:00010000:0.0:1716999788.531922:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.531924:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5edc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531929:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5edc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.531948:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ece lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bfb expref: 602 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.531954:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5ece lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bfb expref: 602 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.531961:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9b00, rc 0) 00000100:00100000:0.0:1716999788.531994:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480707328:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 336us (419us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.531999:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45579 00000100:00100000:3.0:1716999788.538201:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.538238:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.541171:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480707456 00000100:00100000:0.0:1716999788.541182:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480707456 00000100:00100000:0.0:1716999788.541213:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480707520 00000100:00100000:0.0:1716999788.541215:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480707520 00000100:00100000:0.0:1716999788.541232:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45580 00000100:00100000:0.0:1716999788.541238:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480707456:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999788.541276:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999788.541294:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5df5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc47:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ba7 expref: 602 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.541309:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc5dbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b8b expref: 601 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.541317:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc47:0x0].0x0 (ffff880094791e00) 00010000:00010000:0.0:1716999788.541328:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bd1 expref: 600 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.541335:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.541337:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999788.541356:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5ee3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541364:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5ee3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541370:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5ee3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541381:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5eea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541385:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541389:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541469:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5ef1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541475:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5ef1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541481:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5ef1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:0.0:1716999788.541877:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1485, 64 off103296 00000040:00080000:0.0:1716999788.541912:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11469, 184 off2051160 00010000:00010000:0.0:1716999788.541965:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5ef8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541971:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541977:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541983:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5ef8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541988:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5ef8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.541996:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5ef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542001:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5ef8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542005:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9200 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.542008:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5ef8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542014:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5ef8 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542020:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc47:0x0].0x0 (ffff880094791d00) 00010000:00010000:0.0:1716999788.542023:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999788.542025:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5ef8 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542029:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc5ef8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542046:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5ef1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542050:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5ef1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542054:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5ef1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542057:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.542060:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5ef1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542066:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5ef1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542072:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc47:0x0].0x0 (ffff880094791d00) 00010000:00010000:0.0:1716999788.542073:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999788.542075:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5ef1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542079:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc5ef1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542113:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5ee3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542118:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5ee3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542123:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5ee3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542127:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.542129:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5ee3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542133:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5ee3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542139:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.542141:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.542143:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5ee3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.542146:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc5ee3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999788.542154:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008927ea00 reply state ffff8800938ea000 transno 4294986048 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999788.542159:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999788.542556:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45581 00000100:00100000:1.0:1716999788.542562:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480707520:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.542572:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.542581:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5eff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c02 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.542608:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5f06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.542615:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5f06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.542621:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5f06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.542630:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5f0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.542634:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.542639:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.542671:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5f06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.542676:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5f06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.542684:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.542687:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.542689:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.542693:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5f06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.542699:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.542701:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.542704:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5f06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.542707:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc5f06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999788.544285:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480707456:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3041us (6085us total) trans 4294986048 rc 0/0 00000100:00100000:0.0:1716999788.544292:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45580 00010000:00010000:1.0:1716999788.544583:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5f0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.544591:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5f0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.544596:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5f0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.544604:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.544607:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5f0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.544612:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5f0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.544622:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x522b8500 (ffff88008a83f000) 00010000:00010000:1.0:1716999788.544624:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.544626:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5f0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.544630:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5f0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.544679:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5eff lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c02 expref: 601 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.544686:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5eff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c02 expref: 601 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.544693:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c961c0, rc 0) 00000100:00100000:1.0:1716999788.544730:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+600:11419:x1800404480707520:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2169us (6492us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.544737:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45581 00010000:00010000:0.0:1716999788.546983:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.546993:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5eea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.546999:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.547003:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eba80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.547007:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.547012:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5eea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.547092:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x4bb1867f (ffff880094791800) 00010000:00010000:0.0:1716999788.547095:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.547098:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5eea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.547103:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc5eea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x4bb1867f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999788.547769:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.548252:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.548304:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480707648 00000100:00100000:0.0:1716999788.548312:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480707648 00000100:00100000:0.0:1716999788.548524:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480707712 00000100:00100000:0.0:1716999788.548528:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480707712 00000100:00100000:1.0:1716999788.548602:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45582 00000100:00100000:1.0:1716999788.548608:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+600:11419:x1800404480707648:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.548626:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.548629:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999788.548644:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaf40/0x6d188eabd8dc5de7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ba0 expref: 600 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.548654:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.548657:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.548668:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc5f14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c09 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.548763:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5f1b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.548772:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5f1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.548779:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5f1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.548789:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5f22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.548794:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.548798:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999788.549238:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45583 00000100:00100000:0.0:1716999788.549244:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+600:11420:x1800404480707712:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.549250:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.549259:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5f29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c10 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.549282:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5f30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549288:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5f30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549294:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5f30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549303:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5f37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60b25030 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549307:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549312:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549340:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5f30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549346:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5f30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549351:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5f30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549356:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.549358:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5f30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549364:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5f30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549370:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.549372:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.549375:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5f30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549378:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc5f30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549386:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549389:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5f37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549393:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5f37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549396:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.549398:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5f37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549401:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5f37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549405:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x60b25030 (ffff880094791900) 00010000:00010000:0.0:1716999788.549407:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.549409:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5f37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549412:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc5f37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x60b25030 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.549439:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5f29 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c10 expref: 601 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.549445:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc5f29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c10 expref: 601 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.549452:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9b00, rc 0) 00000100:00100000:0.0:1716999788.549490:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+600:11420:x1800404480707712:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 246us (1238us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.549495:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45583 00000004:00080000:1.0:1716999788.549933:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x608:0x0], index 0: 0 00000040:00080000:1.0:1716999788.549995:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11470, 184 off2051344 00010000:00010000:1.0:1716999788.550072:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5f3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.550079:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5f3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.550084:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5f3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.550105:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5f1b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.550112:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5f1b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.550117:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5f1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.550120:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.550122:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5f1b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.550126:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5f1b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.550132:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.550133:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.550135:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5f1b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.550138:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5f1b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999788.550145:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008927c380 reply state ffff88012e8a2000 transno 4294986049 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999788.550151:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999788.550166:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc5f14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c09 expref: 601 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.550175:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5f3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c09 expref: 600 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.550180:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc48:0x0].0x0 (ffff88008a83fb00) 00010000:00010000:1.0:1716999788.550182:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999788.550183:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94000, rc 0) 00000100:00100000:1.0:1716999788.551991:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480707648:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 3378us (4220us total) trans 4294986049 rc 0/0 00000100:00100000:1.0:1716999788.551998:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45582 00000100:00100000:0.0:1716999788.552187:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.552641:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480707776 00000100:00100000:1.0:1716999788.552648:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480707776 00000100:00100000:1.0:1716999788.552682:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45584 00000100:00100000:1.0:1716999788.552688:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+601:11420:x1800404480707776:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.552701:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.552713:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5f4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c17 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.552733:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c17 expref: 602 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.552742:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c17 expref: 602 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.552748:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.552751:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.552753:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97600, rc 0) 00000100:00100000:1.0:1716999788.552780:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480707776:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 91us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.552785:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45584 00010000:00010000:2.0:1716999788.554368:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5f22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999788.554375:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999788.554379:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5f22 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.554386:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5f22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.554391:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.554394:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5f22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.554401:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5f22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.554410:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x522b8500 (ffff88008a83f100) 00010000:00010000:2.0:1716999788.554413:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.554415:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5f22 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.554419:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc5f22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999788.554446:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480707840 00000100:00100000:1.0:1716999788.554452:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480707840 00000100:00100000:1.0:1716999788.555227:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10017 00000100:00100000:1.0:1716999788.555233:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+73:1958:x1800404480707840:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.555249:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.555264:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5f53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c1e expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1716999788.555285:0:17365:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x608:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1716999788.555296:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.555298:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.555304:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c1e expref: 74 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999788.555317:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c1e expref: 74 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999788.555324:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c961c0, rc 0) 00000100:00100000:1.0:1716999788.555354:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+74:1958:x1800404480707840:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 121us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.555359:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10017 00000100:00100000:0.0:1716999788.555999:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.556055:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480707904 00000100:00100000:2.0:1716999788.556059:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480707904 00000100:00100000:2.0:1716999788.556078:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9094 00000100:00100000:2.0:1716999788.556082:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+601:11420:x1800404480707904:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999788.557366:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.557551:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708032 00000100:00100000:0.0:1716999788.557555:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708032 00000100:00100000:0.0:1716999788.557583:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9095 00000100:00100000:0.0:1716999788.557588:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480708032:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999788.558098:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11471, 168 off2051512 00000001:00080000:0.0:1716999788.558103:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986050 00000100:00100000:0.0:1716999788.558163:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+605:11419:x1800404480708032:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 574us (798us total) trans 4294986051 rc 0/0 00000100:00100000:0.0:1716999788.558171:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9095 00000020:00080000:0.0:1716999788.558175:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999788.559285:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480707904:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3198us (3283us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.559292:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9094 00000100:00100000:2.0:1716999788.560215:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.560393:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708160 00000100:00100000:3.0:1716999788.560399:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708160 00000100:00100000:3.0:1716999788.560438:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45585 00000100:00100000:3.0:1716999788.560444:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480708160:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.560458:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.560473:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5f5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c25 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.560538:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5f61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.560548:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5f61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc48:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.560556:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5f61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc48:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:3.0:1716999788.560564:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc48:0x0]: returning size 0 00010000:00010000:3.0:1716999788.560654:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc5f5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c25 expref: 606 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.560679:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5f61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc48:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c25 expref: 605 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.560687:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc48:0x0].0x0 (ffff88008a83fb00) 00010000:00010000:3.0:1716999788.560689:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1716999788.560691:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf840, rc 0) 00000100:00100000:3.0:1716999788.560724:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11419:x1800404480708160:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 279us (510us total) trans 4294986052 rc 0/0 00000100:00100000:3.0:1716999788.560730:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45585 00000100:00100000:2.0:1716999788.561453:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.561969:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708224 00000100:00100000:3.0:1716999788.561974:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708224 00000100:00100000:3.0:1716999788.562007:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45586 00000100:00100000:3.0:1716999788.562012:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480708224:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.562023:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.562038:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5f6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c2c expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.562070:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5f76 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562078:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5f76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562085:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5f76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562095:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5f7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562100:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562104:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562152:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5f76 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562157:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5f76 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562162:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5f76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562167:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.562170:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5f76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562175:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5f76 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562183:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.562185:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.562188:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5f76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562192:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc5f76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562199:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5f7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562204:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5f7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562208:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562212:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.562214:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5f7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562218:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5f7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562223:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xec6f74b7 (ffff88009330d900) 00010000:00010000:3.0:1716999788.562225:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.562227:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5f7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562231:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc5f7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.562260:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5f6f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c2c expref: 606 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.562267:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc5f6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c2c expref: 606 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.562272:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcb40, rc 0) 00000100:00100000:3.0:1716999788.562295:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480708224:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 283us (844us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.562301:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45586 00000100:00100000:1.0:1716999788.563184:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.563254:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708288 00000100:00100000:2.0:1716999788.563259:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708288 00000100:00100000:2.0:1716999788.563649:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10018 00000100:00100000:2.0:1716999788.563655:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+74:11419:x1800404480708288:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.563664:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.563675:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c33 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.563697:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5f53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c1e expref: 75 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.563708:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.563710:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.563712:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c33 expref: 75 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.563736:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c1e expref: 75 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.563746:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5f53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c1e expref: 75 pid: 17365 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.563755:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099583480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483013120:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.563790:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012cde99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.564047:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.564212:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708352 00000100:00100000:3.0:1716999788.564216:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708352 00000100:00100000:3.0:1716999788.564268:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45587 00000100:00100000:3.0:1716999788.564273:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480708352:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.564284:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.564292:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5f8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c3a expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.564319:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5f92 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564327:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5f92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564334:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5f92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564343:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5f99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564348:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564356:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564395:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5f92 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564399:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5f92 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564404:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5f92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564409:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.564411:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5f92 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564416:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5f92 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564423:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.564425:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.564428:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5f92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564432:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc5f92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564441:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5f99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564445:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5f99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564450:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5f99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564454:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcd80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.564456:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5f99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564459:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5f99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564465:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x45949197 (ffff88009330de00) 00010000:00010000:3.0:1716999788.564466:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.564468:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5f99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564471:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc5f99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.564502:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5f8b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c3a expref: 606 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.564508:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc5f8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c3a expref: 606 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.564514:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd680, rc 0) 00000100:00100000:3.0:1716999788.565463:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480708352:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1187us (1414us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.565469:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45587 00000100:00100000:0.0:1716999788.565761:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.565777:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708416 00000100:00100000:0.0:1716999788.565780:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708416 00010000:00010000:0.0:1716999788.565795:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5f53 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c1e expref: 76 pid: 17365 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.565818:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4544 00000100:00100000:0.0:1716999788.565823:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+76:1959:x1800404480708416:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999788.565830:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999788.565844:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5f53 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c1e expref: 76 pid: 17365 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.565853:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5f53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c1e expref: 76 pid: 17365 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.565865:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.565866:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.565871:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c33 expref: 76 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.565877:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c33 expref: 76 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.565909:0:15839:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c33 expref: 76 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.565918:0:15839:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131e72300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:15839:1800404483013184:192.168.203.3@tcp:105: 00000100:00100000:0.0:1716999788.565950:0:15839:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96000 going to sleep for 11 seconds 00010000:00010000:2.0:1716999788.566028:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc5f53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c1e expref: 76 pid: 17365 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.566040:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099583480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483013120:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999788.566053:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c33 expref: 75 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.566060:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c52880, rc 0) 00000100:00100000:2.0:1716999788.566075:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+75:11419:x1800404480708288:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2421us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.566080:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10018 00000100:00100000:3.0:1716999788.567782:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.567863:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708480 00000100:00100000:2.0:1716999788.567868:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708480 00000100:00100000:2.0:1716999788.567923:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45588 00000100:00100000:2.0:1716999788.567929:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480708480:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.567941:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.567955:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5fa0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c41 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.567992:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5fa7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568001:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568008:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568018:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5fae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568023:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568028:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568072:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5fa7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568077:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5fa7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568083:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568087:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.568089:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5fa7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568094:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5fa7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568102:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.568103:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.568106:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5fa7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568109:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc5fa7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568117:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5fae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568121:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5fae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568125:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5fae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568129:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.568130:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5fae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568134:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5fae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568139:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x45949197 (ffff880134241f00) 00010000:00010000:2.0:1716999788.568140:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.568142:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5fae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568146:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc5fae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x45949197 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.568168:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5fa0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c41 expref: 606 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.568174:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc5fa0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c41 expref: 606 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.568179:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50fc0, rc 0) 00000100:00100000:2.0:1716999788.568202:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480708480:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 273us (424us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.568206:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45588 00000100:00100000:0.0:1716999788.568345:0:15839:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131e72300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:15839:1800404483013184:192.168.203.3@tcp:105: 00010000:00010000:0.0:1716999788.568358:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999788.568377:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480708416:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2554us (2617us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.568384:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4544 00000100:00100000:3.0:1716999788.571575:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.571633:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708544 00000100:00100000:1.0:1716999788.571640:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708544 00000100:00100000:1.0:1716999788.571674:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45589 00000100:00100000:1.0:1716999788.571680:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+605:11419:x1800404480708544:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.571694:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.571709:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc5fb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c48 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.571759:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5fbc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571770:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5fbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571778:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5fbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571788:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5fc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571793:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571798:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571858:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5fbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571864:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5fbc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571868:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5fbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571873:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.571876:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5fbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571903:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5fbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571915:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.571918:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.571921:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5fbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571926:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc5fbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571939:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5fc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571943:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5fc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571947:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571950:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.571952:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5fc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571955:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5fc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571960:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x4f529a91 (ffff88008a83f300) 00010000:00010000:1.0:1716999788.571961:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.571963:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5fc3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571966:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc5fc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.571996:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc5fb5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c48 expref: 606 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.572002:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc5fb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c48 expref: 606 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.572007:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94b40, rc 0) 00000100:00100000:1.0:1716999788.572046:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+605:11419:x1800404480708544:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 361us (470us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.572052:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45589 00000100:00100000:1.0:1716999788.573728:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.573978:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708608 00000100:00100000:2.0:1716999788.573984:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708608 00000100:00100000:2.0:1716999788.574007:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45590 00000100:00100000:2.0:1716999788.574013:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11419:x1800404480708608:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.574023:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.574033:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc5fca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c4f expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.574053:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc5fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c4f expref: 606 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.574066:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc5fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c4f expref: 606 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.574071:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.574074:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.574075:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c51440, rc 0) 00000100:00100000:1.0:1716999788.574107:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.574596:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+606:11419:x1800404480708608:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 581us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.574601:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45590 00000100:00100000:3.0:1716999788.574648:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708736 00000100:00100000:3.0:1716999788.574652:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708736 00000100:00100000:3.0:1716999788.574682:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9096 00000100:00100000:3.0:1716999788.574686:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+606:11420:x1800404480708736:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999788.575149:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11472, 168 off2051680 00000001:00080000:3.0:1716999788.575153:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986053 00000100:00100000:3.0:1716999788.575222:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+608:11420:x1800404480708736:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 534us (1114us total) trans 4294986054 rc 0/0 00000100:00100000:3.0:1716999788.575228:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9096 00000020:00080000:3.0:1716999788.575231:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999788.577128:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.577523:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.577716:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708800 00000100:00100000:3.0:1716999788.577723:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708800 00000100:00100000:3.0:1716999788.577759:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9097 00000100:00100000:3.0:1716999788.577765:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+608:11419:x1800404480708800:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999788.577932:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708928 00000100:00100000:2.0:1716999788.577936:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708928 00000100:00100000:2.0:1716999788.577967:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45591 00000100:00100000:2.0:1716999788.577971:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+609:11420:x1800404480708928:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999788.578000:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1716999788.578017:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc5995 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc43:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a11 expref: 609 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.578030:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc593a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a03 expref: 608 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.578037:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc43:0x0].0x0 (ffff880135ac4500) 00010000:00010000:2.0:1716999788.578047:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc5f4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c17 expref: 607 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.578053:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.578055:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999788.578071:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5fd1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.578080:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5fd1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.578086:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5fd1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.578095:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5fd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.578099:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.578103:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.578175:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5fdf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.578179:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5fdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.578184:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5fdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:2.0:1716999788.579598:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1486, 64 off103360 00000040:00080000:2.0:1716999788.579623:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11473, 184 off2051864 00010000:00010000:2.0:1716999788.579685:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc5fe6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579694:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc5fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579701:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc5fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579707:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc5fe6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579712:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc5fe6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579717:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc5fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579721:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc5fe6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579726:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5f80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999788.579729:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc5fe6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579735:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc5fe6 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579742:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc43:0x0].0x0 (ffff880134241b00) 00010000:00010000:2.0:1716999788.579744:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999788.579746:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc5fe6 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579750:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc5fe6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579769:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5fdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579773:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5fdf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579777:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5fdf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579782:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.579784:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5fdf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579788:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5fdf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579793:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc43:0x0].0x0 (ffff880134241b00) 00010000:00010000:2.0:1716999788.579795:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999788.579796:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5fdf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579801:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc5fdf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579851:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5fd1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579856:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5fd1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579860:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5fd1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.579865:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.579867:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5fd1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.580394:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5fd1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.580402:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.580404:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.580407:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5fd1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.580411:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc5fd1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999788.580420:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e603b80 reply state ffff88008bbc4000 transno 4294986055 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999788.580426:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999788.580479:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+609:11420:x1800404480708928:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2504us (2953us total) trans 4294986055 rc 0/0 00000100:00100000:2.0:1716999788.580485:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45591 00000100:00100000:3.0:1716999788.581491:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480708800:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3723us (4364us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.581499:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9097 00010000:00010000:0.0:1716999788.583195:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5fd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.583203:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5fd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.583208:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5fd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.583213:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.583216:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5fd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.583221:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5fd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.583232:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x17a4f95f (ffff880134241100) 00010000:00010000:0.0:1716999788.583234:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.583237:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5fd8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.583242:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc5fd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x17a4f95f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999788.583411:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.583488:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480708992 00000100:00100000:3.0:1716999788.583494:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480708992 00000100:00100000:3.0:1716999788.583518:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45592 00000100:00100000:3.0:1716999788.583523:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+606:11420:x1800404480708992:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.583537:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.583548:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5fed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c56 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.583586:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5ff4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583596:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583604:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583614:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5ffb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583619:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583624:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583674:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583678:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5ff4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583682:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583686:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.583688:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583692:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5ff4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583698:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.583699:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.583702:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5ff4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583705:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc5ff4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583713:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5ffb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583717:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5ffb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583721:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583724:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.583726:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5ffb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583730:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5ffb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583736:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x54f6b75a (ffff88009330d300) 00010000:00010000:3.0:1716999788.583738:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.583740:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5ffb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583743:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc5ffb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.583773:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5fed lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c56 expref: 607 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.583779:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc5fed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c56 expref: 607 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.583790:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc000, rc 0) 00000100:00100000:3.0:1716999788.583835:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+606:11420:x1800404480708992:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 310us (425us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.583840:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45592 00000100:00100000:1.0:1716999788.585050:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.585286:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480709056 00000100:00100000:3.0:1716999788.585292:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480709056 00000100:00100000:3.0:1716999788.585371:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45593 00000100:00100000:3.0:1716999788.585377:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+606:11420:x1800404480709056:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.585391:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.585402:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6002 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c5d expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.585418:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c5d expref: 607 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.585426:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c5d expref: 607 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.585432:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.585434:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.585436:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdfcc0, rc 0) 00000100:00100000:3.0:1716999788.585475:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480709056:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 96us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.585479:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45593 00000100:00100000:0.0:1716999788.585877:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.586067:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480709120 00000100:00100000:1.0:1716999788.586071:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480709120 00000100:00100000:1.0:1716999788.586781:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45594 00000100:00100000:1.0:1716999788.586787:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480709120:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.586796:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.586815:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6009 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c64 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.586854:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6010 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.586863:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.586869:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.586906:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6017 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.586912:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.586918:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.586970:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6010 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.586975:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6010 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.586980:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6010 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.586985:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.586988:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6010 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.586993:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6010 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.587000:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.587002:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.587004:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6010 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.587007:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6010 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.587023:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6017 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.587029:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6017 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.587033:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.587037:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.587039:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6017 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.587042:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6017 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.587048:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x4f529a91 (ffff88008a83fa00) 00010000:00010000:1.0:1716999788.587049:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.587051:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6017 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.587055:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6017 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.587086:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6009 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c64 expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.587091:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6009 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c64 expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.587096:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96ac0, rc 0) 00000100:00100000:1.0:1716999788.587123:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480709120:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 337us (1247us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.587130:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45594 00000100:00100000:0.0:1716999788.587571:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.587632:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480709184 00000100:00100000:3.0:1716999788.587637:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480709184 00000100:00100000:3.0:1716999788.587660:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9098 00000100:00100000:3.0:1716999788.587665:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480709184:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999788.590096:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.590209:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480709248 00000100:00100000:2.0:1716999788.590216:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480709248 00000100:00100000:2.0:1716999788.590241:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45595 00000100:00100000:2.0:1716999788.590247:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+609:11419:x1800404480709248:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.590258:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.590271:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc601e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c6b expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.590307:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6025 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590316:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590323:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590332:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc602c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590339:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc602c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590344:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc602c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590386:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6025 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590389:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6025 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590393:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590398:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.590400:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6025 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590405:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6025 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590412:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.590415:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.590417:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6025 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590421:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6025 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590440:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc602c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590445:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc602c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590449:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc602c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590452:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.590454:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc602c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590458:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc602c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590462:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x5a9c1470 (ffff880134241a00) 00010000:00010000:2.0:1716999788.590464:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.590466:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc602c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590469:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc602c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.590493:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc601e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c6b expref: 609 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.590498:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc601e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c6b expref: 609 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.590503:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb6880, rc 0) 00000100:00100000:2.0:1716999788.590528:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+608:11419:x1800404480709248:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 281us (438us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.590533:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45595 00000100:00100000:3.0:1716999788.591596:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480709184:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3928us (4023us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.591604:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9098 00000100:00100000:1.0:1716999788.591840:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.591941:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480709312 00000100:00100000:2.0:1716999788.591946:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480709312 00000100:00100000:2.0:1716999788.591974:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45596 00000100:00100000:2.0:1716999788.591978:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480709312:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.591991:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.592301:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6033 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c72 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.592331:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc603a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592338:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc603a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592344:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc603a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592353:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592358:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592362:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592395:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc603a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592399:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc603a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592403:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc603a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592406:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.592409:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc603a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592414:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc603a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592421:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.592423:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.592425:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc603a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592429:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc603a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592435:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592439:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6041 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592442:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592445:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.592447:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592450:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6041 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592454:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x5ae91372 (ffff880134241100) 00010000:00010000:2.0:1716999788.592456:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.592457:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6041 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592464:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.592484:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6033 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c72 expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.592489:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6033 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c72 expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.592494:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb73c0, rc 0) 00000100:00100000:2.0:1716999788.592525:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480709312:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 546us (686us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.592530:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45596 00000100:00100000:1.0:1716999788.593936:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.593977:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480709440 00000100:00100000:2.0:1716999788.593981:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480709440 00000100:00100000:2.0:1716999788.594119:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45597 00000100:00100000:2.0:1716999788.594125:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480709440:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.594137:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.594148:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6048 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c79 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.594209:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc604f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594217:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc604f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594223:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc604f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594235:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6056 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594240:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594244:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594271:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc604f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594276:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc604f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594281:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc604f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594285:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.594287:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc604f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594292:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc604f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594299:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.594301:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.594304:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc604f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594308:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc604f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594317:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6056 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594322:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6056 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594326:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594330:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.594332:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6056 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594336:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6056 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594342:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x5ae91372 (ffff880134241f00) 00010000:00010000:2.0:1716999788.594344:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.594346:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6056 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594350:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6056 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.594369:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6048 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c79 expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.594375:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6048 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c79 expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.594382:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb6ac0, rc 0) 00000100:00100000:2.0:1716999788.594406:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480709440:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 280us (472us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.594414:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45597 00000100:00100000:1.0:1716999788.594493:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.594526:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480709504 00000100:00100000:3.0:1716999788.594530:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480709504 00000100:00100000:3.0:1716999788.594555:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45598 00000100:00100000:3.0:1716999788.594559:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480709504:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.594569:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.594576:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc605d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c80 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.594598:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6064 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594604:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6064 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594610:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6064 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594619:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc606b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594624:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc606b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594628:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc606b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594659:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6064 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594668:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6064 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594672:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6064 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594676:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.594678:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6064 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594683:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6064 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594689:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.594691:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.594693:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6064 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594697:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6064 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594705:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc606b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594709:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc606b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594713:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc606b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594717:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcd80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.594719:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc606b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594726:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc606b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594743:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x54f6b75a (ffff88009330d100) 00010000:00010000:3.0:1716999788.594745:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.594748:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc606b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594752:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc606b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999788.594784:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc605d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c80 expref: 608 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.594791:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc605d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c80 expref: 608 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.594798:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bded00, rc 0) 00000100:00100000:3.0:1716999788.594837:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480709504:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 276us (344us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.594843:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45598 00000100:00100000:1.0:1716999788.599468:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.599600:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480709568 00000100:00100000:2.0:1716999788.599609:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480709568 00000100:00100000:2.0:1716999788.599683:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45599 00000100:00100000:2.0:1716999788.599690:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480709568:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.599705:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.599719:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc6072 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c87 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.599761:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6079 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.599771:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.599779:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.599791:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.599796:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.599802:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.599867:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.599872:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6079 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601159:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601168:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.601171:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601177:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6079 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601187:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.601189:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.601192:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6079 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601196:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6079 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601209:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601214:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6080 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601218:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601221:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.601223:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601227:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6080 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601232:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x5a9c1470 (ffff880134241a00) 00010000:00010000:2.0:1716999788.601234:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.601236:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6080 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601239:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6080 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.601284:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc6072 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c87 expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.601290:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc6072 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c87 expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.601295:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb6880, rc 0) 00000100:00100000:2.0:1716999788.602678:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480709568:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2983us (3211us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.602685:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45599 00000100:00100000:1.0:1716999788.602957:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.603002:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480709632 00000100:00100000:3.0:1716999788.603008:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480709632 00000100:00100000:3.0:1716999788.603131:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45600 00000100:00100000:3.0:1716999788.603137:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480709632:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.603150:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.603163:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc6087 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c8e expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.603206:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc608e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603216:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc608e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603224:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc608e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603235:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6095 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603239:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603244:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603289:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc608e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603293:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc608e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603298:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc608e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603302:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcb40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.603304:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc608e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603309:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc608e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603319:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.603322:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.603324:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc608e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603328:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc608e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603340:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6095 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603344:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6095 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603349:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603353:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.603355:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6095 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603359:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6095 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603365:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x522b8500 (ffff88009330d300) 00010000:00010000:3.0:1716999788.603366:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.603368:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6095 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603372:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6095 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.603400:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc6087 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c8e expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.603406:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc6087 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c8e expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.603412:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdef40, rc 0) 00000100:00100000:3.0:1716999788.603449:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480709632:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 312us (492us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.603454:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45600 00000100:00100000:0.0:1716999788.605175:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.605216:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.605281:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480709696 00000100:00100000:2.0:1716999788.605287:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480709696 00000100:00100000:2.0:1716999788.605308:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45601 00000100:00100000:2.0:1716999788.605314:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480709696:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.605324:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.605336:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc609c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c95 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.605369:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc60a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605381:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc60a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605387:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc60a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605396:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc60aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605401:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc60aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605405:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc60aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605444:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc60a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605449:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc60a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605454:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc60a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605458:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb4900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.605460:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc60a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605465:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc60a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605472:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.605474:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.605477:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc60a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605481:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc60a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605488:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc60aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605492:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc60aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605497:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc60aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605500:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb58c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.605502:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc60aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605505:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc60aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605509:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x52788402 (ffff880134241b00) 00010000:00010000:2.0:1716999788.605511:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.605513:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc60aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605517:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc60aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.605544:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc609c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c95 expref: 608 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.605551:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc609c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c95 expref: 608 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.605558:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb4480, rc 0) 00000100:00100000:3.0:1716999788.605639:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480709824 00000100:00100000:3.0:1716999788.605642:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480709824 00000100:00100000:3.0:1716999788.605659:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45602 00000100:00100000:3.0:1716999788.605663:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+608:11419:x1800404480709824:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.605669:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.605676:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc60b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65c9c expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.605717:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc60b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605724:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc60b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605729:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc60b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605745:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc60bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605749:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc60bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605757:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc60bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605778:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc60b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605783:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc60b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605788:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc60b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605791:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.605794:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc60b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605798:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc60b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605803:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.605805:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.605807:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc60b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605822:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc60b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605829:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc60bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605833:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc60bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605837:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc60bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605842:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.605844:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc60bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605849:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc60bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605854:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x5a9c1470 (ffff88009330d900) 00010000:00010000:3.0:1716999788.605856:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.605858:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc60bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605871:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc60bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.605911:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc60b1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c9c expref: 609 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.605916:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc60b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c9c expref: 609 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.605922:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf600, rc 0) 00000100:00100000:2.0:1716999788.606137:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+608:11420:x1800404480709696:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 821us (963us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.606143:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45601 00000100:00100000:3.0:1716999788.606306:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480709824:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 642us (1090us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.606311:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45602 00000100:00100000:1.0:1716999788.608019:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.608148:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.608215:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480709888 00000100:00100000:3.0:1716999788.608221:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480709888 00000100:00100000:3.0:1716999788.608249:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480710016 00000100:00100000:3.0:1716999788.608252:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480710016 00000100:00100000:3.0:1716999788.608265:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45603 00000100:00100000:3.0:1716999788.608271:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+608:11419:x1800404480709888:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.608283:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.608295:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc60c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ca3 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.608332:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc60cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608341:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc60cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608348:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc60cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608357:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc60d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608362:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc60d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608366:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc60d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608411:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc60cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608416:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc60cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608422:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc60cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608426:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.608428:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc60cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608434:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc60cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608442:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.608445:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.608447:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc60cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608451:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc60cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608460:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc60d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608465:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc60d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608470:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc60d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608473:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.608475:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc60d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608480:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc60d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608485:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x5ae91372 (ffff88009330db00) 00010000:00010000:3.0:1716999788.608487:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.608489:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc60d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608493:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc60d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608520:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc60c6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ca3 expref: 609 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.608526:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc60c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ca3 expref: 609 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.608537:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc6c0, rc 0) 00000100:00100000:3.0:1716999788.608566:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+608:11419:x1800404480709888:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 294us (549us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.608571:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45603 00000100:00100000:3.0:1716999788.608583:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45604 00000100:00100000:3.0:1716999788.608587:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480710016:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.608593:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.608599:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc60db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65caa expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.608636:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc60e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608642:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc60e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608647:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc60e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608656:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc60e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608660:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc60e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608665:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc60e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608686:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc60e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608690:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc60e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.608694:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc60e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.609766:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcd80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.609769:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc60e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.609775:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc60e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.609783:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.609786:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.609789:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc60e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.609793:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc60e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.609805:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc60e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.609821:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc60e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.609825:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc60e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.609830:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.609832:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc60e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.609836:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc60e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.609842:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x52788402 (ffff88009330de00) 00010000:00010000:3.0:1716999788.609844:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.609846:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc60e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.609850:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc60e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.609874:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc60db lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65caa expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.609895:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc60db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65caa expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.609902:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bded00, rc 0) 00000100:00100000:3.0:1716999788.609942:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480710016:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1353us (1792us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.609948:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45604 00000100:00100000:1.0:1716999788.610088:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.610945:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.610995:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480710144 00000100:00100000:3.0:1716999788.611000:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480710144 00000100:00100000:3.0:1716999788.611029:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480710208 00000100:00100000:3.0:1716999788.611032:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480710208 00000100:00100000:3.0:1716999788.611050:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45605 00000100:00100000:3.0:1716999788.611057:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+608:11419:x1800404480710144:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.611069:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.611079:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc60f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65cb1 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.611129:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45606 00000100:00100000:0.0:1716999788.611133:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+609:11420:x1800404480710208:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.611139:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.611146:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc60fe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.611146:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc60f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65cb8 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.611155:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc60fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.611161:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc60fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.611167:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc6105 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.611170:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc610c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.611174:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc6105 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.611175:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc610c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.611179:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc610c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.611179:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc6105 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.611186:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc6113 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.611191:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc6113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.611195:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc6113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.611205:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc60fe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.611209:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc60fe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.611213:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc60fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.611217:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.611219:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc60fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.611220:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc6105 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.611224:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc6105 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.611225:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc60fe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.611229:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc6105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.611231:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.611233:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.611233:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.611234:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc6105 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.611235:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc60fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.611239:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc60fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.611239:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc6105 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.611244:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.611245:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.611247:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc610c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.611247:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc6105 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.611251:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc610c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.611252:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc6105 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.611255:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc610c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.611259:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.611260:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc610c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.611264:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc610c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.611269:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc6113 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.611271:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x5ae91372 (ffff88009330df00) 00010000:00010000:3.0:1716999788.611273:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.611273:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc6113 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.611275:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc610c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.611278:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc6113 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.611279:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc610c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.611281:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e8000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.611283:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc6113 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.611287:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc6113 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.611292:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x522b8500 (ffff880094791f00) 00010000:00010000:0.0:1716999788.611293:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.611295:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc6113 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.611296:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc60f0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cb1 expref: 610 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.611299:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc6113 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.611322:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc60f7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cb8 expref: 610 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.611328:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc60f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cb8 expref: 610 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.611334:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918ea880, rc 0) 00000100:00100000:0.0:1716999788.611357:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+609:11420:x1800404480710208:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 223us (413us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.611362:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45606 00010000:00010000:3.0:1716999788.613201:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc60f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cb1 expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.613214:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc000, rc 0) 00000100:00100000:2.0:1716999788.613240:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.613243:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480710144:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2186us (3155us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.613249:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45605 00000100:00100000:1.0:1716999788.613285:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480710336 00000100:00100000:1.0:1716999788.613290:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480710336 00000100:00100000:1.0:1716999788.614562:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45607 00000100:00100000:1.0:1716999788.614568:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480710336:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:2.0:1716999788.614581:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999788.614584:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.614596:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc611a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65cbf expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.614597:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480710400 00000100:00100000:2.0:1716999788.614601:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480710400 00000100:00100000:2.0:1716999788.614627:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45608 00000100:00100000:2.0:1716999788.614631:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+609:11419:x1800404480710400:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.614637:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.614643:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6121 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65cc6 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.614666:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6128 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614667:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc612f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614675:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6128 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614675:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc612f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614683:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6128 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614683:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc612f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.614691:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6136 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614692:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc613d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.614697:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc613d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614699:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614704:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc613d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614704:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614741:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6128 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614744:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc612f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614747:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6128 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614748:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc612f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614752:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6128 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614752:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc612f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614756:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.614756:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.614759:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6128 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614759:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc612f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614764:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6128 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614764:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc612f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614771:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.614771:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.614773:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.614773:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.614776:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6128 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614776:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc612f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614780:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6128 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614780:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc612f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614790:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc613d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999788.614796:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc613d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614796:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6136 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614800:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc613d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614800:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6136 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614805:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.614805:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614807:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc613d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614819:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.614821:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc613d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614821:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6136 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.614825:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6136 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614827:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x5a9c1470 (ffff880134241f00) 00010000:00010000:2.0:1716999788.614829:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.614830:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc613d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614830:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x522b8500 (ffff88008a83f700) 00010000:00010000:1.0:1716999788.614832:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.614833:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6136 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.614835:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc613d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.614838:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6136 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.614857:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc611a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cbf expref: 610 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.614863:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc611a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cbf expref: 610 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.614865:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6121 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cc6 expref: 610 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.614870:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c973c0, rc 0) 00010000:00010000:2.0:1716999788.614871:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6121 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cc6 expref: 609 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.614877:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb6ac0, rc 0) 00000100:00100000:2.0:1716999788.614908:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+608:11419:x1800404480710400:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 275us (326us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.614908:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+608:11420:x1800404480710336:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 340us (1668us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.614913:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45608 00000100:00100000:1.0:1716999788.615090:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45607 00000100:00100000:0.0:1716999788.616167:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.616285:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480710464 00000100:00100000:1.0:1716999788.616290:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480710464 00000100:00100000:1.0:1716999788.616322:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45609 00000100:00100000:1.0:1716999788.616328:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480710464:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.616338:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.616348:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc6144 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ccd expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.616380:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc614b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616388:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc614b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616395:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc614b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616404:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6152 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616409:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616414:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616453:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc614b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616458:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc614b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616463:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc614b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616466:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.616469:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc614b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616473:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc614b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616480:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.616482:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.616485:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc614b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616489:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc614b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616497:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6152 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616501:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6152 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616505:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616508:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.616510:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6152 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616515:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6152 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616520:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x52788402 (ffff88008a83f300) 00010000:00010000:1.0:1716999788.616522:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.616523:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6152 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616530:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6152 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.616554:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc6144 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ccd expref: 608 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.616561:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95b00/0x6d188eabd8dc6144 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ccd expref: 608 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.616568:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95b00, rc 0) 00000100:00100000:1.0:1716999788.616607:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480710464:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 278us (441us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.616612:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45609 00000100:00100000:2.0:1716999788.617743:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.618243:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480710592 00000100:00100000:1.0:1716999788.618248:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480710592 00000100:00100000:1.0:1716999788.618280:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45610 00000100:00100000:1.0:1716999788.618286:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480710592:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.618297:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.618299:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999788.618314:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc5fca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c4f expref: 607 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.618325:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.618328:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.618337:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6159 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65cd4 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.618421:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6160 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.618429:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6160 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.618435:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6160 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.618444:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6167 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.618449:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.618453:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:1.0:1716999788.618846:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x609:0x0], index 1: 0 00000040:00080000:1.0:1716999788.618921:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11474, 184 off2052048 00000100:00100000:0.0:1716999788.618951:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999788.619007:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc616e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619014:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc616e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619020:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc616e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619043:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6160 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619048:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6160 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619053:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6160 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619057:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.619060:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6160 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619066:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6160 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619073:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.619075:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.619077:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6160 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619081:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6160 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999788.619088:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099580e00 reply state ffff880099966000 transno 4294986056 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999788.619094:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999788.619110:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6159 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cd4 expref: 609 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.619120:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc616e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cd4 expref: 608 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.619126:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc49:0x0].0x0 (ffff88008a83f100) 00010000:00010000:1.0:1716999788.619127:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999788.619129:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97600, rc 0) 00000100:00100000:1.0:1716999788.619185:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+609:11419:x1800404480710592:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 898us (1443us total) trans 4294986056 rc 0/0 00000100:00100000:1.0:1716999788.619190:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45610 00000100:00100000:1.0:1716999788.619284:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480710720 00000100:00100000:1.0:1716999788.619287:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480710720 00000100:00100000:1.0:1716999788.619302:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45611 00000100:00100000:1.0:1716999788.619306:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+609:11420:x1800404480710720:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.619313:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.619320:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc617c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65cdb expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.619357:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6183 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619364:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619370:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619379:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc618a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619384:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc618a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619389:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc618a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619436:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6183 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619444:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6183 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619448:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619452:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.619454:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6183 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619459:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6183 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619466:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.619468:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.619470:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6183 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619474:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6183 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619481:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc618a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619485:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc618a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619489:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc618a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619493:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.619495:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc618a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619503:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc618a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619508:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x52788402 (ffff88008a83fa00) 00010000:00010000:1.0:1716999788.619510:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.619512:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc618a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619515:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc618a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52788402 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.619533:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc617c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cdb expref: 610 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.619539:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc617c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cdb expref: 610 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.619544:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94480, rc 0) 00000100:00100000:1.0:1716999788.619610:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+609:11420:x1800404480710720:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 301us (657us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.619615:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45611 00010000:00010000:2.0:1716999788.620307:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6167 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.620313:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6167 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.620318:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.620322:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.620324:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6167 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.620329:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6167 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.620335:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x5a9c1470 (ffff88008a83f500) 00010000:00010000:2.0:1716999788.620337:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.620340:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6167 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999788.620344:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6167 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999788.621349:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.621765:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.621836:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480710784 00000100:00100000:2.0:1716999788.621842:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480710784 00000100:00100000:2.0:1716999788.621898:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10019 00000100:00100000:2.0:1716999788.621904:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480710784:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.621914:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.621927:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6191 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ce2 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999788.621945:0:17365:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x609:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999788.621956:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.621958:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.621963:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6191 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ce2 expref: 79 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.621974:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6191 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ce2 expref: 79 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.621983:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb73c0, rc 0) 00000100:00100000:2.0:1716999788.622019:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480710784:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 114us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.622024:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10019 00000100:00100000:1.0:1716999788.622243:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480710848 00000100:00100000:1.0:1716999788.622247:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480710848 00000100:00100000:1.0:1716999788.622262:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45612 00000100:00100000:1.0:1716999788.622266:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+608:11420:x1800404480710848:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.622274:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.622281:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6198 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ce9 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.622312:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc619f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622319:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc619f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622323:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc619f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622437:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc61a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622442:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc61a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622446:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc61a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622486:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc619f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622489:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc619f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622492:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc619f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622495:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c961c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.622497:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc619f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622500:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc619f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622508:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.622509:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.622511:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc619f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622514:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc619f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622519:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc61a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622522:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc61a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622525:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc61a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622527:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.622528:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc61a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622530:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc61a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622533:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x522b8500 (ffff88008a83f700) 00010000:00010000:1.0:1716999788.622534:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.622535:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc61a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622537:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc61a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.622555:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6198 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ce9 expref: 609 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.622560:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6198 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ce9 expref: 609 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.622565:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94d80, rc 0) 00000100:00100000:1.0:1716999788.622591:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+608:11420:x1800404480710848:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 324us (827us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.622594:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45612 00000100:00100000:0.0:1716999788.624970:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.625164:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480710976 00000100:00100000:3.0:1716999788.625171:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480710976 00000100:00100000:3.0:1716999788.625201:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9099 00000100:00100000:3.0:1716999788.625207:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+608:11419:x1800404480710976:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999788.625576:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11475, 168 off2052216 00000001:00080000:3.0:1716999788.625581:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986057 00000100:00100000:3.0:1716999788.625678:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+610:11419:x1800404480710976:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 469us (711us total) trans 4294986058 rc 0/0 00000100:00100000:3.0:1716999788.625685:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9099 00000020:00080000:3.0:1716999788.625689:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999788.625803:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.626081:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480711104 00000100:00100000:1.0:1716999788.626085:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480711104 00000100:00100000:1.0:1716999788.626104:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45613 00000100:00100000:1.0:1716999788.626108:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+610:11420:x1800404480711104:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.626116:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.626118:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999788.626133:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6002 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c5d expref: 610 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.626145:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.626148:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.626157:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc61ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65cf0 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.626229:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc61b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626238:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc61b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626246:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc61b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626257:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc61bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626262:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc61bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626267:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc61bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:1.0:1716999788.626558:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x609:0x0], index 0: 0 00000040:00080000:1.0:1716999788.626601:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11476, 184 off2052400 00010000:00010000:1.0:1716999788.626665:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc61c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626672:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc61c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626677:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc61c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626697:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc61b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626703:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc61b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626708:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc61b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626712:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.626715:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc61b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626723:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc61b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626730:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.626732:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.626735:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc61b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.626739:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc61b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999788.626746:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009143c000 reply state ffff880099960000 transno 4294986059 ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc61bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999788.626751:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999788.626768:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc61ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cf0 expref: 612 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.626777:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc61c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cf0 expref: 611 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.626783:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4a:0x0].0x0 (ffff88008a83ff00) 00010000:00010000:1.0:1716999788.626785:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999788.626786:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801339f9f80, rc 0) 00000100:00100000:1.0:1716999788.626837:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+612:11420:x1800404480711104:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 727us (1034us total) trans 4294986059 rc 0/0 00000100:00100000:1.0:1716999788.626843:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45613 00010000:00010000:0.0:1716999788.629248:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc61bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.629258:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc61bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.629267:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc61bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.629272:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8801339fba80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.629275:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc61bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.629281:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc61bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.629291:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x522b8500 (ffff88008a83f200) 00010000:00010000:0.0:1716999788.629293:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.629296:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc61bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.629299:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc61bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999788.629483:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.629524:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480711232 00000100:00100000:0.0:1716999788.629531:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480711232 00000100:00100000:0.0:1716999788.629565:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45614 00000100:00100000:0.0:1716999788.629570:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+611:11419:x1800404480711232:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.629587:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.629598:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc61d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65cf7 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.629658:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc61d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.629666:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc61d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc49:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.629673:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc61d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc49:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:0.0:1716999788.629680:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc49:0x0]: returning size 0 00010000:00010000:0.0:1716999788.629765:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc61d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cf7 expref: 614 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.629774:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc61d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc49:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cf7 expref: 613 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.629780:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc49:0x0].0x0 (ffff88008a83f100) 00010000:00010000:0.0:1716999788.629781:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1716999788.629783:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8000, rc 0) 00000100:00100000:0.0:1716999788.629834:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+613:11419:x1800404480711232:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 262us (353us total) trans 4294986060 rc 0/0 00000100:00100000:0.0:1716999788.629840:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45614 00000100:00100000:2.0:1716999788.631576:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.631633:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480711296 00000100:00100000:0.0:1716999788.631639:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480711296 00000100:00100000:0.0:1716999788.631665:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10020 00000100:00100000:0.0:1716999788.631670:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+74:1958:x1800404480711296:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.631680:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.631693:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc61e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65cfe expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1716999788.631710:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x609:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1716999788.631722:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.631724:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.631730:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc61e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cfe expref: 75 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.631740:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc61e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cfe expref: 75 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.631748:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8b40, rc 0) 00000100:00100000:0.0:1716999788.631855:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+75:1958:x1800404480711296:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 183us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.631861:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10020 00000100:00100000:3.0:1716999788.631968:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.632120:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480711360 00000100:00100000:0.0:1716999788.632123:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480711360 00000100:00100000:0.0:1716999788.632294:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10021 00000100:00100000:0.0:1716999788.632299:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+79:11419:x1800404480711360:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.632307:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.632316:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d05 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.632330:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6191 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ce2 expref: 80 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.632336:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.632337:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.632340:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d05 expref: 80 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.632360:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6191 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ce2 expref: 80 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.632374:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6191 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ce2 expref: 80 pid: 17365 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.632385:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483013248:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.632417:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e963c0 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.635537:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483013248:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.635563:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d05 expref: 80 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.635576:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eaf40, rc 0) 00000100:00100000:0.0:1716999788.635622:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+80:11419:x1800404480711360:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 3320us (3653us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.635629:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10021 00000100:00100000:2.0:1716999788.635989:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.636042:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480711488 00000100:00100000:0.0:1716999788.636048:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480711488 00000100:00100000:0.0:1716999788.636820:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9100 00000100:00100000:0.0:1716999788.636827:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+613:11420:x1800404480711488:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999788.637198:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11477, 168 off2052568 00000001:00080000:0.0:1716999788.637204:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986061 00000100:00100000:0.0:1716999788.637282:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+615:11420:x1800404480711488:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 454us (1293us total) trans 4294986062 rc 0/0 00000100:00100000:0.0:1716999788.637288:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9100 00000020:00080000:0.0:1716999788.637292:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999788.638133:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.638186:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480711552 00000100:00100000:0.0:1716999788.638191:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480711552 00010000:00010000:0.0:1716999788.638209:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6191 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ce2 expref: 80 pid: 17365 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.638227:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4545 00000100:00100000:0.0:1716999788.638231:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+80:1959:x1800404480711552:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999788.638238:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999788.638254:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6191 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ce2 expref: 80 pid: 17365 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.638263:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6191 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ce2 expref: 80 pid: 17365 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.638278:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6191 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ce2 expref: 80 pid: 17365 timeout: 407 lvb_type: 1 00010000:00010000:0.0:1716999788.638288:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.638290:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.638295:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d05 expref: 79 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.638302:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d05 expref: 79 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.638332:0:15839:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d05 expref: 79 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.638342:0:15839:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483013312:192.168.203.3@tcp:105: 00000100:00100000:0.0:1716999788.638382:0:15839:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96900 going to sleep for 11 seconds 00000100:00100000:3.0:1716999788.642305:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.642553:0:15839:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483013312:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999788.642574:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999788.642608:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480711552:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 4375us (4476us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.642617:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4545 00000100:00100000:0.0:1716999788.643295:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480711680 00000100:00100000:0.0:1716999788.643300:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480711680 00000100:00100000:0.0:1716999788.643341:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45615 00000100:00100000:0.0:1716999788.643347:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+615:11420:x1800404480711680:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.643363:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.643377:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc61f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d0c expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.643442:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc61fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.643452:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc61fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc4a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.643460:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc61fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc4a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:0.0:1716999788.643468:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc4a:0x0]: returning size 0 00010000:00010000:0.0:1716999788.643557:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc61f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d0c expref: 618 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.643567:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc61fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc4a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d0c expref: 617 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.643573:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4a:0x0].0x0 (ffff88008a83ff00) 00010000:00010000:0.0:1716999788.643576:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1716999788.643578:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9b00, rc 0) 00000100:00100000:0.0:1716999788.643598:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+617:11420:x1800404480711680:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 252us (1300us total) trans 4294986063 rc 0/0 00000100:00100000:0.0:1716999788.643606:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45615 00000100:00100000:3.0:1716999788.645008:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.646090:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480711744 00000100:00100000:0.0:1716999788.646097:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480711744 00002000:00100000:0.0:1716999788.646133:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x608:0x0] (0->4095) req@ffff880099446a00 x1800404480711744/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:694/0 lens 4584/0 e 0 to 0 dl 1716999799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:0.0:1716999788.646141:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880099446a00 with x1800404480711744 ext(0->4095) 00002000:00010000:0.0:1716999788.646146:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099446a00 00000100:00100000:0.0:1716999788.646761:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1434 00000100:00100000:0.0:1716999788.646767:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+75:1958:x1800404480711744:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:0.0:1716999788.647175:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+77:1958:x1800404480711744:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 406us (2167us total) trans 4294970152 rc 0/0 00000100:00100000:0.0:1716999788.647181:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1434 00002000:00100000:0.0:1716999788.647187:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x608:0x0] (0->4095) req@ffff880099446a00 x1800404480711744/t4294970152(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:694/0 lens 4584/448 e 0 to 0 dl 1716999799 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:0.0:1716999788.647194:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880099446a00 with x1800404480711744 ext(0->4095) 00002000:00010000:0.0:1716999788.647198:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099446a00 00000100:00100000:2.0:1716999788.647901:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.648420:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480711808 00000100:00100000:0.0:1716999788.648425:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480711808 00000100:00100000:0.0:1716999788.648447:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10022 00000100:00100000:0.0:1716999788.648455:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+77:11420:x1800404480711808:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.648465:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.648479:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d13 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.648502:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc61e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cfe expref: 78 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.648508:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.648510:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.648512:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d13 expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.648536:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc61e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cfe expref: 78 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.648546:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc61e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cfe expref: 78 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.648556:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483013376:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.649200:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800936980c0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.651735:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.651796:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.651871:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480711936 00000100:00100000:1.0:1716999788.651904:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480711936 00010000:00010000:1.0:1716999788.651928:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc61e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cfe expref: 79 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999788.651950:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4546 00000100:00100000:1.0:1716999788.651955:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480711936:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999788.651964:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999788.651981:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc61e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cfe expref: 79 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.651990:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc61e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cfe expref: 79 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.652008:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.652010:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.652015:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d13 expref: 79 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.652022:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d13 expref: 79 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.652046:0:15839:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d13 expref: 79 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.652065:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc61e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cfe expref: 79 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:1.0:1716999788.652067:0:15839:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e601c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:15839:1800404483013440:192.168.203.3@tcp:105: 00000100:00100000:0.0:1716999788.652076:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483013376:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.652093:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d13 expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.652102:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8fc0, rc 0) 00000100:00100000:1.0:1716999788.652110:0:15839:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219180 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.652121:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+78:11420:x1800404480711808:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 3670us (4223us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.652128:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10022 00000100:00100000:3.0:1716999788.652134:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480711872 00000100:00100000:3.0:1716999788.652137:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480711872 00000100:00100000:3.0:1716999788.652157:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45616 00000100:00100000:3.0:1716999788.652162:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+617:11419:x1800404480711872:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:0.0:1716999788.654857:0:15839:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e601c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:15839:1800404483013440:192.168.203.3@tcp:105: 00010000:00010000:0.0:1716999788.654873:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999788.654917:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480711936:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2960us (3119us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.654926:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4546 00000100:00100000:0.0:1716999788.656648:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.656664:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712000 00000100:00100000:0.0:1716999788.656669:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712000 00000100:00100000:0.0:1716999788.656697:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45617 00000100:00100000:0.0:1716999788.656701:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+618:11420:x1800404480712000:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.656714:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.656728:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc620f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d1a expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.656768:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc6216 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656779:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc6216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656788:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc6216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656798:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc621d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656803:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc621d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656826:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc621d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656871:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc6216 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656877:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc6216 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656895:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc6216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656901:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eba80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.656904:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc6216 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656909:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc6216 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656918:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.656921:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.656923:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc6216 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656928:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eba80/0x6d188eabd8dc6216 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656937:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc621d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656942:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc621d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656946:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc621d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656950:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.656953:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc621d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656957:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc621d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656962:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x4f529a91 (ffff880094791f00) 00010000:00010000:0.0:1716999788.656964:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.656966:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc621d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.656970:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9680/0x6d188eabd8dc621d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.657000:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc620f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d1a expref: 619 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.657007:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc620f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d1a expref: 619 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.657013:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918eb600, rc 0) 00000100:00100000:0.0:1716999788.657040:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+618:11420:x1800404480712000:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 337us (395us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.657045:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45617 00000100:00100000:1.0:1716999788.659486:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.659559:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712064 00000100:00100000:0.0:1716999788.659565:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712064 00000100:00100000:0.0:1716999788.659593:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45618 00000100:00100000:0.0:1716999788.659599:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+618:11420:x1800404480712064:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.659613:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.659626:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc6224 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d21 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.659649:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc6224 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d21 expref: 619 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.659659:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc6224 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d21 expref: 619 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.659665:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.659667:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.659670:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8900, rc 0) 00000100:00100000:0.0:1716999788.659698:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+619:11420:x1800404480712064:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 99us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.659703:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45618 00000100:00100000:0.0:1716999788.664467:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.664487:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712128 00000100:00100000:0.0:1716999788.664493:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712128 00000100:00100000:0.0:1716999788.664620:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9101 00000100:00100000:0.0:1716999788.664627:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+619:11420:x1800404480712128:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999788.667690:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+619:11420:x1800404480712128:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3055us (3218us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.667701:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9101 00000100:00100000:0.0:1716999788.672128:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.672334:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712192 00000100:00100000:1.0:1716999788.672342:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712192 00000100:00100000:1.0:1716999788.672425:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45619 00000100:00100000:1.0:1716999788.672432:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+619:11420:x1800404480712192:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.672447:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.672461:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc622b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d28 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.672504:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6232 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.672515:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6232 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.672524:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6232 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.672535:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6239 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673083:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6239 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673089:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6239 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673231:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6232 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673345:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6232 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673351:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6232 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673356:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.673359:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6232 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673366:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6232 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673379:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.673382:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.673385:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6232 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673390:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6232 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673400:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6239 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673405:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6239 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673410:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6239 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673413:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.673415:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6239 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673423:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6239 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673428:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x4f529a91 (ffff8800939ba800) 00010000:00010000:1.0:1716999788.673430:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.673431:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6239 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673436:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6239 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.673473:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc622b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d28 expref: 620 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.673480:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc622b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d28 expref: 620 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.673487:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801339fba80, rc 0) 00000100:00100000:1.0:1716999788.673526:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+619:11420:x1800404480712192:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1093us (1402us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.673537:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45619 00000100:00100000:1.0:1716999788.679393:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.679496:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712256 00000100:00100000:0.0:1716999788.679504:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712256 00000100:00100000:0.0:1716999788.679535:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45620 00000100:00100000:0.0:1716999788.679542:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+619:11420:x1800404480712256:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.679573:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.679861:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc6240 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d2f expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.679954:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc6247 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.679966:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc6247 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.679987:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc6247 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680013:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc624e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680019:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc624e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680025:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc624e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680097:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc6247 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680103:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc6247 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680108:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc6247 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680112:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.680116:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc6247 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680162:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc6247 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680172:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.680207:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.680211:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc6247 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680216:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea1c0/0x6d188eabd8dc6247 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680223:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc624e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680227:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc624e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680231:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc624e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680235:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eb600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.680236:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc624e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680240:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc624e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680245:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x5a9c1470 (ffff880094791900) 00010000:00010000:0.0:1716999788.680246:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.680248:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc624e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680251:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb600/0x6d188eabd8dc624e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.680321:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc6240 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d2f expref: 620 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.680329:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9200/0x6d188eabd8dc6240 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d2f expref: 620 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.680408:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e9200, rc 0) 00000100:00100000:0.0:1716999788.680453:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+619:11420:x1800404480712256:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 911us (1064us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.680459:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45620 00000001:00080000:2.0:1716999788.681766:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986063 is committed 00000004:00080000:2.0:1716999788.681806:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 132 committed 00000100:00100000:1.0:1716999788.681951:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483013504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999788.681986:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999788.682002:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1716999788.682006:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483013568:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999788.682016:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999788.682107:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11419:x1800404480711872:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 29942us (30376us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.682114:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45616 00000100:00100000:2.0:1716999788.682206:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483013632:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999788.682227:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999788.682249:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483013504 00000100:00100000:2.0:1716999788.682254:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483013504 00000100:00100000:2.0:1716999788.682270:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483013568 00000100:00100000:2.0:1716999788.682272:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483013568 00000100:00100000:2.0:1716999788.682281:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483013632 00000100:00100000:2.0:1716999788.682283:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483013632 00000100:00100000:2.0:1716999788.682292:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10023 00000100:00100000:2.0:1716999788.682296:0:8342:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3219:x1800404483013504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999788.682311:0:8342:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1535 count 1 00010000:00010000:2.0:1716999788.682326:0:8342:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.682339:0:8342:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f654fb expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.682346:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999788.682347:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999788.682349:0:8342:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.682368:0:8342:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654fb expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.682379:0:8342:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654fb expref: 78 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:2.0:1716999788.682388:0:8342:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483013696:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.682407:0:8342:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012cde9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.682420:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10024 00000100:00100000:2.0:1716999788.682423:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3219:x1800404483013568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999788.682431:0:8341:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1531 count 1 00010000:00010000:2.0:1716999788.682439:0:8341:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.682451:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6521c expref: 78 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.682455:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999788.682456:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999788.682458:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.682470:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6521c expref: 78 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.682476:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6521c expref: 78 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:2.0:1716999788.682483:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8341:1800404483013760:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.682503:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012cde9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.682514:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10025 00000100:00100000:2.0:1716999788.682518:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+7:3217:x1800404483013632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999788.682528:0:19196:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1538 count 1 00010000:00010000:2.0:1716999788.682535:0:19196:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.682544:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c97cc0/0x6d188eabd8dc510d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6577f expref: 78 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.682550:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.682551:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.682553:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.682566:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090c97cc0/0x6d188eabd8dc510d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6577f expref: 78 pid: 17864 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1716999788.682573:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483013952:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999788.682574:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090c97cc0/0x6d188eabd8dc510d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6577f expref: 78 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.682582:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:19196:1800404483014080:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.682593:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999788.682597:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012cde90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.682605:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1716999788.682607:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483014016:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999788.682610:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483013888:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999788.682625:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999788.682639:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1716999788.682640:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483013952 00000100:00100000:0.0:1716999788.682643:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483013952 00000100:00100000:2.0:1716999788.682644:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483013824:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999788.682657:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999788.682662:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483014016 00000100:00100000:0.0:1716999788.682664:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483014016 00000100:00100000:0.0:1716999788.682674:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483013824 00000100:00100000:0.0:1716999788.682676:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483013824 00000100:00100000:2.0:1716999788.683689:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10026 00000100:00100000:2.0:1716999788.683695:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+10:3220:x1800404483013952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999788.683708:0:19200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1539 count 1 00010000:00010000:2.0:1716999788.683717:0:19200:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.683726:0:19200:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65851 expref: 78 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.683731:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999788.683733:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999788.683735:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.683748:0:19200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65851 expref: 78 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.683754:0:19200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65851 expref: 78 pid: 17700 timeout: 407 lvb_type: 0 00000100:00100000:2.0:1716999788.683762:0:19200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483014144:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.683783:0:19200:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012cde9300 going to sleep for 11 seconds 00000100:00100000:3.0:1716999788.683957:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10027 00000100:00100000:3.0:1716999788.683962:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3217:x1800404483014016:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999788.683963:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10028 00000100:00100000:0.0:1716999788.683970:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3217:x1800404483013824:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999788.683972:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1543 count 1 00010000:00010000:3.0:1716999788.683981:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1716999788.683982:0:17864:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1532 count 1 00010000:00010000:3.0:1716999788.683990:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af1 expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.683993:0:17864:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.683994:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999788.683995:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999788.683997:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.684002:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6528c expref: 78 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.684010:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af1 expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.684011:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999788.684013:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999788.684015:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.684017:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af1 expref: 78 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:3.0:1716999788.684025:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099444000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483014208:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.684029:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6528c expref: 78 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.684035:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6528c expref: 78 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:3.0:1716999788.684040:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009c108000 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.684043:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009143df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483014272:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.684062:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093698300 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.684092:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999788.684108:0:17473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483013888 00000100:00100000:0.0:1716999788.684112:0:17473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483013888 00000100:00100000:0.0:1716999788.684128:0:17473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10029 00000100:00100000:0.0:1716999788.684131:0:17473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b87d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3220:x1800404483013888:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1716999788.684140:0:17473:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1536 count 1 00000100:00100000:1.0:1716999788.684143:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999788.684147:0:17473:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.684157:0:17473:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655bf expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.684162:0:17473:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999788.684163:0:17473:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999788.684165:0:17473:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.684179:0:17473:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655bf expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.684185:0:17473:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655bf expref: 78 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:0.0:1716999788.684193:0:17473:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:17473:1800404483014336:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.684213:0:17473:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093698540 going to sleep for 11 seconds 00000100:00100000:3.0:1716999788.684410:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712320 00000100:00100000:3.0:1716999788.684413:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712320 00000100:00100000:3.0:1716999788.684433:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45621 00000100:00100000:3.0:1716999788.684437:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480712320:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.684445:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.684456:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6286 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d36 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.684489:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc628d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684497:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc628d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684504:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc628d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684514:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6294 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684519:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684524:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684572:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc628d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684577:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc628d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684582:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc628d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684587:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.684590:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc628d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684594:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc628d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684603:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999788.684605:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.684607:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc628d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684611:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc628d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684619:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6294 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684623:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6294 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684626:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684630:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.684632:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6294 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684636:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6294 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684641:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x5ae91372 (ffff88009330db00) 00010000:00010000:3.0:1716999788.684643:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.684645:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6294 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684652:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6294 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.684682:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6286 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d36 expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.684689:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6286 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d36 expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.684698:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc000, rc 0) 00000100:00100000:3.0:1716999788.684735:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480712320:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 296us (590us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.684740:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45621 00000100:00100000:2.0:1716999788.684949:0:8342:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483013696:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999788.684962:0:8342:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.684979:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.684980:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:19196:1800404483014080:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999788.684987:0:19196:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.685005:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.685016:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712448 00000100:00100000:0.0:1716999788.685017:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.685019:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712384 00000100:00100000:1.0:1716999788.685020:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712448 00000100:00100000:2.0:1716999788.685022:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712384 00010000:00010000:2.0:1716999788.685034:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654fb expref: 80 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:1.0:1716999788.685034:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090c97cc0/0x6d188eabd8dc510d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6577f expref: 80 pid: 17864 timeout: 407 lvb_type: 1 00000100:00100000:0.0:1716999788.685036:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.685053:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712576 00000100:00100000:2.0:1716999788.685056:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712576 00010000:00010000:2.0:1716999788.685067:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6521c expref: 81 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:1.0:1716999788.685110:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4547 00000100:00100000:2.0:1716999788.685115:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4548 00000100:00100000:1.0:1716999788.685115:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+81:1958:x1800404480712384:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1716999788.685119:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+81:1958:x1800404480712448:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999788.685123:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999788.685126:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999788.685128:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654fb expref: 81 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:2.0:1716999788.685130:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090c97cc0/0x6d188eabd8dc510d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6577f expref: 81 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.685137:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654fb expref: 81 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:2.0:1716999788.685138:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090c97cc0/0x6d188eabd8dc510d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6577f expref: 81 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:2.0:1716999788.685149:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090c97cc0/0x6d188eabd8dc510d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x602:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6577f expref: 81 pid: 17864 timeout: 407 lvb_type: 1 00010000:00010000:1.0:1716999788.685149:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c130480/0x6d188eabd8dc48b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f654fb expref: 81 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:2.0:1716999788.685157:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.685157:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.685158:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999788.685159:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.685161:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.685161:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.685167:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.685167:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.685179:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.685180:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999788.685195:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+79:1958:x1800404480712448:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.685196:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+79:1958:x1800404480712384:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 81us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.685201:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4548 00000100:00100000:1.0:1716999788.685204:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4547 00000100:00100000:2.0:1716999788.685211:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4549 00000100:00100000:2.0:1716999788.685215:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+77:1956:x1800404480712576:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999788.685221:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999788.685224:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6521c expref: 77 pid: 15837 timeout: 407 lvb_type: 0 00010000:00010000:2.0:1716999788.685231:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6521c expref: 77 pid: 15837 timeout: 407 lvb_type: 0 00010000:00010000:2.0:1716999788.685240:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.685241:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.685243:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.685249:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.685257:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999788.685271:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+77:1956:x1800404480712576:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 55us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.685276:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4549 00010000:00010000:3.0:1716999788.685441:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c132880/0x6d188eabd8dc3f7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6521c expref: 76 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:3.0:1716999788.685451:0:8341:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8341:1800404483013760:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999788.685464:0:8341:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.685470:0:8341:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.685475:0:8341:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.685481:0:8341:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.685486:0:8341:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.685492:0:8341:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.685496:0:8341:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999788.685498:0:8341:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.685504:0:8341:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.685512:0:8341:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.685517:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008efb7180/0x6d188eabd8dc625c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.686248:0:19196:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.686255:0:19196:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.686261:0:19196:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.686261:0:8342:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.686269:0:8342:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.686271:0:19196:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.686276:0:19196:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.686276:0:8342:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.686281:0:19196:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb61c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.686282:0:8342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.686283:0:19196:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.686289:0:19196:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.686291:0:8342:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.686295:0:8342:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999788.686296:0:19196:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.686297:0:8342:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.686301:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6263 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x602:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.686302:0:8342:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.686310:0:8342:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.686314:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc6255 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.686460:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+14:3217:x1800404483013632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3939us (4230us total) trans 4294970190 rc 0/0 00000100:00100000:2.0:1716999788.686465:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10025 00000100:00100000:2.0:1716999788.686476:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712512 00000100:00100000:2.0:1716999788.686479:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712512 00000100:00100000:0.0:1716999788.686479:0:8342:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3219:x1800404483013504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4181us (4491us total) trans 4294970191 rc 0/0 00000100:00100000:0.0:1716999788.686484:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10023 00000100:00100000:2.0:1716999788.686494:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10030 00000100:00100000:2.0:1716999788.686498:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480712512:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:1.0:1716999788.686507:0:3219:0:(client.c:2952:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970187 gen 2 00000004:00080000:1.0:1716999788.686511:0:3219:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091106d80, transno 4294970181 00000004:00080000:1.0:1716999788.686517:0:3219:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091106680, transno 4294970182 00000004:00080000:1.0:1716999788.686519:0:3219:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131e73100, transno 4294970183 00000004:00080000:1.0:1716999788.686522:0:3219:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091107100, transno 4294970184 00000004:00080000:1.0:1716999788.686525:0:3219:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131e70700, transno 4294970185 00000004:00080000:1.0:1716999788.686527:0:3219:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091104000, transno 4294970186 00000004:00080000:1.0:1716999788.686529:0:3219:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880091106a00, transno 4294970187 00000100:00100000:1.0:1716999788.686534:0:3219:0:(client.c:2996:ptlrpc_free_committed()) @@@ stopping search req@ffff88009143ca80 x1800404483013504/t4294970191(4294970191) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1716999804 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1716999788.686541:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009143ca80/2, rc 0, transno 2895 00000100:00100000:1.0:1716999788.686544:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483013504:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999788.686560:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3219:x1800404483013568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4134us (4541us total) trans 4294970189 rc 0/0 00000100:00100000:3.0:1716999788.686566:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10024 00000004:00080000:2.0:1716999788.686682:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009143ed80/2, rc 0, transno 2894 00000100:00100000:2.0:1716999788.686686:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483013632:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999788.686690:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009143d180/2, rc 0, transno 2893 00000100:00100000:1.0:1716999788.686694:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483013568:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1716999788.686754:0:10149:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 10 in progress, 4 in flight, 4 done 00000004:00080000:0.0:1716999788.686801:0:10149:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 7 in progress, 4 in flight, 3 done 00000100:00100000:0.0:1716999788.688305:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.688318:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.688337:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.688625:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712640 00000100:00100000:3.0:1716999788.688629:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712640 00000100:00100000:0.0:1716999788.688631:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999788.688646:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af1 expref: 76 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:0.0:1716999788.688655:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.688665:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712832 00000100:00100000:3.0:1716999788.688667:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712832 00010000:00010000:3.0:1716999788.688673:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655bf expref: 77 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:3.0:1716999788.688682:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712768 00000100:00100000:3.0:1716999788.688683:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712768 00010000:00010000:3.0:1716999788.688689:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6528c expref: 78 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:3.0:1716999788.688697:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712704 00000100:00100000:3.0:1716999788.688699:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712704 00010000:00010000:3.0:1716999788.688704:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65851 expref: 79 pid: 17700 timeout: 407 lvb_type: 0 00000100:00100000:3.0:1716999788.688712:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4550 00000100:00100000:3.0:1716999788.688717:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+79:1957:x1800404480712640:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999788.688724:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.688727:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af1 expref: 79 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:3.0:1716999788.688735:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af1 expref: 79 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:3.0:1716999788.688748:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.688750:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.688753:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.688760:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.688772:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999788.688804:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+79:1957:x1800404480712640:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 87us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.688824:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4550 00000100:00100000:3.0:1716999788.688839:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4551 00000100:00100000:3.0:1716999788.688842:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+78:1957:x1800404480712832:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999788.688848:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.688851:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655bf expref: 78 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:3.0:1716999788.688858:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655bf expref: 78 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:3.0:1716999788.688867:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.688868:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.688870:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.688876:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.688901:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999788.688914:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+78:1957:x1800404480712832:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 72us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.688920:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4551 00000100:00100000:3.0:1716999788.688933:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4552 00000100:00100000:3.0:1716999788.688936:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+77:1957:x1800404480712768:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999788.688941:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.688945:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6528c expref: 77 pid: 15837 timeout: 407 lvb_type: 0 00010000:00010000:3.0:1716999788.688951:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6528c expref: 77 pid: 15837 timeout: 407 lvb_type: 0 00010000:00010000:3.0:1716999788.688959:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.688960:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.688963:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.688968:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.688976:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999788.688989:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+77:1957:x1800404480712768:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 51us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.688993:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4552 00000100:00100000:3.0:1716999788.689002:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4553 00000100:00100000:3.0:1716999788.689005:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+76:1958:x1800404480712704:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999788.689012:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.689015:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65851 expref: 76 pid: 17700 timeout: 407 lvb_type: 0 00010000:00010000:0.0:1716999788.689042:0:17473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918e8240/0x6d188eabd8dc4b02 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655bf expref: 76 pid: 17864 timeout: 407 lvb_type: 0 00000100:00100000:0.0:1716999788.689054:0:17473:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:17473:1800404483014336:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.689067:0:17473:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.689074:0:17473:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.689079:0:17473:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.689086:0:17473:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.689092:0:17473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.689097:0:17473:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.689101:0:17473:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918eba80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.689104:0:17473:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.689110:0:17473:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.689119:0:17473:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.689124:0:17473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918eba80/0x6d188eabd8dc627f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.689804:0:19200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483014144:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999788.689829:0:19200:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.690112:0:17473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b87d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3220:x1800404483013888:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5979us (6018us total) trans 4294970192 rc 0/0 00000100:00100000:0.0:1716999788.690120:0:17473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10029 00000004:00080000:0.0:1716999788.690150:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009143d500/2, rc 0, transno 2896 00010000:00010000:3.0:1716999788.690155:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65851 expref: 75 pid: 17700 timeout: 407 lvb_type: 0 00000100:00100000:0.0:1716999788.690158:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483013888:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999788.690165:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918ead00/0x6d188eabd8dc5408 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65851 expref: 75 pid: 17700 timeout: 407 lvb_type: 0 00000100:00100000:0.0:1716999788.690172:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480712960 00010000:00010000:3.0:1716999788.690173:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.690174:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.690176:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.690177:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480712960 00010000:00010000:3.0:1716999788.690182:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690195:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999788.690197:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45622 00000100:00100000:0.0:1716999788.690201:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480712960:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.690212:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1716999788.690216:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+74:1958:x1800404480712704:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1209us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.690221:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4553 00010000:00010000:0.0:1716999788.690224:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc629b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d3d expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690286:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801339f8240/0x6d188eabd8dc5be8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65af1 expref: 73 pid: 17864 timeout: 407 lvb_type: 0 00010000:00010000:0.0:1716999788.690288:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc62a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999788.690293:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099444000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483014208:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.690296:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc62a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690302:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc62a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.690303:0:17365:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690309:0:17365:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690314:0:17365:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.690316:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc62a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.690320:0:17365:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.690320:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc62a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.690325:0:17365:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.690325:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc62a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.690330:0:17365:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690335:0:17365:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdfcc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999788.690337:0:17365:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690343:0:17365:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690349:0:17365:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.690353:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc62a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.690354:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6271 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.690357:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc62a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690361:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc62a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690365:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918ea880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.690367:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc62a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690371:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc62a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690377:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.690379:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.690381:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc62a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690384:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea880/0x6d188eabd8dc62a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690390:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc62a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690395:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc62a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690399:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc62a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690402:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.690404:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc62a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690408:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc62a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690412:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x5ae91372 (ffff880094791100) 00010000:00010000:0.0:1716999788.690414:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.690415:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc62a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690418:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc62a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.690436:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc629b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d3d expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.690442:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8b40/0x6d188eabd8dc629b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d3d expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.690447:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918e8b40, rc 0) 00000100:00100000:0.0:1716999788.690462:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480712960:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 260us (1807us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.690470:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45622 00010000:00010000:0.0:1716999788.690495:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc40ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6528c expref: 72 pid: 15837 timeout: 407 lvb_type: 0 00000100:00100000:0.0:1716999788.690505:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483014272:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.690515:0:17864:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.690518:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3217:x1800404483014016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6555us (7891us total) trans 4294970193 rc 0/0 00010000:00010000:0.0:1716999788.690522:0:17864:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.690525:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10027 00010000:00010000:0.0:1716999788.690527:0:17864:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.690533:0:17864:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.690538:0:17864:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.690543:0:17864:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999788.690548:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009143ea00/2, rc 0, transno 2897 00010000:00010000:0.0:1716999788.690548:0:17864:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918e9680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.690550:0:17864:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.690552:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483014016:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1716999788.690560:0:17864:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.690567:0:17864:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.690573:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918e9680/0x6d188eabd8dc6278 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690616:0:19200:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690623:0:19200:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690629:0:19200:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690634:0:19200:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690640:0:19200:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690644:0:19200:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb4000 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999788.690647:0:19200:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690652:0:19200:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690660:0:19200:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.690665:0:19200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008efb4000/0x6d188eabd8dc626a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999788.690708:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+12:3217:x1800404483013824:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6738us (8048us total) trans 4294970194 rc 0/0 00000100:00100000:0.0:1716999788.690713:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10028 00000100:00100000:3.0:1716999788.690805:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+12:3220:x1800404483013952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7110us (8211us total) trans 4294970195 rc 0/0 00000100:00100000:3.0:1716999788.690823:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10026 00000004:00080000:3.0:1716999788.690936:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009143fb80/2, rc 0, transno 2899 00000100:00100000:3.0:1716999788.690941:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483013952:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1716999788.690954:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009143e680/2, rc 0, transno 2898 00000100:00100000:3.0:1716999788.690956:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009143e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483013824:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999788.694620:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.694925:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480713024 00000100:00100000:0.0:1716999788.694933:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480713024 00000100:00100000:0.0:1716999788.694969:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45623 00000100:00100000:0.0:1716999788.694976:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480713024:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.694991:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.695005:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc62b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d44 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.695049:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc62b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695059:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc62b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695067:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc62b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695077:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc62be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695082:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc62be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695087:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc62be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695264:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc62b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695269:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc62b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695273:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc62b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695278:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.695281:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc62b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695286:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc62b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695295:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.695297:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.695300:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc62b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695305:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc62b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695316:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc62be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695536:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc62be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695542:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc62be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695546:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.695548:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc62be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695553:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc62be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695560:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x5a9c1470 (ffff880094791f00) 00010000:00010000:0.0:1716999788.695562:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.695564:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc62be lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695568:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc62be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.695610:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc62b0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d44 expref: 578 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.695752:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc62b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d44 expref: 578 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.695759:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c53cc0, rc 0) 00000100:00100000:0.0:1716999788.695800:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480713024:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 824us (1185us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.695806:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45623 00000100:00100000:3.0:1716999788.699245:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.699289:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480713152 00000100:00100000:0.0:1716999788.699296:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480713152 00000100:00100000:0.0:1716999788.699330:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45624 00000100:00100000:0.0:1716999788.699336:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480713152:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.699349:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.699362:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc62c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d4b expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.699432:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc62cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699441:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc62cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699449:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc62cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699459:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc62d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699463:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc62d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699468:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc62d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699496:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc62cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699504:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc62cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699509:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc62cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699513:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.699515:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc62cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699520:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc62cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699528:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.699530:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.699533:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc62cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699537:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc62cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699544:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc62d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699547:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc62d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699551:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc62d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699555:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.699557:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc62d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699564:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc62d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699569:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x5a9c1470 (ffff880094791d00) 00010000:00010000:0.0:1716999788.699570:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.699572:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc62d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699575:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc62d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.699592:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc62c5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d4b expref: 578 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.699598:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc62c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d4b expref: 578 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.699603:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50fc0, rc 0) 00000100:00100000:0.0:1716999788.699633:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480713152:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 297us (392us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.699638:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45624 00000100:00100000:0.0:1716999788.702714:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.702855:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480713216 00000100:00100000:1.0:1716999788.702862:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480713216 00000100:00100000:1.0:1716999788.702900:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45625 00000100:00100000:1.0:1716999788.702906:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480713216:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.702920:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.702938:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc62da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d52 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.702977:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc62e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.702991:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc62e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.702999:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc62e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703008:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc62e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703013:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc62e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703018:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc62e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703069:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc62e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703074:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc62e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703079:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc62e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703084:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.703087:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc62e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703092:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc62e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703101:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.703103:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.703375:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc62e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703381:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc62e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703389:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc62e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703392:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc62e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703396:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc62e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703400:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fa80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.703401:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc62e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703405:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc62e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703414:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x5ae91372 (ffff880092624000) 00010000:00010000:1.0:1716999788.703416:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.703418:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc62e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703421:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc62e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.703449:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc62da lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d52 expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.703455:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc62da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d52 expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.703461:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f840, rc 0) 00000100:00100000:1.0:1716999788.703503:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480713216:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 596us (794us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.703508:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45625 00000100:00100000:1.0:1716999788.707919:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.707986:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480713344 00000100:00100000:0.0:1716999788.707993:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480713344 00000100:00100000:0.0:1716999788.708026:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45626 00000100:00100000:0.0:1716999788.708033:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480713344:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.708048:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.708064:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc62ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d59 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.708144:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc62f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708155:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc62f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708163:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc62f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708174:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc62fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708180:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc62fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708184:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc62fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708218:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc62f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708223:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc62f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708227:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc62f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708232:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131f8ed00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.708235:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc62f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708240:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc62f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708251:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.708254:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.708257:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc62f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708261:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc62f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708268:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc62fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708272:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc62fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708276:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc62fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708280:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.708282:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc62fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708286:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc62fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708290:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x5ae91372 (ffff880094791e00) 00010000:00010000:0.0:1716999788.708292:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.708294:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc62fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708298:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc62fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5ae91372 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.708320:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc62ef lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d59 expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.708327:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc62ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d59 expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.708333:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f8ef40, rc 0) 00000100:00100000:0.0:1716999788.708370:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480713344:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 337us (457us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.708375:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45626 00000100:00100000:3.0:1716999788.710957:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.711211:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480713408 00000100:00100000:2.0:1716999788.711219:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480713408 00000100:00100000:2.0:1716999788.711256:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45627 00000100:00100000:2.0:1716999788.711263:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480713408:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.711277:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.711297:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc6304 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d60 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.711342:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc630b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711352:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc630b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711361:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc630b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711370:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6312 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711375:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711379:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711862:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc630b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711869:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc630b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711874:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc630b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711906:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.711910:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc630b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711916:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc630b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711926:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999788.711929:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.711932:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc630b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711936:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc630b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711947:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6312 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711951:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6312 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711956:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711962:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb4240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.711964:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6312 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711968:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6312 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711972:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x5a9c1470 (ffff880134241a00) 00010000:00010000:2.0:1716999788.711974:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.711976:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6312 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.711979:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6312 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.712012:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc6304 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d60 expref: 578 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.712018:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc6304 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d60 expref: 578 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.712024:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb6400, rc 0) 00000100:00100000:2.0:1716999788.712069:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480713408:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 806us (1116us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999788.712074:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45627 00000100:00100000:0.0:1716999788.716311:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.716375:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480713536 00000100:00100000:0.0:1716999788.716382:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480713536 00000100:00100000:0.0:1716999788.716412:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45628 00000100:00100000:0.0:1716999788.716418:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480713536:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.716432:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.716435:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1716999788.716453:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8900/0x6d188eabd8dc6224 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d21 expref: 577 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.716465:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.716468:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999788.716477:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6319 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d67 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.716575:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6320 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.716586:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6320 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.716595:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6320 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.716605:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6327 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.716610:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.716615:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:0.0:1716999788.719503:0:11055:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60a:0x0], index 1: 0 00000040:00080000:0.0:1716999788.719738:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11478, 184 off2052752 00010000:00010000:0.0:1716999788.719908:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc632e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.719919:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc632e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.719927:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc632e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.720468:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6320 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.720474:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6320 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.720479:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6320 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.720483:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.720486:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6320 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.720491:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6320 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.720499:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999788.720501:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.720504:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6320 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.720508:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6320 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:0.0:1716999788.720517:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131e71f80 reply state ffff88013201e000 transno 4294986064 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999788.720522:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999788.720545:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6319 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d67 expref: 579 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.720554:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc632e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d67 expref: 578 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.720559:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4b:0x0].0x0 (ffff880092624d00) 00010000:00010000:0.0:1716999788.720561:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999788.720563:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132640, rc 0) 00000100:00100000:0.0:1716999788.720637:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480713536:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 4216us (4330us total) trans 4294986064 rc 0/0 00000100:00100000:0.0:1716999788.720644:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45628 00000100:00100000:1.0:1716999788.724235:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999788.724644:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6327 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.724654:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6327 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999788.724664:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480713600 00010000:00010000:2.0:1716999788.724664:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6327 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.724669:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131200 already unused, calling callback (ffffffffa1389790) 00000100:00100000:3.0:1716999788.724671:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480713600 00010000:00010000:2.0:1716999788.724672:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6327 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.724678:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6327 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.724691:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x5a9c1470 (ffff880092624000) 00010000:00010000:2.0:1716999788.724694:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.724697:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6327 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999788.724699:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10031 00010000:00010000:2.0:1716999788.724701:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6327 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999788.724705:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:107d663a-2216-406b-94c6-b2fcb1558728+72:1959:x1800404480713600:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.724717:0:19200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.724729:0:19200:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc633c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d6e expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999788.724942:0:19200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x60a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999788.724958:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.724959:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.724965:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc633c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d6e expref: 73 pid: 19200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.724982:0:19200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc633c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d6e expref: 73 pid: 19200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.724990:0:19200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdfcc0, rc 0) 00000100:00100000:3.0:1716999788.725222:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480713600:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 515us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.725228:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10031 00000100:00100000:0.0:1716999788.730521:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.730547:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480713728 00000100:00100000:0.0:1716999788.730554:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480713728 00000100:00100000:0.0:1716999788.730582:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9102 00000100:00100000:0.0:1716999788.730588:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+578:11420:x1800404480713728:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999788.731082:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11479, 168 off2052920 00000001:00080000:0.0:1716999788.731087:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986065 00000100:00100000:0.0:1716999788.731160:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+580:11420:x1800404480713728:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 571us (645us total) trans 4294986066 rc 0/0 00000100:00100000:0.0:1716999788.731167:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9102 00000020:00080000:0.0:1716999788.731171:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999788.735675:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.736038:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480713856 00000100:00100000:0.0:1716999788.736046:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480713856 00000100:00100000:0.0:1716999788.736325:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45629 00000100:00100000:0.0:1716999788.736332:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+580:11420:x1800404480713856:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.736349:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.736363:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6343 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d75 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.736429:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc634a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.736441:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc634a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc4b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999788.736449:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc634a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc4b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:0.0:1716999788.736458:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc4b:0x0]: returning size 0 00010000:00010000:0.0:1716999788.736540:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6343 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d75 expref: 583 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.736556:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc634a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc4b:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d75 expref: 582 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.736563:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4b:0x0].0x0 (ffff880092624d00) 00010000:00010000:0.0:1716999788.736565:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1716999788.736568:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133600, rc 0) 00000100:00100000:0.0:1716999788.736603:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+582:11420:x1800404480713856:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 272us (936us total) trans 4294986067 rc 0/0 00000100:00100000:0.0:1716999788.736609:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45629 00000100:00100000:1.0:1716999788.740826:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.740871:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480713920 00000100:00100000:2.0:1716999788.740894:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480713920 00000100:00100000:2.0:1716999788.740925:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10032 00000100:00100000:2.0:1716999788.740942:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:107d663a-2216-406b-94c6-b2fcb1558728+73:11420:x1800404480713920:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.740955:0:19200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.740968:0:19200:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d7c expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.740989:0:19200:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc633c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d6e expref: 74 pid: 19200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.740996:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.740998:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.741001:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d7c expref: 74 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.741025:0:19200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc633c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d6e expref: 74 pid: 19200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.741035:0:19200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc633c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d6e expref: 74 pid: 19200 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.741046:0:19200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483014400:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999788.742001:0:19200:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099f1ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1716999788.744545:0:19200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483014400:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999788.744545:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999788.744571:0:19200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d7c expref: 74 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.744586:0:19200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb6640, rc 0) 00000100:00100000:3.0:1716999788.744599:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480713984 00000100:00100000:3.0:1716999788.744604:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480713984 00000100:00100000:2.0:1716999788.744620:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:107d663a-2216-406b-94c6-b2fcb1558728+75:11420:x1800404480713920:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 3688us (3812us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999788.744623:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc633c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d6e expref: 75 pid: 19200 timeout: 407 lvb_type: 1 00000100:00100000:2.0:1716999788.744628:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10032 00000100:00100000:3.0:1716999788.744642:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4554 00000100:00100000:3.0:1716999788.744647:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480713984:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999788.744655:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.744669:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc633c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d6e expref: 74 pid: 19200 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.744678:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc633c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d6e expref: 74 pid: 19200 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.744692:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc633c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d6e expref: 74 pid: 19200 timeout: 407 lvb_type: 1 00010000:00010000:3.0:1716999788.744707:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.744709:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.744713:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d7c expref: 73 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.744720:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d7c expref: 73 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.744738:0:6807:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d7c expref: 73 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.744747:0:6807:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099446d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6807:1800404483014464:192.168.203.3@tcp:105: 00000100:00100000:3.0:1716999788.744769:0:6807:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009c108240 going to sleep for 11 seconds 00000100:00100000:3.0:1716999788.746367:0:6807:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099446d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6807:1800404483014464:192.168.203.3@tcp:105: 00010000:00010000:3.0:1716999788.746380:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999788.746400:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+73:1959:x1800404480713984:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1753us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.746406:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4554 00000100:00100000:2.0:1716999788.748030:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480712512:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 61526us (63007us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.748038:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10030 00000001:00080000:1.0:1716999788.748089:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970152 is committed 00000001:00080000:1.0:1716999788.748098:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970151 is committed 00000100:00100000:0.0:1716999788.749867:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.750216:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.750278:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714048 00000100:00100000:1.0:1716999788.750285:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714048 00002000:00100000:1.0:1716999788.750316:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x609:0x0] (0->4095) req@ffff880131e70700 x1800404480714048/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:694/0 lens 4584/0 e 0 to 0 dl 1716999799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:1.0:1716999788.750324:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e70700 with x1800404480714048 ext(0->4095) 00002000:00010000:1.0:1716999788.750329:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e70700 00000100:00100000:1.0:1716999788.750341:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714112 00000100:00100000:1.0:1716999788.750343:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714112 00002000:00100000:1.0:1716999788.750353:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x609:0x0] (0->4095) req@ffff880131e73100 x1800404480714112/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:694/0 lens 4584/0 e 0 to 0 dl 1716999799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:1.0:1716999788.750358:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e73100 with x1800404480714112 ext(0->4095) 00002000:00010000:1.0:1716999788.750361:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e73100 00000100:00100000:1.0:1716999788.750370:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1435 00000100:00100000:3.0:1716999788.750644:0:8347:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1436 00000100:00100000:3.0:1716999788.750650:0:8347:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+75:1958:x1800404480714112:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:3.0:1716999788.751379:0:8347:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:107d663a-2216-406b-94c6-b2fcb1558728+77:1958:x1800404480714112:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 727us (1161us total) trans 4294970153 rc 0/0 00000100:00100000:3.0:1716999788.751386:0:8347:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1436 00002000:00100000:3.0:1716999788.751392:0:8347:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x609:0x0] (0->4095) req@ffff880131e73100 x1800404480714112/t4294970153(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:694/0 lens 4584/448 e 0 to 0 dl 1716999799 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999788.751399:0:8347:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e73100 with x1800404480714112 ext(0->4095) 00002000:00010000:3.0:1716999788.751402:0:8347:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131e73100 00000100:00100000:1.0:1716999788.751465:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+73:1956:x1800404480714048:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:1.0:1716999788.751693:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+75:1956:x1800404480714048:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 1316us (1829us total) trans 4294970196 rc 0/0 00000100:00100000:1.0:1716999788.751698:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1435 00002000:00100000:1.0:1716999788.751703:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x609:0x0] (0->4095) req@ffff880131e70700 x1800404480714048/t4294970196(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:694/0 lens 4584/448 e 0 to 0 dl 1716999799 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:1.0:1716999788.751710:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e70700 with x1800404480714048 ext(0->4095) 00002000:00010000:1.0:1716999788.751713:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e70700 00000100:00100000:1.0:1716999788.753376:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.753518:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714176 00000100:00100000:2.0:1716999788.753525:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714176 00000100:00100000:2.0:1716999788.753566:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45630 00000100:00100000:2.0:1716999788.753572:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+582:11420:x1800404480714176:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:2.0:1716999788.753654:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+582:11420:x1800404480714176:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 81us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.753660:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45630 00000100:00100000:2.0:1716999788.754696:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.754722:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.754772:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714240 00000100:00100000:0.0:1716999788.754777:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714240 00000100:00100000:0.0:1716999788.754825:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10033 00000100:00100000:0.0:1716999788.754831:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480714240:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:1.0:1716999788.755028:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714304 00000100:00100000:1.0:1716999788.755031:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714304 00000100:00100000:1.0:1716999788.755059:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45631 00000100:00100000:1.0:1716999788.755063:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+582:11419:x1800404480714304:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:1.0:1716999788.755107:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+582:11419:x1800404480714304:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 44us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.755112:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45631 00000100:00100000:1.0:1716999788.759739:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.760627:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714368 00000100:00100000:3.0:1716999788.760635:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714368 00000100:00100000:3.0:1716999788.760669:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10034 00000100:00100000:3.0:1716999788.760676:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:107d663a-2216-406b-94c6-b2fcb1558728+75:1956:x1800404480714368:12345-192.168.203.3@tcp:16:dbench.0 00000001:00080000:1.0:1716999788.830327:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970153 is committed 00000100:00100000:0.0:1716999788.830451:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+75:1959:x1800404480714240:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 75616us (75753us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.830460:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10033 00000100:00100000:3.0:1716999788.832660:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:107d663a-2216-406b-94c6-b2fcb1558728+75:1956:x1800404480714368:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 71978us (72922us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.832669:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10034 00000001:00080000:3.0:1716999788.832695:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970194 is committed 00000001:00080000:3.0:1716999788.832706:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970196 is committed 00000001:00080000:3.0:1716999788.832715:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970195 is committed 00000100:00100000:0.0:1716999788.834647:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.834772:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714432 00000100:00100000:1.0:1716999788.834780:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714432 00002000:00100000:1.0:1716999788.834816:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x60a:0x0] (0->4095) req@ffff880131e72680 x1800404480714432/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:694/0 lens 4584/0 e 0 to 0 dl 1716999799 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:1.0:1716999788.834825:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e72680 with x1800404480714432 ext(0->4095) 00002000:00010000:1.0:1716999788.834829:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e72680 00000100:00100000:1.0:1716999788.834843:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1437 00000100:00100000:1.0:1716999788.834849:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+73:1957:x1800404480714432:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:1.0:1716999788.835220:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+75:1957:x1800404480714432:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 369us (577us total) trans 4294970197 rc 0/0 00000100:00100000:1.0:1716999788.835227:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1437 00002000:00100000:1.0:1716999788.835232:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x60a:0x0] (0->4095) req@ffff880131e72680 x1800404480714432/t4294970197(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:694/0 lens 4584/448 e 0 to 0 dl 1716999799 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:1.0:1716999788.835238:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880131e72680 with x1800404480714432 ext(0->4095) 00002000:00010000:1.0:1716999788.835241:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131e72680 00000100:00100000:0.0:1716999788.838682:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.839062:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714496 00000100:00100000:3.0:1716999788.839070:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714496 00000100:00100000:3.0:1716999788.839193:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45632 00000100:00100000:3.0:1716999788.839201:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+582:11419:x1800404480714496:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.839214:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.839231:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc635f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d83 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.839276:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6366 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839287:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6366 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839296:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6366 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839308:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc636d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839316:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc636d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999788.839319:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999788.839321:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc636d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839395:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6366 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839401:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6366 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839406:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6366 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839410:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.839413:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6366 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839418:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6366 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839427:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.839430:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.839433:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6366 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839436:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6366 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839445:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc636d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839449:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc636d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839453:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc636d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839456:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.839458:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc636d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839462:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc636d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839467:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xa992fa2d (ffff880135ac4200) 00010000:00010000:3.0:1716999788.839469:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.839471:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc636d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839475:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc636d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999788.839508:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc635f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d83 expref: 583 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.839515:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc635f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d83 expref: 583 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.839526:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc000, rc 0) 00000100:00100000:1.0:1716999788.839814:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714560 00000100:00100000:1.0:1716999788.839818:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714560 00000100:00100000:1.0:1716999788.839841:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45633 00000100:00100000:1.0:1716999788.839846:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+583:11420:x1800404480714560:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:3.0:1716999788.840242:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+583:11419:x1800404480714496:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1041us (1566us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.840248:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45632 00000100:00100000:1.0:1716999788.842088:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.842106:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714624 00000100:00100000:1.0:1716999788.842111:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714624 00000100:00100000:1.0:1716999788.842132:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45634 00000100:00100000:1.0:1716999788.842136:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+583:11419:x1800404480714624:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.842148:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.842160:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6374 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d8a expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.842180:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d8a expref: 584 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.842189:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6374 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d8a expref: 584 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.842198:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.842200:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.842202:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c240, rc 0) 00000100:00100000:1.0:1716999788.842230:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+584:11419:x1800404480714624:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 93us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.842235:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45634 00000100:00100000:1.0:1716999788.846680:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.846815:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714688 00000100:00100000:0.0:1716999788.846822:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714688 00000100:00100000:0.0:1716999788.846853:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9103 00000100:00100000:0.0:1716999788.846860:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+584:11419:x1800404480714688:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999788.852657:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+584:11419:x1800404480714688:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5791us (5975us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.852669:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9103 00000100:00100000:0.0:1716999788.859745:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.860822:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714816 00000100:00100000:1.0:1716999788.860831:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714816 00000100:00100000:1.0:1716999788.860893:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45635 00000100:00100000:1.0:1716999788.860901:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+584:11419:x1800404480714816:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.860916:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.860918:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999788.860941:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6374 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d8a expref: 584 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.860954:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.860958:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.860967:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc637b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d91 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.861424:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6382 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.861436:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6382 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.861443:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6382 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.861454:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6389 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.861459:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6389 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.861463:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6389 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:1.0:1716999788.862850:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60a:0x0], index 0: 0 00000040:00080000:1.0:1716999788.863038:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11480, 176 off2053096 00010000:00010000:1.0:1716999788.863150:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6390 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.863161:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.863169:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6390 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.863194:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6382 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.863199:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6382 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.863203:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6382 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.863207:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216eac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.863210:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6382 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.863218:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6382 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.863227:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.863229:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.863232:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6382 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.863236:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6382 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999788.863245:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800a5c11f80 reply state ffff880091992000 transno 4294986068 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6389 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999788.863250:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999788.863273:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc637b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d91 expref: 586 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.863281:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6390 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d91 expref: 585 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.863285:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4c:0x0].0x0 (ffff8800a585e100) 00010000:00010000:1.0:1716999788.863287:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999788.863289:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f3c0, rc 0) 00000100:00100000:1.0:1716999788.863350:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+586:11419:x1800404480714816:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2450us (3609us total) trans 4294986068 rc 0/0 00000100:00100000:1.0:1716999788.863356:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45635 00010000:00010000:1.0:1716999788.865478:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6389 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.865491:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6389 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.865497:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6389 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999788.865501:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999788.865502:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.865505:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6389 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.865510:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6389 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.865520:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xa992fa2d (ffff8800a585ed00) 00010000:00010000:1.0:1716999788.865522:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.865525:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6389 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999788.865529:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6389 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999788.865640:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480714880 00000100:00100000:2.0:1716999788.865647:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480714880 00000100:00100000:2.0:1716999788.865673:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10035 00000100:00100000:2.0:1716999788.865678:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:107d663a-2216-406b-94c6-b2fcb1558728+75:1956:x1800404480714880:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.865689:0:19200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.865701:0:19200:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc639e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d98 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999788.865719:0:19200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x60a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999788.865731:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.865732:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.865737:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc639e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d98 expref: 76 pid: 19200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.865748:0:19200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc639e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d98 expref: 76 pid: 19200 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999788.865756:0:19200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb6d00, rc 0) 00000100:00100000:2.0:1716999788.865788:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:107d663a-2216-406b-94c6-b2fcb1558728+76:1956:x1800404480714880:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 111us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.865794:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10035 00000100:00100000:2.0:1716999788.867232:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.867280:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480715008 00000100:00100000:0.0:1716999788.867285:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480715008 00000100:00100000:0.0:1716999788.867305:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9104 00000100:00100000:0.0:1716999788.867310:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+585:11419:x1800404480715008:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999788.867575:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11481, 168 off2053264 00000001:00080000:0.0:1716999788.867580:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986069 00000100:00100000:0.0:1716999788.867631:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+587:11419:x1800404480715008:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 320us (400us total) trans 4294986070 rc 0/0 00000100:00100000:0.0:1716999788.867636:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9104 00000020:00080000:0.0:1716999788.867639:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999788.870853:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.871486:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480715136 00000100:00100000:0.0:1716999788.871493:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480715136 00000100:00100000:0.0:1716999788.871536:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45636 00000100:00100000:0.0:1716999788.871543:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+587:11419:x1800404480715136:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.871558:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.871573:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc63a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65d9f expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.871638:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc63ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.871648:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc63ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc4c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999788.871656:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc63ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc4c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:0.0:1716999788.871663:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc4c:0x0]: returning size 0 00010000:00010000:0.0:1716999788.871739:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc63a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d9f expref: 590 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.871751:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc63ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc4c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d9f expref: 589 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.871758:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4c:0x0].0x0 (ffff8800a585e100) 00010000:00010000:0.0:1716999788.871762:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1716999788.871764:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131d40, rc 0) 00000100:00100000:0.0:1716999788.871798:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+589:11419:x1800404480715136:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 256us (950us total) trans 4294986071 rc 0/0 00000100:00100000:0.0:1716999788.871804:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45636 00000100:00100000:0.0:1716999788.875310:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.875331:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480715200 00000100:00100000:0.0:1716999788.875337:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480715200 00000100:00100000:0.0:1716999788.875362:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10036 00000100:00100000:0.0:1716999788.875368:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+76:11419:x1800404480715200:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.875381:0:19196:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.875393:0:19196:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65da6 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.875413:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc639e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d98 expref: 77 pid: 19200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.875424:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.875425:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.875428:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 4/0,0 mode: --/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65da6 expref: 77 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.875450:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc639e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d98 expref: 77 pid: 19200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.875458:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc639e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d98 expref: 77 pid: 19200 timeout: 408 lvb_type: 1 00000100:00100000:0.0:1716999788.875469:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483014528:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999788.875508:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136379840 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.877076:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.878039:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483014528:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.878065:0:19196:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65da6 expref: 77 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.878080:0:19196:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131440, rc 0) 00000100:00100000:0.0:1716999788.878117:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+77:11419:x1800404480715200:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2748us (2812us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.878124:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10036 00000100:00100000:3.0:1716999788.878245:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480715264 00000100:00100000:3.0:1716999788.878250:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480715264 00010000:00010000:3.0:1716999788.878268:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc639e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d98 expref: 77 pid: 19200 timeout: 408 lvb_type: 1 00000100:00100000:3.0:1716999788.878284:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4555 00000100:00100000:3.0:1716999788.878288:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+77:1958:x1800404480715264:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999788.878296:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999788.878312:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc639e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d98 expref: 77 pid: 19200 timeout: 408 lvb_type: 1 00010000:00010000:3.0:1716999788.878321:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc639e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d98 expref: 77 pid: 19200 timeout: 408 lvb_type: 1 00010000:00010000:3.0:1716999788.878338:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc639e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d98 expref: 77 pid: 19200 timeout: 408 lvb_type: 1 00010000:00010000:3.0:1716999788.878347:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.878348:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.878353:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65da6 expref: 76 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.878360:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65da6 expref: 76 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.878381:0:6807:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65da6 expref: 76 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.878391:0:6807:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099446d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6807:1800404483014592:192.168.203.3@tcp:105: 00000100:00100000:3.0:1716999788.879147:0:6807:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093549d80 going to sleep for 11 seconds 00000100:00100000:3.0:1716999788.882025:0:6807:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099446d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6807:1800404483014592:192.168.203.3@tcp:105: 00010000:00010000:3.0:1716999788.882042:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999788.882075:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+76:1958:x1800404480715264:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3785us (5001us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.882084:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4555 00000100:00100000:1.0:1716999788.882868:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.883248:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480715328 00000100:00100000:0.0:1716999788.883254:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480715328 00000100:00100000:0.0:1716999788.883282:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45637 00000100:00100000:0.0:1716999788.883288:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+589:11419:x1800404480715328:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.883304:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.883319:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc63c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65dad expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.883360:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc63c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883371:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc63c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883379:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc63c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883390:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc63cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883395:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc63cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883399:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc63cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883449:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc63c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883455:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc63c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883460:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc63c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883464:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.883468:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc63c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883474:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc63c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883482:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.883484:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.883487:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc63c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883491:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc63c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883500:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc63cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883504:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc63cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883509:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc63cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883512:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.883514:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc63cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883518:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc63cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883523:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xa992fa36 (ffff880094791d00) 00010000:00010000:0.0:1716999788.883525:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.883527:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc63cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883531:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc63cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.883563:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc63c1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dad expref: 590 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.883570:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc63c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dad expref: 590 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.883576:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131f80, rc 0) 00000100:00100000:0.0:1716999788.883602:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+589:11419:x1800404480715328:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 314us (735us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.883607:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45637 00000100:00100000:2.0:1716999788.885161:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.885387:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480715392 00000100:00100000:1.0:1716999788.885393:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480715392 00000100:00100000:1.0:1716999788.885417:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45638 00000100:00100000:1.0:1716999788.885422:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+589:11419:x1800404480715392:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.885434:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.885447:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc63d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65db4 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.885472:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc63d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65db4 expref: 590 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.885482:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc63d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65db4 expref: 590 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.885488:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.885490:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.885493:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216fcc0, rc 0) 00000100:00100000:1.0:1716999788.885518:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+590:11419:x1800404480715392:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 96us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.885523:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45638 00000001:00080000:2.0:1716999788.886040:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986067 is committed 00000100:00100000:3.0:1716999788.886256:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+585:11420:x1800404480714560:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 46408us (46935us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.886263:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45633 00000100:00100000:0.0:1716999788.887374:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.887415:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.887471:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480715456 00000100:00100000:2.0:1716999788.887476:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480715456 00000100:00100000:2.0:1716999788.887500:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9105 00000100:00100000:2.0:1716999788.887505:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec21450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+585:11419:x1800404480715456:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999788.888779:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480715520 00000100:00100000:1.0:1716999788.888783:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480715520 00000100:00100000:1.0:1716999788.888825:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10037 00000100:00100000:1.0:1716999788.888830:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+75:1958:x1800404480715520:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:2.0:1716999788.891368:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec21450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+585:11419:x1800404480715456:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3855us (3988us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.891378:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9105 00000100:00100000:3.0:1716999788.896212:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.896493:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480715648 00000100:00100000:2.0:1716999788.896500:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480715648 00000100:00100000:3.0:1716999788.897675:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45639 00000100:00100000:3.0:1716999788.897683:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+585:11419:x1800404480715648:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.897701:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.897704:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1716999788.897723:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc63d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65db4 expref: 585 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.897740:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.897744:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999788.897753:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc63dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65dbb expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.897867:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc63e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.897878:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc63e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.897907:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc63e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.897918:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc63eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.897923:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc63eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.897928:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc63eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:3.0:1716999788.899616:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60b:0x0], index 1: 0 00000040:00080000:3.0:1716999788.899673:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11482, 176 off2053440 00010000:00010000:3.0:1716999788.899767:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc63f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.899776:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc63f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.899784:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc63f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.900158:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc63e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.900164:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc63e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.900169:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc63e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.900174:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bded00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.900177:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc63e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.900183:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc63e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.900192:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.900194:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.900197:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc63e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999788.900201:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc63e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999788.900209:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099446d80 reply state ffff880135ae0000 transno 4294986072 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc63eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999788.900215:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999788.900239:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc900/0x6d188eabd8dc63dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dbb expref: 587 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.900252:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc63f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dbb expref: 586 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.900257:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4d:0x0].0x0 (ffff880135ac4200) 00010000:00010000:3.0:1716999788.900258:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999788.900260:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcd80, rc 0) 00000100:00100000:3.0:1716999788.900316:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+587:11419:x1800404480715648:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2633us (4110us total) trans 4294986072 rc 0/0 00000100:00100000:3.0:1716999788.900323:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45639 00010000:00010000:2.0:1716999788.905906:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc63eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.905918:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc63eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999788.905921:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999788.905924:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc63eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.905929:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.905932:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc63eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.905938:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc63eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.905955:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xa992fa36 (ffff880135ac4500) 00010000:00010000:2.0:1716999788.905958:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.905961:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc63eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.905966:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc63eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999788.906027:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480715712 00000100:00100000:0.0:1716999788.906034:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480715712 00000100:00100000:0.0:1716999788.906073:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10038 00000100:00100000:0.0:1716999788.906079:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:107d663a-2216-406b-94c6-b2fcb1558728+76:1959:x1800404480715712:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.906091:0:19200:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.906104:0:19200:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c131f80/0x6d188eabd8dc6400 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65dc2 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1716999788.906121:0:19200:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x60b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1716999788.906135:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.906136:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999788.906142:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c131f80/0x6d188eabd8dc6400 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dc2 expref: 77 pid: 19200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.906154:0:19200:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c131f80/0x6d188eabd8dc6400 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dc2 expref: 77 pid: 19200 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999788.906163:0:19200:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131f80, rc 0) 00000100:00100000:0.0:1716999788.906199:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480715712:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 120us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.906205:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10038 00000100:00100000:0.0:1716999788.910118:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.910191:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480715840 00000100:00100000:2.0:1716999788.910198:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480715840 00000100:00100000:2.0:1716999788.910227:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9106 00000100:00100000:2.0:1716999788.910233:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+586:11419:x1800404480715840:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999788.910551:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11483, 168 off2053608 00000001:00080000:2.0:1716999788.910556:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986073 00000100:00100000:2.0:1716999788.910643:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+588:11419:x1800404480715840:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 408us (528us total) trans 4294986074 rc 0/0 00000100:00100000:2.0:1716999788.910649:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9106 00000020:00080000:2.0:1716999788.910653:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999788.916552:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.916577:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480715968 00000100:00100000:2.0:1716999788.916583:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480715968 00000100:00100000:2.0:1716999788.916612:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45640 00000100:00100000:2.0:1716999788.916618:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+588:11419:x1800404480715968:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.916635:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.916651:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6407 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65dc9 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.916717:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5200/0x6d188eabd8dc640e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.916727:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5200/0x6d188eabd8dc640e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc4d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.916736:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5200/0x6d188eabd8dc640e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc4d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:2.0:1716999788.916744:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc4d:0x0]: returning size 0 00010000:00010000:2.0:1716999788.916838:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6407 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dc9 expref: 591 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.916850:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5200/0x6d188eabd8dc640e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc4d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dc9 expref: 590 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.916856:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4d:0x0].0x0 (ffff880135ac4200) 00010000:00010000:2.0:1716999788.916859:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999788.916861:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb5200, rc 0) 00000100:00100000:2.0:1716999788.916918:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+590:11419:x1800404480715968:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 299us (372us total) trans 4294986075 rc 0/0 00000100:00100000:2.0:1716999788.916924:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45640 00000100:00100000:1.0:1716999788.924679:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.925512:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716032 00000100:00100000:3.0:1716999788.925521:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716032 00000100:00100000:3.0:1716999788.925561:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10039 00000100:00100000:3.0:1716999788.925567:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+77:11419:x1800404480716032:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.925582:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.925595:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65dd0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.925617:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c131f80/0x6d188eabd8dc6400 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dc2 expref: 78 pid: 19200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.925624:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.925626:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999788.925628:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd0 expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.925652:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c131f80/0x6d188eabd8dc6400 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dc2 expref: 78 pid: 19200 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.925661:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c131f80/0x6d188eabd8dc6400 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dc2 expref: 78 pid: 19200 timeout: 408 lvb_type: 1 00000100:00100000:3.0:1716999788.925671:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483014656:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999788.925714:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20b480 going to sleep for 11 seconds 00000100:00100000:0.0:1716999788.928345:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099444e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483014656:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999788.928370:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd0 expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.928384:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc6c0, rc 0) 00000100:00100000:0.0:1716999788.928415:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+78:11419:x1800404480716032:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2848us (3743us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.928423:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10039 00000100:00100000:0.0:1716999788.929306:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.929611:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716096 00000100:00100000:2.0:1716999788.929618:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716096 00010000:00010000:2.0:1716999788.929640:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c131f80/0x6d188eabd8dc6400 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dc2 expref: 78 pid: 19200 timeout: 408 lvb_type: 1 00000100:00100000:2.0:1716999788.929719:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4556 00000100:00100000:2.0:1716999788.929724:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480716096:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999788.929734:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999788.929751:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c131f80/0x6d188eabd8dc6400 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dc2 expref: 78 pid: 19200 timeout: 408 lvb_type: 1 00010000:00010000:2.0:1716999788.929760:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c131f80/0x6d188eabd8dc6400 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dc2 expref: 78 pid: 19200 timeout: 408 lvb_type: 1 00010000:00010000:2.0:1716999788.929780:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c131f80/0x6d188eabd8dc6400 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dc2 expref: 78 pid: 19200 timeout: 408 lvb_type: 1 00010000:00010000:2.0:1716999788.929789:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.929791:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.929795:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd0 expref: 77 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.929803:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd0 expref: 77 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.929837:0:6807:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd0 expref: 77 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999788.929847:0:6807:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6807:1800404483014720:192.168.203.3@tcp:105: 00000100:00100000:2.0:1716999788.929898:0:6807:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008eaf5300 going to sleep for 11 seconds 00000100:00100000:1.0:1716999788.934253:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.934279:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716160 00000100:00100000:1.0:1716999788.934285:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716160 00000100:00100000:1.0:1716999788.934313:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45641 00000100:00100000:1.0:1716999788.934319:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+590:11419:x1800404480716160:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.934337:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.934352:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc6423 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65dd7 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.934395:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc642a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934406:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc642a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934414:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc642a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934422:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6431 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999788.934424:0:6807:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6807:1800404483014720:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999788.934427:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934432:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999788.934438:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999788.934470:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480716096:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 4745us (5165us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.934477:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4556 00010000:00010000:1.0:1716999788.934479:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc642a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934484:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc642a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934488:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc642a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934493:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.934496:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc642a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934501:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc642a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934513:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999788.934515:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.934518:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc642a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934522:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc642a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934530:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6431 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934535:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6431 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934538:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934542:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.934544:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6431 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934549:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6431 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934554:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xa053fa7a (ffff8800a585ed00) 00010000:00010000:1.0:1716999788.934556:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.934557:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6431 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934562:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6431 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999788.934592:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc6423 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd7 expref: 591 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.934599:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc6423 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd7 expref: 591 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.934606:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216fcc0, rc 0) 00000100:00100000:1.0:1716999788.934626:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+590:11419:x1800404480716160:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 307us (380us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.934631:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45641 00000100:00100000:1.0:1716999788.941544:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.941721:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716224 00000100:00100000:0.0:1716999788.941729:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716224 00000100:00100000:0.0:1716999788.941760:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45642 00000100:00100000:0.0:1716999788.941766:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+590:11419:x1800404480716224:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.942198:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.942214:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6438 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65dde expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.942239:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dde expref: 591 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.942254:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6438 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dde expref: 591 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.942261:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.942264:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.942266:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130240, rc 0) 00000100:00100000:0.0:1716999788.942302:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480716224:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 536us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.942308:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45642 00000100:00100000:2.0:1716999788.947111:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.947314:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716288 00000100:00100000:3.0:1716999788.947321:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716288 00000100:00100000:3.0:1716999788.947351:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9107 00000100:00100000:3.0:1716999788.947356:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480716288:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999788.951062:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480716288:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3698us (3948us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999788.951071:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9107 00000100:00100000:1.0:1716999788.954797:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.954987:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716416 00000100:00100000:0.0:1716999788.954994:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716416 00000100:00100000:0.0:1716999788.955025:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45643 00000100:00100000:0.0:1716999788.955031:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480716416:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.955045:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.955058:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc643f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65de5 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.955140:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6446 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955150:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955159:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955168:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc644d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955172:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc644d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955177:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc644d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955207:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6446 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955212:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6446 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955217:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6446 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955221:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.955224:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6446 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955230:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6446 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955251:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.955254:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.955258:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6446 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955262:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6446 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955321:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc644d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955327:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc644d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955331:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc644d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955334:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.955336:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc644d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955340:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc644d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955345:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xa053fa7a (ffff880135ac4800) 00010000:00010000:0.0:1716999788.955347:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.955348:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc644d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955352:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc644d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999788.955371:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc643f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65de5 expref: 592 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.955377:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc643f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65de5 expref: 592 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.955384:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133cc0, rc 0) 00000100:00100000:0.0:1716999788.955820:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480716416:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 786us (1026us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.955829:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45643 00000001:00080000:2.0:1716999788.958785:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970197 is committed 00000100:00100000:1.0:1716999788.959009:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+74:1958:x1800404480715520:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 70174us (71589us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.959017:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10037 00000100:00100000:0.0:1716999788.960340:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.960468:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716544 00000100:00100000:2.0:1716999788.960475:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716544 00000100:00100000:2.0:1716999788.960516:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9108 00000100:00100000:2.0:1716999788.960522:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480716544:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999788.960845:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11484, 168 off2053776 00000001:00080000:2.0:1716999788.960850:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986076 00000100:00100000:2.0:1716999788.962482:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480716544:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1956us (2140us total) trans 4294986077 rc 0/0 00000100:00100000:2.0:1716999788.962490:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9108 00000020:00080000:2.0:1716999788.962495:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999788.965004:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.965051:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716608 00000100:00100000:1.0:1716999788.965059:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716608 00000100:00100000:0.0:1716999788.965081:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.965675:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716736 00000100:00100000:1.0:1716999788.965679:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716736 00000100:00100000:1.0:1716999788.965697:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45644 00000100:00100000:1.0:1716999788.965703:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+594:11420:x1800404480716608:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:0.0:1716999788.965704:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45645 00000100:00100000:0.0:1716999788.965707:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480716736:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999788.965721:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.965735:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6454 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65dec expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.965748:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999788.965761:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc63ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc4c:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d9f expref: 595 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.965766:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc645b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965775:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc645b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965786:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc645b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965796:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6462 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965802:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965869:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965942:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc645b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965947:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc645b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965952:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc645b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965956:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.965959:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc645b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965963:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc645b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965970:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.965972:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.965975:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc645b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965978:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc645b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965985:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6462 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965989:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6462 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965993:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.965996:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.965998:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6462 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.966002:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6462 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.966006:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xa992fa2d (ffff880094791a00) 00010000:00010000:1.0:1716999788.966008:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.966009:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6462 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.966013:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc6462 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.966037:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6454 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dec expref: 594 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.966042:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6454 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dec expref: 594 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.966048:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c6c0, rc 0) 00000100:00100000:1.0:1716999788.966081:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+593:11420:x1800404480716608:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 380us (1084us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999788.966087:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45644 00010000:00010000:0.0:1716999788.966289:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6390 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d91 expref: 592 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.966302:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4c:0x0].0x0 (ffff8800a585e100) 00010000:00010000:0.0:1716999788.966315:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6438 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dde expref: 591 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.966323:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.966326:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999788.966338:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6469 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.966344:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.966349:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.966364:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6470 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.966369:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.966374:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.966573:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6477 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.966579:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6477 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.966583:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6477 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:0.0:1716999788.967173:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1484, 64 off103232 00000040:00080000:0.0:1716999788.967191:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11485, 176 off2053952 00010000:00010000:0.0:1716999788.967242:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc647e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967248:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc647e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967254:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc647e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967259:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc647e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967263:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc647e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967270:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc647e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967274:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc647e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967278:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999788.967280:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc647e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967284:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc647e lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967290:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4c:0x0].0x0 (ffff880135ac4800) 00010000:00010000:0.0:1716999788.967292:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999788.967294:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc647e lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967298:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc647e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967316:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6477 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967321:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6477 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967325:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6477 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967329:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.967331:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6477 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967339:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6477 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967344:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4c:0x0].0x0 (ffff880135ac4800) 00010000:00010000:0.0:1716999788.967345:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999788.967347:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6477 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967350:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6477 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967385:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6469 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967389:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6469 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967394:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6469 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967397:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.967399:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6469 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967403:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6469 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967408:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.967410:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.967412:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6469 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.967416:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6469 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999788.967423:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800995a3100 reply state ffff88012cbba000 transno 4294986078 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999788.967427:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999788.967463:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480716736:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1753us (2381us total) trans 4294986078 rc 0/0 00000100:00100000:0.0:1716999788.967468:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45645 00000100:00100000:1.0:1716999788.972457:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.972532:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999788.972555:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6470 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.972563:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6470 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.972569:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.972574:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.972577:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6470 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.972583:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6470 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.972595:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xa992fa2d (ffff880135ac4e00) 00010000:00010000:1.0:1716999788.972597:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.972601:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6470 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999788.972605:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6470 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999788.972636:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716800 00000100:00100000:1.0:1716999788.972643:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716800 00000100:00100000:1.0:1716999788.972672:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716864 00000100:00100000:1.0:1716999788.972674:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716864 00000100:00100000:1.0:1716999788.973290:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45646 00000100:00100000:1.0:1716999788.973296:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480716800:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:0.0:1716999788.973344:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45647 00000100:00100000:0.0:1716999788.973349:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480716864:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999788.973365:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999788.973376:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6485 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65dfa expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.973415:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc648c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973424:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc648c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973431:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc648c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973440:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6493 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973444:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973448:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973499:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc648c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973504:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc648c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973508:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc648c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973513:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.973515:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc648c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973520:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc648c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973526:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999788.973528:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.973530:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc648c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973535:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc648c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973541:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6493 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973546:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6493 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973551:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973558:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999788.973560:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6493 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973565:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6493 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973571:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xc88ea4fb (ffff880135ac4c00) 00010000:00010000:0.0:1716999788.973573:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999788.973575:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6493 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973579:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6493 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999788.973609:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6485 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dfa expref: 593 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.973615:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6485 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dfa expref: 593 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999788.973622:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130240, rc 0) 00000100:00100000:0.0:1716999788.973660:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480716864:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 310us (1127us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999788.973665:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45647 00010000:00010000:1.0:1716999788.974022:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.974030:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc649a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65df3 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.974045:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc649a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65df3 expref: 592 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.974053:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc649a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65df3 expref: 592 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.974063:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.974065:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.974067:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c480, rc 0) 00000100:00100000:1.0:1716999788.974085:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480716800:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 789us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999788.974100:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45646 00000100:00100000:0.0:1716999788.977442:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999788.978065:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.978137:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716992 00000100:00100000:2.0:1716999788.978145:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716992 00000100:00100000:2.0:1716999788.978174:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9109 00000100:00100000:2.0:1716999788.978180:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480716992:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999788.979483:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480716928 00000100:00100000:3.0:1716999788.979490:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480716928 00000100:00100000:3.0:1716999788.979524:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45648 00000100:00100000:3.0:1716999788.979529:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480716928:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999788.979538:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999788.979553:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc64a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e01 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.979574:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc64a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e01 expref: 595 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.979583:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc64a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e01 expref: 595 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.979589:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.979591:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.979594:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd8c0, rc 0) 00000100:00100000:3.0:1716999788.979625:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+595:11419:x1800404480716928:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 96us (2190us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.979630:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45648 00000100:00100000:2.0:1716999788.981628:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+593:11420:x1800404480716992:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3442us (3557us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999788.981637:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9109 00000100:00100000:0.0:1716999788.982641:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.983739:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480717056 00000100:00100000:2.0:1716999788.983747:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480717056 00000100:00100000:2.0:1716999788.983786:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9110 00000100:00100000:2.0:1716999788.983792:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec21050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480717056:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999788.985398:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.986063:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec21050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480717056:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2268us (3420us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999788.986072:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9110 00000100:00100000:1.0:1716999788.986316:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480717184 00000100:00100000:1.0:1716999788.986322:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480717184 00000100:00100000:1.0:1716999788.986345:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45649 00000100:00100000:1.0:1716999788.986350:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+593:11420:x1800404480717184:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.986364:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.986367:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999788.986386:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc649a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65df3 expref: 593 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.986399:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.986403:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999788.986414:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc64a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e08 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.986517:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc64af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.986527:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc64af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.986535:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc64af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.986545:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc64b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.986550:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc64b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.986554:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc64b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:1.0:1716999788.986966:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60b:0x0], index 0: 0 00000040:00080000:1.0:1716999788.987041:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11486, 176 off2054128 00010000:00010000:1.0:1716999788.987124:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc64bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.987131:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc64bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.987137:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc64bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.987157:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc64af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.987163:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc64af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.987168:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc64af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.987173:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999788.987175:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc64af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.987181:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc64af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.987187:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999788.987189:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999788.987192:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc64af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.987196:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc64af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999788.987204:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009c2c6a00 reply state ffff880091991000 transno 4294986079 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc64b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999788.987209:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999788.987225:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc64a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e08 expref: 595 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.987234:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc64bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e08 expref: 594 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.987239:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4e:0x0].0x0 (ffff880094791a00) 00010000:00010000:1.0:1716999788.987242:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999788.987244:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c240, rc 0) 00000100:00100000:1.0:1716999788.987268:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+595:11420:x1800404480717184:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 917us (1874us total) trans 4294986079 rc 0/0 00000100:00100000:1.0:1716999788.987273:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45649 00010000:00010000:2.0:1716999788.988983:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc64b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.988994:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc64b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.988999:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc64b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.989003:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216eac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.989007:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc64b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.989012:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc64b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.989022:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xa992fa2d (ffff880094791900) 00010000:00010000:2.0:1716999788.989024:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.989027:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc64b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999788.989031:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc64b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999788.990279:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.990328:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480717248 00000100:00100000:2.0:1716999788.990335:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480717248 00000100:00100000:0.0:1716999788.990344:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.990366:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10040 00000100:00100000:2.0:1716999788.990371:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+76:1959:x1800404480717248:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.990385:0:19196:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.990399:0:19196:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc64cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e0f expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999788.990407:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480717312 00000100:00100000:3.0:1716999788.990411:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480717312 00002000:00010000:2.0:1716999788.990418:0:19196:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x60b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00100000:3.0:1716999788.990430:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45650 00010000:00010000:2.0:1716999788.990431:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999788.990433:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1716999788.990434:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480717312:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999788.990438:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc64cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e0f expref: 77 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.990445:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999788.990448:0:19196:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc64cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e0f expref: 77 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999788.990453:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc64d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e16 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.990461:0:19196:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb4b40, rc 0) 00010000:00010000:3.0:1716999788.990486:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc64d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999788.990491:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480717248:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 120us (216us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999788.990495:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc64d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999788.990496:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10040 00010000:00010000:3.0:1716999788.990501:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc64d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990509:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc64e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990514:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc64e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990519:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc64e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990578:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc64d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990583:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc64d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990587:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc64d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990590:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.990592:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc64d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990597:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc64d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990604:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999788.990606:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.990609:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc64d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990612:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc64d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990622:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc64e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990626:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc64e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990629:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc64e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990632:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999788.990634:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc64e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990638:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc64e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990642:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xc88ea4fb (ffff88012e3f8900) 00010000:00010000:3.0:1716999788.990644:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999788.990646:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc64e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990649:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc64e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999788.990675:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc64d2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e16 expref: 595 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.990681:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc64d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e16 expref: 595 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999788.990687:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde400, rc 0) 00000100:00100000:3.0:1716999788.990703:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480717312:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 269us (360us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999788.990708:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45650 00000100:00100000:0.0:1716999788.992575:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999788.992635:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480717440 00000100:00100000:3.0:1716999788.992640:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480717440 00000100:00100000:3.0:1716999788.992662:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9111 00000100:00100000:3.0:1716999788.992667:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+594:11420:x1800404480717440:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999788.993022:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11487, 168 off2054296 00000001:00080000:3.0:1716999788.993027:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986080 00000100:00100000:3.0:1716999788.993109:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+596:11420:x1800404480717440:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 440us (536us total) trans 4294986081 rc 0/0 00000100:00100000:3.0:1716999788.993116:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9111 00000020:00080000:3.0:1716999788.993119:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999788.994213:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999788.994258:0:4162:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480717568 00000100:00100000:2.0:1716999788.994264:0:4162:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480717568 00000100:00100000:2.0:1716999788.994295:0:4162:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 614 00000100:00100000:2.0:1716999788.994300:0:4162:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+596:11419:x1800404480717568:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999788.994323:0:4162:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999788.994338:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc63f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dbb expref: 596 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.994352:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4d:0x0].0x0 (ffff880135ac4200) 00010000:00010000:2.0:1716999788.994359:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc64a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e01 expref: 595 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999788.994365:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.994371:0:4162:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999788.994411:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc64e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994421:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc64e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994428:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc64e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994441:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc64ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994446:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc64ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994451:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc64ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994464:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc64f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994470:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc64f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994474:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc64f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994545:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc64fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994551:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc64fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994556:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc64fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000040:00080000:2.0:1716999788.994799:0:4162:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11488, 224 off2054520 00000004:00010000:2.0:1716999788.994903:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009c2c6300 reply state ffff88012ca92000 transno 4294986082 ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc64fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:2.0:1716999788.994910:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:2.0:1716999788.994913:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009c2c6300 reply state ffff88012ca92000 transno 4294986082 ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc64f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:2.0:1716999788.994918:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:2.0:1716999788.994921:0:4162:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc64e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994925:0:4162:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc64e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994931:0:4162:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc64e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994935:0:4162:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb4d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999788.994938:0:4162:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc64e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994943:0:4162:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc64e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994950:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999788.994952:0:4162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999788.994954:0:4162:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc64e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999788.994958:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc64e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00000004:00010000:2.0:1716999788.994965:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009c2c6300 reply state ffff88012ca92000 transno 4294986082 ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc64ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:2.0:1716999788.994968:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:0.0:1716999788.996275:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999788.996432:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480717696 00000100:00100000:1.0:1716999788.996438:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480717696 00000100:00100000:1.0:1716999788.997854:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45651 00000100:00100000:1.0:1716999788.997862:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+597:11420:x1800404480717696:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999788.997904:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999788.997919:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6503 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e1d expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.997983:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc650a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.997993:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc650a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc4e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999788.998001:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc650a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc4e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:1.0:1716999788.998009:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc4e:0x0]: returning size 0 00010000:00010000:1.0:1716999788.998099:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6503 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e1d expref: 600 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.998113:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc650a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc4e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e1d expref: 599 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999788.998120:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4e:0x0].0x0 (ffff880094791a00) 00010000:00010000:1.0:1716999788.998123:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1716999788.998126:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216fa80, rc 0) 00000100:00100000:1.0:1716999788.998165:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+599:11420:x1800404480717696:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 304us (1893us total) trans 4294986083 rc 0/0 00000100:00100000:1.0:1716999788.998171:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45651 00000100:00100000:3.0:1716999788.998620:0:4162:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480717568:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 4317us (4406us total) trans 4294986082 rc 0/0 00000100:00100000:3.0:1716999788.998626:0:4162:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 614 00010000:00010000:1.0:1716999789.000158:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc64ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000166:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc64ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000172:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc64ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000177:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.000180:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc64ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000185:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc64ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000195:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xa992fa36 (ffff88008a83f600) 00010000:00010000:1.0:1716999789.000198:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.000200:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc64ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000205:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc64ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000218:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc64f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000222:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc64f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000227:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc64f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000231:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb46c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.000233:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc64f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000238:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc64f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000244:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xc88ea4fb (ffff88008a83f300) 00010000:00010000:1.0:1716999789.000246:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.000248:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc64f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000252:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc64f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000262:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc64fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000266:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc64fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000270:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc64fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000274:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb6d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.000276:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc64fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000281:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc64fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000287:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4d:0x0].0x0 (ffff880135ac4200) 00010000:00010000:1.0:1716999789.000288:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1716999789.000290:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc64fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:1.0:1716999789.000294:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc64fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00000100:00100000:0.0:1716999789.000547:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.000656:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480717760 00000100:00100000:3.0:1716999789.000662:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480717760 00000100:00100000:3.0:1716999789.000733:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45652 00000100:00100000:3.0:1716999789.000739:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:11419:x1800404480717760:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.000755:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.000766:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6518 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e24 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.000804:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc651f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.000823:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc651f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.000830:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc651f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.000840:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6526 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.000845:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.000849:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.000866:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00080000:2.0:1716999789.000914:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1716999759 00000100:00100000:2.0:1716999789.001065:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480717824 00000100:00100000:2.0:1716999789.001069:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480717824 00000100:00100000:2.0:1716999789.001090:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10041 00000100:00100000:2.0:1716999789.001095:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+77:11420:x1800404480717824:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.001103:0:19196:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.001147:0:19196:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e2b expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.001164:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc64cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e0f expref: 78 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.001174:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.001176:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.001179:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e2b expref: 78 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.001201:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc6534 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.001202:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc64cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e0f expref: 78 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999789.001207:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc6534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.001212:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc64cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e0f expref: 78 pid: 19196 timeout: 408 lvb_type: 1 00010000:00010000:3.0:1716999789.001213:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc6534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999789.001221:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483014784:192.168.203.3@tcp:104: 00000004:00200000:3.0:1716999789.001234:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc4d:0x0]: returning size 0 00000004:00200000:3.0:1716999789.001237:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999789.001247:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc6534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001253:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc6534 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001259:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc651f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001263:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc651f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001268:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc651f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001276:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdef40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.001279:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc651f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001283:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc651f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001290:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.001292:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.001294:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc651f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001298:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc651f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001306:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6526 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001311:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6526 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001318:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001322:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.001324:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6526 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001328:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6526 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001332:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xc88ea4fb (ffff88012e3f8900) 00010000:00010000:3.0:1716999789.001333:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.001335:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6526 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.001338:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6526 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999789.001351:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008eaf5300 going to sleep for 11 seconds 00010000:00010000:3.0:1716999789.001360:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6518 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e24 expref: 599 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.001367:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc6534 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e24 expref: 598 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.001373:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4d:0x0].0x0 (ffff880135ac4200) 00010000:00010000:3.0:1716999789.001374:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999789.001376:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcb40, rc 0) 00000100:00100000:3.0:1716999789.001393:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480717760:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 654us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.001398:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45652 00000100:00100000:0.0:1716999789.005077:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.005155:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480717888 00000100:00100000:2.0:1716999789.005163:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480717888 00000100:00100000:3.0:1716999789.005189:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483014784:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999789.005191:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc64cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e0f expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00010000:00010000:3.0:1716999789.005210:0:19196:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e2b expref: 79 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999789.005212:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4557 00000100:00100000:2.0:1716999789.005217:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480717888:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999789.005222:0:19196:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb6400, rc 0) 00010000:00010000:2.0:1716999789.005227:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999789.005243:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc64cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e0f expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00010000:00010000:2.0:1716999789.005251:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc64cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e0f expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:3.0:1716999789.005253:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+79:11420:x1800404480717824:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 4158us (4389us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.005259:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10041 00010000:00010000:2.0:1716999789.005267:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc64cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e0f expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00010000:00010000:2.0:1716999789.005276:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.005277:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.005282:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e2b expref: 77 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.005289:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e2b expref: 77 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.005529:0:6807:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e2b expref: 77 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999789.005541:0:6807:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6807:1800404483014848:192.168.203.3@tcp:105: 00000100:00100000:2.0:1716999789.005571:0:6807:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008eaf5300 going to sleep for 11 seconds 00000100:00100000:2.0:1716999789.005844:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.005902:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480717952 00000100:00100000:3.0:1716999789.005906:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480717952 00000100:00100000:3.0:1716999789.005926:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45653 00000100:00100000:3.0:1716999789.005930:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480717952:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.005942:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.005955:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc653b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e32 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.005996:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc6542 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006006:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc6542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006014:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc6542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006023:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6549 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006029:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006037:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006098:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc6542 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006104:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc6542 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006109:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc6542 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006114:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.006117:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc6542 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006127:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc6542 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006136:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.006138:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.006141:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc6542 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006145:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc6542 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006152:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6549 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006156:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6549 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006163:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006167:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.006170:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6549 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006174:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6549 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006179:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x778ea4fb (ffff88012e3f8700) 00010000:00010000:3.0:1716999789.006181:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.006183:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6549 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006187:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.006220:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc653b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e32 expref: 599 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.006227:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc653b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e32 expref: 599 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.006234:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bde400, rc 0) 00000100:00100000:3.0:1716999789.006266:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480717952:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 333us (421us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.006271:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45653 00000100:00100000:2.0:1716999789.007626:0:6807:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6807:1800404483014848:192.168.203.3@tcp:105: 00010000:00010000:2.0:1716999789.007640:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999789.008281:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480717888:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3062us (3211us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.008289:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4557 00000100:00100000:0.0:1716999789.009246:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.009295:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480718016 00000100:00100000:3.0:1716999789.009300:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480718016 00000100:00100000:0.0:1716999789.009313:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.009330:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480718080 00000100:00100000:3.0:1716999789.009332:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480718080 00000100:00100000:3.0:1716999789.009344:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45654 00000100:00100000:3.0:1716999789.009349:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+599:11419:x1800404480718016:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:0.0:1716999789.009352:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45655 00000100:00100000:0.0:1716999789.009355:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+599:11420:x1800404480718080:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.009361:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.009361:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.009373:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc6557 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e39 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.009373:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6550 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e40 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.009394:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc6557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e39 expref: 601 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.009402:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc6557 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e39 expref: 601 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.009406:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc655e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.009408:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.009410:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.009412:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd8c0, rc 0) 00010000:00010000:0.0:1716999789.009412:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc655e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009418:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc655e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009427:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6565 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009432:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999789.009434:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480718016:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 86us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.009439:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45654 00010000:00010000:0.0:1716999789.009440:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009486:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc655e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009491:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc655e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009496:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc655e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009500:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.009503:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc655e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009508:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc655e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009515:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.009517:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.009519:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc655e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009523:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc655e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009546:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6565 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009551:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6565 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009555:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009559:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.009561:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6565 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009565:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6565 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009571:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xa992fa36 (ffff880135ac4e00) 00010000:00010000:0.0:1716999789.009573:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.009575:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6565 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009579:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6565 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.009606:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6550 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e40 expref: 600 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.009612:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6550 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e40 expref: 600 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.009619:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130b40, rc 0) 00000100:00100000:0.0:1716999789.009634:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+599:11420:x1800404480718080:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 278us (321us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999789.009639:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45655 00000100:00100000:0.0:1716999789.011147:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.011210:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480718144 00000100:00100000:1.0:1716999789.011215:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480718144 00000100:00100000:1.0:1716999789.011249:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45656 00000100:00100000:1.0:1716999789.011255:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+599:11420:x1800404480718144:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.011264:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.011275:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc656c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e47 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.011293:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc656c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e47 expref: 600 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.011303:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc656c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e47 expref: 600 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.011309:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.011311:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.011313:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216e640, rc 0) 00000100:00100000:1.0:1716999789.011335:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+600:11420:x1800404480718144:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 81us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.011341:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45656 00000100:00100000:0.0:1716999789.013242:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.013515:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480718208 00000100:00100000:0.0:1716999789.013520:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480718208 00000100:00100000:0.0:1716999789.013558:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9112 00000100:00100000:0.0:1716999789.013563:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+600:11419:x1800404480718208:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999789.015416:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.015464:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480718272 00000100:00100000:3.0:1716999789.015469:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480718272 00000100:00100000:3.0:1716999789.015495:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9113 00000100:00100000:3.0:1716999789.015501:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480718272:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999789.018574:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480718208:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5003us (5330us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.018583:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9112 00000100:00100000:3.0:1716999789.019147:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+600:11420:x1800404480718272:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3645us (3734us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.019154:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9113 00000100:00100000:0.0:1716999789.021408:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.021509:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480718464 00000100:00100000:2.0:1716999789.021515:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480718464 00000100:00100000:2.0:1716999789.022157:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45657 00000100:00100000:2.0:1716999789.022163:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+600:11419:x1800404480718464:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.022177:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.022180:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1716999789.022200:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc6557 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e39 expref: 600 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.022226:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.022230:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.022239:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6573 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e4e expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.022337:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc657a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022346:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc657a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022353:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc657a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022366:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc6581 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022371:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc6581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022375:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc6581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:2.0:1716999789.022760:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60c:0x0], index 1: 0 00000040:00080000:2.0:1716999789.022828:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11489, 184 off2054704 00010000:00010000:2.0:1716999789.022931:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6588 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022937:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022943:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6588 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022964:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc657a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022969:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc657a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022974:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc657a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022978:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb46c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.022981:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc657a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022990:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc657a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.022996:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.022998:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.023000:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc657a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.023004:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc657a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999789.023011:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009c2c4700 reply state ffff88012ca94000 transno 4294986084 ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc6581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.023016:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999789.023031:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6573 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e4e expref: 602 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.023039:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6588 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e4e expref: 601 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.023044:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4f:0x0].0x0 (ffff880091b4d100) 00010000:00010000:2.0:1716999789.023045:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999789.023047:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb4240, rc 0) 00000100:00100000:2.0:1716999789.023085:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480718464:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 922us (1683us total) trans 4294986084 rc 0/0 00000100:00100000:2.0:1716999789.023090:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45657 00000100:00100000:0.0:1716999789.023721:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.023779:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480718528 00000100:00100000:1.0:1716999789.023784:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480718528 00000100:00100000:1.0:1716999789.023815:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45658 00000100:00100000:1.0:1716999789.023821:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480718528:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.023830:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.023831:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999789.023842:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc656c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e47 expref: 602 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.023864:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.023867:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.023874:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6596 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e55 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.023956:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc659d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.023962:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc659d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.023968:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc659d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.023976:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc65a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.023981:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc65a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.023985:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc65a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:1.0:1716999789.024239:0:7785:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60c:0x0], index 0: 0 00000040:00080000:1.0:1716999789.024277:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11490, 176 off2054880 00010000:00010000:1.0:1716999789.024338:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc65ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.024344:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc65ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.024350:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc65ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.024365:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc659d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.024369:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc659d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.024373:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc659d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.024376:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.024379:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc659d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.024384:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc659d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.024390:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.024392:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.024394:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc659d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.024398:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc659d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999789.024406:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008fc1fb80 reply state ffff880091996000 transno 4294986085 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc65a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999789.024410:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999789.024423:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6596 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e55 expref: 604 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.024431:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc65ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e55 expref: 603 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.024436:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc50:0x0].0x0 (ffff880094791f00) 00010000:00010000:1.0:1716999789.024437:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999789.024439:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216e1c0, rc 0) 00000100:00100000:1.0:1716999789.024463:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+604:11420:x1800404480718528:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 641us (743us total) trans 4294986085 rc 0/0 00000100:00100000:1.0:1716999789.024468:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45658 00010000:00010000:3.0:1716999789.025018:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc6581 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.025025:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc6581 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.025030:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc6581 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.025033:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.025036:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc6581 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.025040:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc6581 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.025047:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x778ea4fb (ffff880091b4db00) 00010000:00010000:3.0:1716999789.025049:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.025051:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc6581 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.025055:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc6581 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.026022:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc65a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.026029:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc65a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.026034:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc65a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.026039:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.026045:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc65a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.026049:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc65a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.026058:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xa992fa36 (ffff880094791d00) 00010000:00010000:1.0:1716999789.026060:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.026062:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc65a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.026066:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc65a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.026609:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.026827:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480718592 00000100:00100000:3.0:1716999789.026833:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480718592 00000100:00100000:3.0:1716999789.026859:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10042 00000100:00100000:3.0:1716999789.026864:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480718592:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.026875:0:19196:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.026904:0:19196:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc65b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e5c expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999789.026925:0:19196:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x60c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999789.026939:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.026940:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.026946:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc65b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e5c expref: 78 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999789.026955:0:19196:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc65b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e5c expref: 78 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999789.026963:0:19196:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcd80, rc 0) 00000100:00100000:3.0:1716999789.027004:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480718592:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 138us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.027010:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10042 00000100:00100000:2.0:1716999789.027347:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.027490:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480718656 00000100:00100000:0.0:1716999789.027493:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480718656 00000100:00100000:0.0:1716999789.027521:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10043 00000100:00100000:0.0:1716999789.027526:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+74:1959:x1800404480718656:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.027533:0:17864:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.027544:0:17864:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc65c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e63 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1716999789.027558:0:17864:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x60c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1716999789.027566:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999789.027568:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999789.027571:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc65c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e63 expref: 75 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999789.027580:0:17864:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc65c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e63 expref: 75 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1716999789.027587:0:17864:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130d80, rc 0) 00000100:00100000:0.0:1716999789.027616:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+75:1959:x1800404480718656:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 89us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.027622:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10043 00000100:00100000:0.0:1716999789.030398:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.030443:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.030595:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480718784 00000100:00100000:2.0:1716999789.030603:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480718784 00000100:00100000:2.0:1716999789.030632:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480718912 00000100:00100000:2.0:1716999789.030635:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480718912 00000100:00100000:2.0:1716999789.030660:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9114 00000100:00100000:2.0:1716999789.030666:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480718784:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999789.031047:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11491, 168 off2055048 00000001:00080000:2.0:1716999789.031052:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986086 00000100:00100000:2.0:1716999789.031125:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480718784:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 458us (733us total) trans 4294986087 rc 0/0 00000100:00100000:2.0:1716999789.031131:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9114 00000020:00080000:2.0:1716999789.031135:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999789.031147:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9115 00000100:00100000:2.0:1716999789.031150:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec20c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+604:11419:x1800404480718912:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999789.031314:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11492, 168 off2055216 00000001:00080000:2.0:1716999789.031318:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986088 00000100:00100000:2.0:1716999789.031360:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec20c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+606:11419:x1800404480718912:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 208us (917us total) trans 4294986089 rc 0/0 00000100:00100000:2.0:1716999789.031366:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9115 00000020:00080000:2.0:1716999789.031368:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.035318:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.035844:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.036199:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719040 00000100:00100000:2.0:1716999789.036207:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719040 00000100:00100000:2.0:1716999789.036235:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719168 00000100:00100000:2.0:1716999789.036237:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719168 00000100:00100000:2.0:1716999789.036262:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45659 00000100:00100000:2.0:1716999789.036268:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480719040:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.036285:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.036300:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc65c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e6a expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.036374:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4000/0x6d188eabd8dc65ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.036385:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4000/0x6d188eabd8dc65ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc50:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.036393:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4000/0x6d188eabd8dc65ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc50:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:2.0:1716999789.036401:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc50:0x0]: returning size 0 00010000:00010000:2.0:1716999789.036495:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc65c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e6a expref: 610 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.036506:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4000/0x6d188eabd8dc65ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc50:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e6a expref: 609 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.036512:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc50:0x0].0x0 (ffff880094791f00) 00010000:00010000:2.0:1716999789.036514:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999789.036517:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb4000, rc 0) 00000100:00100000:2.0:1716999789.036553:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+609:11420:x1800404480719040:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 284us (1241us total) trans 4294986090 rc 0/0 00000100:00100000:2.0:1716999789.036558:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45659 00000100:00100000:2.0:1716999789.036571:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45660 00000100:00100000:2.0:1716999789.036575:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+608:11419:x1800404480719168:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.036582:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.036589:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc65dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e71 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.036625:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc65e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.036632:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc65e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc4f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.036638:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc65e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc4f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:2.0:1716999789.036643:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc4f:0x0]: returning size 0 00010000:00010000:2.0:1716999789.036687:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc65dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e71 expref: 611 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.036697:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc65e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc4f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e71 expref: 610 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.036702:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4f:0x0].0x0 (ffff880091b4d100) 00010000:00010000:2.0:1716999789.036704:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999789.036706:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb7cc0, rc 0) 00000100:00100000:2.0:1716999789.036723:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+610:11419:x1800404480719168:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 146us (880us total) trans 4294986091 rc 0/0 00000100:00100000:2.0:1716999789.036728:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45660 00000100:00100000:0.0:1716999789.040298:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.040340:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.041375:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719232 00000100:00100000:3.0:1716999789.041383:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719232 00000100:00100000:3.0:1716999789.041419:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719296 00000100:00100000:3.0:1716999789.041421:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719296 00000100:00100000:3.0:1716999789.041437:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10044 00000100:00100000:3.0:1716999789.041443:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+78:11420:x1800404480719232:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.041461:0:19196:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.041475:0:19196:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e78 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.041502:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc65b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e5c expref: 79 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999789.041512:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.041514:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.041516:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e78 expref: 79 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.041540:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc65b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e5c expref: 79 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999789.041549:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc65b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e5c expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:3.0:1716999789.041560:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099445c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483014912:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999789.041602:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff880131f95000 going to sleep for 11 seconds 00000100:00100000:3.0:1716999789.041618:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10045 00000100:00100000:3.0:1716999789.041622:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+75:11419:x1800404480719296:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.041628:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.041636:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e7f expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.041647:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc65c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e63 expref: 76 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999789.041652:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.041654:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.041656:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e7f expref: 76 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.041669:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc65c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e63 expref: 76 pid: 17864 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999789.041676:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc65c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e63 expref: 76 pid: 17864 timeout: 408 lvb_type: 1 00000100:00100000:3.0:1716999789.041683:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099447800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483014976:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999789.041698:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff880131f95d80 going to sleep for 11 seconds 00000100:00100000:2.0:1716999789.045564:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099447800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483014976:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999789.045593:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e7f expref: 76 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.045607:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc900, rc 0) 00000100:00100000:2.0:1716999789.045648:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+76:11419:x1800404480719296:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 4023us (5305us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.045655:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10045 00000100:00100000:3.0:1716999789.046899:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099445c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483014912:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999789.046919:0:19196:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e78 expref: 79 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.046928:0:19196:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd8c0, rc 0) 00000100:00100000:3.0:1716999789.047194:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+79:11420:x1800404480719232:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 5749us (6900us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.047201:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10044 00000100:00100000:0.0:1716999789.047725:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.047756:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.047906:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719424 00000100:00100000:1.0:1716999789.047913:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719424 00010000:00010000:1.0:1716999789.047933:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc65c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e63 expref: 76 pid: 17864 timeout: 408 lvb_type: 1 00000100:00100000:1.0:1716999789.047958:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719360 00000100:00100000:1.0:1716999789.047960:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719360 00010000:00010000:1.0:1716999789.047967:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc65b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e5c expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:1.0:1716999789.047978:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4558 00000100:00100000:1.0:1716999789.047982:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+76:1958:x1800404480719424:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999789.047991:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999789.048006:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc65c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e63 expref: 76 pid: 17864 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.048013:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc65c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e63 expref: 76 pid: 17864 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.048028:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c130d80/0x6d188eabd8dc65c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e63 expref: 76 pid: 17864 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.048042:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.048044:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.048048:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e7f expref: 75 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.048054:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e7f expref: 75 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.048076:0:15839:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e7f expref: 75 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999789.048085:0:15839:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880088b2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483015040:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999789.048114:0:15839:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e361300 going to sleep for 11 seconds 00000100:00100000:1.0:1716999789.048174:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4559 00000100:00100000:1.0:1716999789.048178:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+79:1958:x1800404480719360:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999789.048185:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999789.048196:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc65b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e5c expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.048203:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc65b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e5c expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.048212:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc65b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e5c expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.048227:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.048228:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.048231:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e78 expref: 78 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.048237:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e78 expref: 78 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.048250:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e78 expref: 78 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999789.048255:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880088b2ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483015104:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999789.048270:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e361840 going to sleep for 11 seconds 00000100:00100000:0.0:1716999789.052271:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.052576:0:15839:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880088b2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483015040:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999789.052595:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999789.052629:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+75:1958:x1800404480719424:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 4644us (4904us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.052638:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4558 00000100:00100000:0.0:1716999789.054682:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.054703:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719488 00000100:00100000:0.0:1716999789.054709:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719488 00000100:00100000:1.0:1716999789.054930:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880088b2ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483015104:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999789.054947:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999789.055056:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+78:1958:x1800404480719360:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 6874us (7297us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.055064:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4559 00000100:00100000:0.0:1716999789.055797:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719552 00000100:00100000:0.0:1716999789.055801:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719552 00000100:00100000:2.0:1716999789.056042:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45661 00000100:00100000:2.0:1716999789.056049:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+611:11419:x1800404480719488:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.056068:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.056083:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc65ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e86 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.056125:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6606 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056135:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6606 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056144:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6606 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056155:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc660d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056159:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc660d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056164:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc660d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056217:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6606 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056222:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6606 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056226:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6606 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056231:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb73c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.056233:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6606 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056238:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6606 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056246:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.056248:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.056251:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6606 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056256:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6606 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056268:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc660d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056272:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc660d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056276:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc660d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056279:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb6ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.056282:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc660d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056286:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc660d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056290:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x78ea50f (ffff88008a83f200) 00010000:00010000:2.0:1716999789.056292:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.056294:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc660d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056298:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc660d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056327:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc65ff lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e86 expref: 612 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.056334:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc65ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e86 expref: 612 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.056340:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb61c0, rc 0) 00000100:00100000:2.0:1716999789.056364:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+611:11419:x1800404480719488:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 316us (4100us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.056370:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45661 00000100:00100000:2.0:1716999789.056382:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45662 00000100:00100000:2.0:1716999789.056386:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+610:11420:x1800404480719552:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.056398:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.056406:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc6614 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e8d expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.056424:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc661b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.056430:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc661b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057158:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc661b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057172:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc6622 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057178:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc6622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057183:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc6622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057217:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc661b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057222:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc661b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057227:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc661b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057230:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.057232:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc661b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057237:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc661b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057244:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.057246:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.057248:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc661b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057252:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc661b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057260:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc6622 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057265:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc6622 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057269:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc6622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057272:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb4480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.057275:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc6622 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057279:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc6622 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057284:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xa053fa7a (ffff88008a83f300) 00010000:00010000:2.0:1716999789.057285:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.057287:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc6622 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057291:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc6622 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.057319:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc6614 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e8d expref: 611 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.057326:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc6614 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e8d expref: 611 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.057332:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb7840, rc 0) 00000100:00100000:2.0:1716999789.057367:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+610:11420:x1800404480719552:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 979us (2690us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.057376:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45662 00000100:00100000:0.0:1716999789.059191:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.059278:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719616 00000100:00100000:2.0:1716999789.059285:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719616 00000100:00100000:2.0:1716999789.059637:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45663 00000100:00100000:2.0:1716999789.059644:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+610:11419:x1800404480719616:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.059658:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.059672:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc6629 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e94 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.059694:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc6629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e94 expref: 611 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.059704:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc6629 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e94 expref: 611 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.059710:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.059712:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.059715:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb58c0, rc 0) 00000100:00100000:2.0:1716999789.059757:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+611:11419:x1800404480719616:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 113us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.059762:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45663 00000100:00100000:0.0:1716999789.060658:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.060706:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719680 00000100:00100000:3.0:1716999789.060711:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719680 00000100:00100000:3.0:1716999789.060736:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45664 00000100:00100000:3.0:1716999789.060741:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+611:11420:x1800404480719680:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.060747:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.060755:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc6630 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65e9b expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.060769:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc6630 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e9b expref: 612 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.060777:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc6630 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e9b expref: 612 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.060781:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.060783:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.060785:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bded00, rc 0) 00000100:00100000:3.0:1716999789.060801:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+612:11420:x1800404480719680:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.060815:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45664 00000100:00100000:0.0:1716999789.062224:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.062419:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719744 00000100:00100000:2.0:1716999789.062425:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719744 00000100:00100000:2.0:1716999789.062457:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9116 00000100:00100000:2.0:1716999789.062462:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+612:11420:x1800404480719744:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999789.063665:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.063760:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719808 00000100:00100000:1.0:1716999789.063765:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719808 00000100:00100000:1.0:1716999789.063801:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9117 00000100:00100000:1.0:1716999789.063816:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480719808:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999789.066850:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+614:11420:x1800404480719744:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4380us (4620us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.066862:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9116 00000100:00100000:1.0:1716999789.067607:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+612:11419:x1800404480719808:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3799us (3943us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.067614:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9117 00000100:00100000:0.0:1716999789.069753:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.069835:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480719872 00000100:00100000:2.0:1716999789.069843:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480719872 00000100:00100000:2.0:1716999789.069928:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45665 00000100:00100000:2.0:1716999789.069936:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+612:11419:x1800404480719872:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.069954:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.069972:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc6637 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ea2 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.070020:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc663e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070030:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc663e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070039:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc663e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070051:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6645 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070055:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070060:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070113:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc663e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070118:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc663e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070122:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc663e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070129:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb6880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.070132:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc663e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070137:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc663e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070144:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.070146:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.070148:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc663e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070152:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc663e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070164:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6645 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070168:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6645 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070172:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070175:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.070177:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6645 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070180:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6645 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070184:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xec6f74b7 (ffff88008a83f200) 00010000:00010000:2.0:1716999789.070186:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.070188:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6645 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070192:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc6645 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.070221:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc6637 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ea2 expref: 613 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.070227:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc6637 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ea2 expref: 613 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.070233:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb4900, rc 0) 00000100:00100000:2.0:1716999789.070280:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+612:11419:x1800404480719872:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 345us (532us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.070286:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45665 00000100:00100000:0.0:1716999789.071078:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.071130:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480720000 00000100:00100000:2.0:1716999789.071134:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480720000 00000100:00100000:2.0:1716999789.071152:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45666 00000100:00100000:2.0:1716999789.071156:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+612:11420:x1800404480720000:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.071164:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.071172:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc664c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ea9 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.071223:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc6653 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071230:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc6653 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071240:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc6653 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071250:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc665a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071255:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc665a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071260:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc665a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071282:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc6653 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071287:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc6653 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071291:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc6653 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071296:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.071298:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc6653 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071303:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc6653 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071309:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.071311:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.071313:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc6653 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071318:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc6653 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071325:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc665a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071330:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc665a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071334:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc665a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071338:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb61c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.071341:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc665a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071345:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc665a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071350:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xa053fa7a (ffff88008a83f600) 00010000:00010000:2.0:1716999789.071352:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.071354:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc665a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071358:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc665a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xa053fa7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.071374:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc664c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ea9 expref: 613 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.071380:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc664c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ea9 expref: 613 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.071387:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb7a80, rc 0) 00000100:00100000:2.0:1716999789.071408:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+612:11420:x1800404480720000:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 251us (332us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.071413:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45666 00000100:00100000:1.0:1716999789.074415:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.074459:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.074527:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480720064 00000100:00100000:3.0:1716999789.074534:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480720064 00000100:00100000:3.0:1716999789.074563:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45667 00000100:00100000:3.0:1716999789.074569:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+612:11419:x1800404480720064:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.074583:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.074597:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6661 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65eb0 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.074640:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6668 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074651:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6668 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074660:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6668 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074671:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc666f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x9c159348 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074675:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc666f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074680:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc666f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074740:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6668 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074745:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6668 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074750:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6668 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074755:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.074758:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6668 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074763:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6668 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074770:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.074773:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.074775:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6668 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074779:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6668 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074796:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc666f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074801:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc666f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074815:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc666f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074819:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.074821:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc666f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074825:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc666f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074830:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x9c159348 (ffff88012e3f8f00) 00010000:00010000:3.0:1716999789.074832:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.074834:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc666f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074838:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc666f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.074865:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6661 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65eb0 expref: 613 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.074872:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6661 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65eb0 expref: 613 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.074877:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd680, rc 0) 00000100:00100000:3.0:1716999789.074926:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+612:11419:x1800404480720064:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 357us (518us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.074932:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45667 00000100:00100000:0.0:1716999789.075032:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480720192 00000100:00100000:0.0:1716999789.075036:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480720192 00000100:00100000:0.0:1716999789.075063:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9118 00000100:00100000:0.0:1716999789.075067:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+612:11420:x1800404480720192:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999789.075368:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11493, 168 off2055384 00000001:00080000:0.0:1716999789.075373:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986092 00000100:00100000:0.0:1716999789.075439:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+614:11420:x1800404480720192:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 371us (979us total) trans 4294986093 rc 0/0 00000100:00100000:0.0:1716999789.075444:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9118 00000020:00080000:0.0:1716999789.075448:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999789.077188:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.077347:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480720320 00000100:00100000:0.0:1716999789.077353:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480720320 00000100:00100000:0.0:1716999789.077384:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45668 00000100:00100000:0.0:1716999789.077390:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+614:11420:x1800404480720320:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.077422:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999789.077439:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc650a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc4e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e1d expref: 614 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.077452:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc64bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e08 expref: 613 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.077460:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4e:0x0].0x0 (ffff880094791a00) 00010000:00010000:0.0:1716999789.077471:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc6630 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e9b expref: 612 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.077598:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.077601:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.077618:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6676 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.077628:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.077634:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.077644:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc667d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.077649:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc667d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.077657:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc667d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.077730:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6684 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.077736:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6684 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.077742:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6684 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:0.0:1716999789.078345:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1485, 64 off103296 00000004:00080000:0.0:1716999789.078350:0:6823:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 308277469699ns, next at 309277467907ns, rc = 0 00000040:00080000:0.0:1716999789.078368:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11494, 176 off2055560 00010000:00010000:0.0:1716999789.078905:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc668b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078913:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc668b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078919:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc668b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078925:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc668b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078929:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc668b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078933:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc668b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078938:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc668b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078942:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999789.078945:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc668b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078950:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc668b lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078956:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4e:0x0].0x0 (ffff880135ac4c00) 00010000:00010000:0.0:1716999789.078958:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999789.078961:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc668b lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078965:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc668b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc4e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078982:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6684 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078987:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6684 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078991:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6684 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.078995:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.078998:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6684 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.079002:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6684 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.079008:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4e:0x0].0x0 (ffff880135ac4c00) 00010000:00010000:0.0:1716999789.079010:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.079012:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6684 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.079016:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6684 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.079051:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6676 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.079056:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6676 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.079061:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6676 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.079064:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.079066:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6676 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.079070:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6676 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.079075:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.079077:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.079079:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6676 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.079083:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6676 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999789.079089:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008ea7f480 reply state ffff880135ae4000 transno 4294986094 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc667d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999789.079094:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.079156:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+613:11420:x1800404480720320:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1763us (1968us total) trans 4294986094 rc 0/0 00000100:00100000:0.0:1716999789.079163:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45668 00010000:00010000:2.0:1716999789.081111:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc667d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081121:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc667d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081126:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc667d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081129:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.081132:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc667d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081136:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc667d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081145:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xa992fa2d (ffff880135ac4a00) 00010000:00010000:2.0:1716999789.081147:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.081149:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc667d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081153:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc667d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xa992fa2d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999789.081530:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.081579:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480720384 00000100:00100000:2.0:1716999789.081584:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480720384 00000100:00100000:2.0:1716999789.081612:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45669 00000100:00100000:2.0:1716999789.081617:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+612:11420:x1800404480720384:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.081634:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.081643:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6692 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65eb7 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.081680:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6699 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081688:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081694:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081702:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081706:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081710:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081754:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6699 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081757:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6699 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081761:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6699 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081765:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb73c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.081767:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6699 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081771:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6699 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081777:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.081779:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.081781:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6699 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081784:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6699 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081789:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081793:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081796:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081800:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.081801:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081817:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081822:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xc88ea4fb (ffff8800b4877e00) 00010000:00010000:2.0:1716999789.081824:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.081826:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081830:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.081854:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6692 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65eb7 expref: 613 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.081861:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6692 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65eb7 expref: 613 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.081867:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb6ac0, rc 0) 00000100:00100000:2.0:1716999789.081919:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+612:11420:x1800404480720384:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 301us (391us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.081924:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45669 00000100:00100000:0.0:1716999789.085114:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.085173:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480720448 00000100:00100000:3.0:1716999789.085180:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480720448 00000100:00100000:3.0:1716999789.085287:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45670 00000100:00100000:3.0:1716999789.085293:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+612:11420:x1800404480720448:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.085305:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.085318:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc66a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ebe expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.085340:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc66a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ebe expref: 613 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.085350:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc66a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ebe expref: 613 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.085356:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.085358:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.085360:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bded00, rc 0) 00000100:00100000:3.0:1716999789.086738:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+613:11420:x1800404480720448:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1441us (1626us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.086744:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45670 00000100:00100000:0.0:1716999789.088939:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.089008:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480720576 00000100:00100000:3.0:1716999789.089014:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480720576 00000100:00100000:3.0:1716999789.089041:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9119 00000100:00100000:3.0:1716999789.089047:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+613:11419:x1800404480720576:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999789.089386:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11495, 168 off2055728 00000001:00080000:3.0:1716999789.089391:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986095 00000100:00100000:3.0:1716999789.090821:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480720576:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1769us (1880us total) trans 4294986096 rc 0/0 00000100:00100000:3.0:1716999789.090830:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9119 00000020:00080000:3.0:1716999789.090836:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.091181:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.091343:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480720640 00000100:00100000:3.0:1716999789.091348:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480720640 00000100:00100000:3.0:1716999789.091367:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9120 00000100:00100000:3.0:1716999789.091372:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec20850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+615:11420:x1800404480720640:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:1.0:1716999789.093447:0:11317:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1716999789.094707:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.094769:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480720768 00000100:00100000:2.0:1716999789.094775:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480720768 00000100:00100000:3.0:1716999789.095346:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec20850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+616:11420:x1800404480720640:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3971us (4163us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.095358:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9120 00000100:00100000:2.0:1716999789.095394:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45671 00000100:00100000:2.0:1716999789.095400:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480720768:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.095437:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1716999789.095455:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc5f61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc48:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c25 expref: 615 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.095484:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc5f3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c09 expref: 614 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.095492:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc48:0x0].0x0 (ffff88008a83fb00) 00010000:00010000:2.0:1716999789.095503:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc6629 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e94 expref: 613 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.095509:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.095512:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.095528:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc66ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.095537:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc66ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.095544:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc66ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.095553:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.095557:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.095561:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.095631:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc66bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.095636:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc66bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.095640:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc66bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:2.0:1716999789.096040:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1486, 64 off103360 00000040:00080000:2.0:1716999789.097469:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11496, 184 off2055912 00010000:00010000:2.0:1716999789.097545:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc66c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097556:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc66c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097567:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc66c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097572:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc66c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097577:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc66c3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097581:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc66c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097586:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc66c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097592:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5b00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999789.097595:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc66c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097600:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc66c3 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097608:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc48:0x0].0x0 (ffff8800b4877900) 00010000:00010000:2.0:1716999789.097610:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999789.097613:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc66c3 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097617:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc66c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc48:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097636:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc66bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097640:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc66bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097645:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc66bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097649:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb73c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.097651:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc66bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097656:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc66bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097660:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc48:0x0].0x0 (ffff8800b4877900) 00010000:00010000:2.0:1716999789.097662:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.097663:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc66bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097667:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc66bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097712:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc66ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097716:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc66ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097719:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc66ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097723:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb6ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.097724:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc66ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097728:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc66ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097737:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.097738:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.097740:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc66ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.097744:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc66ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999789.097749:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df2d80 reply state ffff8800a6cdf000 transno 4294986097 ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999789.097754:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.097825:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480720768:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2422us (3119us total) trans 4294986097 rc 0/0 00000100:00100000:2.0:1716999789.097831:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45671 00000100:00100000:0.0:1716999789.101424:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.101615:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480720832 00000100:00100000:2.0:1716999789.101622:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480720832 00000100:00100000:2.0:1716999789.101653:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45672 00000100:00100000:2.0:1716999789.101659:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+614:11420:x1800404480720832:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.101675:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.101691:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc66ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ec5 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.101735:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc66d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101744:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc66d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101752:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc66d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101763:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc66d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101767:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc66d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101772:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc66d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101840:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc66d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101846:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc66d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101850:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc66d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101855:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb6d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.101858:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc66d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101863:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc66d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101872:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.101875:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.101878:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc66d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101897:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc66d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101911:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc66d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101915:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc66d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101919:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc66d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101923:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb46c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.101925:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc66d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101930:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc66d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101936:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xc88ea4fb (ffff8800990eab00) 00010000:00010000:2.0:1716999789.101938:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.101940:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc66d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101944:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc66d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.101976:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc66ca lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ec5 expref: 615 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.101983:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc66ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ec5 expref: 615 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.101990:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb7600, rc 0) 00000100:00100000:2.0:1716999789.102026:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+614:11420:x1800404480720832:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 367us (609us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.102032:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45672 00010000:00010000:1.0:1716999789.102301:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.102307:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.102311:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.102315:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.102317:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.102322:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.102329:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x522b8500 (ffff8800b4877e00) 00010000:00010000:1.0:1716999789.102331:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.102333:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.102337:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc66b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.103618:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.103692:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480720960 00000100:00100000:3.0:1716999789.103698:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480720960 00000100:00100000:3.0:1716999789.103719:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9121 00000100:00100000:3.0:1716999789.103724:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+613:11419:x1800404480720960:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999789.104081:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11497, 168 off2056080 00000001:00080000:3.0:1716999789.104086:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986098 00000100:00100000:3.0:1716999789.104159:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480720960:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 434us (544us total) trans 4294986099 rc 0/0 00000100:00100000:3.0:1716999789.104165:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9121 00000020:00080000:3.0:1716999789.104168:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999789.104990:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.107395:0:4162:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721088 00000100:00100000:3.0:1716999789.107404:0:4162:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721088 00000100:00100000:3.0:1716999789.107450:0:4162:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 615 00000100:00100000:3.0:1716999789.107456:0:4162:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+615:11420:x1800404480721088:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999789.107498:0:4162:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1716999789.107520:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc65ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc50:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e55 expref: 615 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.107539:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc50:0x0].0x0 (ffff880094791f00) 00010000:00010000:3.0:1716999789.107548:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc66a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ebe expref: 614 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.107554:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.107557:0:4162:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.107626:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc66df lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.107636:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc66df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.107644:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc66df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.107655:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc66e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.107660:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc66e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.107665:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc66e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.107680:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc66ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.107685:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc66ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.107690:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc66ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.107769:0:4162:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc66f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.107775:0:4162:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc66f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.107780:0:4162:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc66f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000040:00080000:3.0:1716999789.108156:0:4162:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11499, 224 off2056416 00000004:00010000:3.0:1716999789.108241:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008ea7c700 reply state ffff88009c08a000 transno 4294986100 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc66f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:3.0:1716999789.108247:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00010000:3.0:1716999789.108249:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008ea7c700 reply state ffff88009c08a000 transno 4294986100 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc66ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:3.0:1716999789.108252:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 1 00010000:00010000:3.0:1716999789.108254:0:4162:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc66df lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.108259:0:4162:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc66df lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.108263:0:4162:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc66df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.108267:0:4162:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.108270:0:4162:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc66df lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.108278:0:4162:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc66df lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.108285:0:4162:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.108286:0:4162:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.108289:0:4162:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc66df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:3.0:1716999789.108293:0:4162:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc66df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00000004:00010000:3.0:1716999789.108298:0:4162:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008ea7c700 reply state ffff88009c08a000 transno 4294986100 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc66e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4162 initiator: MDT0 00000100:00100000:3.0:1716999789.108302:0:4162:0:(service.c:188:ptlrpc_save_lock()) nlocks 2 00000100:00100000:3.0:1716999789.108358:0:4162:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_004:107d663a-2216-406b-94c6-b2fcb1558728+615:11420:x1800404480721088:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 901us (3369us total) trans 4294986100 rc 0/0 00000100:00100000:3.0:1716999789.108364:0:4162:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 615 00000100:00100000:1.0:1716999789.110391:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.110528:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721216 00000100:00100000:0.0:1716999789.110535:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721216 00000100:00100000:0.0:1716999789.110562:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45673 00000100:00100000:0.0:1716999789.110567:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480721216:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.110601:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999789.110623:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8000/0x6d188eabd8dc61d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc49:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cf7 expref: 615 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.110642:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc616e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cd4 expref: 614 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.110651:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc49:0x0].0x0 (ffff88008a83f100) 00010000:00010000:0.0:1716999789.110658:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.110676:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc66fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.110685:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc66fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.110691:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc66fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.110701:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6702 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.110706:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.110711:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.110779:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6709 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.110786:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6709 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.110791:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6709 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.110900:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc66e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110906:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc66e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110911:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc66e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110915:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdfcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.110918:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc66e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110923:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc66e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110931:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xa992fa36 (ffff88012e3f8100) 00010000:00010000:2.0:1716999789.110933:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.110936:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc66e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110940:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc66e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xa992fa36 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110950:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc66ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110955:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc66ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110963:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc66ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110966:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.110968:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc66ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110973:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc66ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110979:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xc88ea4fb (ffff88012e3f8700) 00010000:00010000:2.0:1716999789.110981:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.110983:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc66ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110987:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc66ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.110996:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc66f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.111000:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc66f4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.111004:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc66f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.111008:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.111010:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc66f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.111014:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc66f4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.111021:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc50:0x0].0x0 (ffff880094791f00) 00010000:00010000:2.0:1716999789.111022:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1716999789.111025:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc66f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00010000:00010000:2.0:1716999789.111029:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc66f4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 4162 initiator: MDT0 00000040:00080000:0.0:1716999789.111430:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1487, 64 off103424 00000040:00080000:0.0:1716999789.111450:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11500, 184 off2056600 00010000:00010000:0.0:1716999789.111498:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6710 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111505:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111511:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6710 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111517:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6710 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111522:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6710 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111530:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6710 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111534:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6710 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111538:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999789.111540:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6710 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111545:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6710 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111551:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc49:0x0].0x0 (ffff880135ac4c00) 00010000:00010000:0.0:1716999789.111553:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999789.111555:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6710 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111559:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6710 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111574:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6709 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111579:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6709 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111584:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6709 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111587:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.111590:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6709 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111597:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6709 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111603:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc49:0x0].0x0 (ffff880135ac4c00) 00010000:00010000:0.0:1716999789.111605:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.111607:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6709 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111611:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6709 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111656:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc66fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111661:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc66fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111666:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc66fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111670:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.111672:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc66fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111677:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc66fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111682:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999789.111684:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.111686:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc66fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.111690:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc66fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999789.111697:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880088b2e680 reply state ffff880136317000 transno 4294986101 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999789.111703:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.111742:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480721216:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1174us (1354us total) trans 4294986101 rc 0/0 00000100:00100000:0.0:1716999789.111749:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45673 00000100:00100000:1.0:1716999789.114131:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999789.114160:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6702 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114167:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6702 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114171:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6702 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114176:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.114178:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6702 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114183:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6702 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114193:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x5a9c1470 (ffff880135ac4800) 00010000:00010000:1.0:1716999789.114196:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.114199:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6702 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114203:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6702 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999789.114246:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.114268:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721280 00000100:00100000:1.0:1716999789.114274:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721280 00000100:00100000:1.0:1716999789.114296:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721344 00000100:00100000:1.0:1716999789.114298:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721344 00000100:00100000:1.0:1716999789.114316:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45674 00000100:00100000:1.0:1716999789.114323:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+614:11420:x1800404480721280:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.114339:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.114351:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc6717 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ecc expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.114386:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc671e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114395:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc671e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114401:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc671e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114410:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6725 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114415:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114420:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114492:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc672c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114498:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc672c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114504:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc672c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999789.114525:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc50:0x0]: returning size 0 00000004:00200000:1.0:1716999789.114528:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.114539:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc672c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc50:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114545:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc672c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114550:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc671e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114554:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc671e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114558:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc671e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114562:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216eac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.114564:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc671e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114569:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc671e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114574:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.114576:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.114579:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc671e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114583:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc671e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114590:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6725 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114595:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6725 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114602:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6725 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114605:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c6c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.114608:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6725 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114612:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6725 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114617:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xc88ea4fb (ffff880094791900) 00010000:00010000:1.0:1716999789.114619:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.114621:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6725 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114625:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6725 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114645:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc6717 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ecc expref: 616 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.114653:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc672c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ecc expref: 615 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.114659:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc50:0x0].0x0 (ffff880094791f00) 00010000:00010000:1.0:1716999789.114661:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999789.114663:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216e400, rc 0) 00000100:00100000:1.0:1716999789.114694:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+615:11420:x1800404480721280:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 370us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.114699:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45674 00000100:00100000:1.0:1716999789.114713:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45675 00000100:00100000:1.0:1716999789.114717:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480721344:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.114724:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.114730:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc6733 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ed3 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.114749:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc673a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114755:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc673a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114761:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc673a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114770:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6741 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114776:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114780:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114821:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc673a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114826:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc673a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114830:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc673a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114833:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.114836:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc673a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114840:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc673a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114846:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.114848:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.114851:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc673a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114855:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc673a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114861:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6741 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114864:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6741 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114868:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6741 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114872:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.114873:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6741 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114877:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6741 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114900:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x4f529a91 (ffff88008a83fb00) 00010000:00010000:1.0:1716999789.114902:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.114904:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6741 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114921:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6741 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.114948:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc6733 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ed3 expref: 615 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.114953:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc6733 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ed3 expref: 615 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.114960:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216fcc0, rc 0) 00000100:00100000:1.0:1716999789.114975:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480721344:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 258us (729us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999789.114980:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45675 00000100:00100000:0.0:1716999789.117381:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.117717:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721408 00000100:00100000:3.0:1716999789.117725:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721408 00000100:00100000:3.0:1716999789.117767:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45676 00000100:00100000:3.0:1716999789.117774:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+614:11419:x1800404480721408:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.117788:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.117802:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc6748 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65eda expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.117837:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc6748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65eda expref: 615 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.117848:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc6748 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65eda expref: 615 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.117855:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.117857:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.117860:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdf840, rc 0) 00000100:00100000:3.0:1716999789.117907:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+615:11419:x1800404480721408:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 133us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.117914:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45676 00000100:00100000:0.0:1716999789.118823:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.119832:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721472 00000100:00100000:1.0:1716999789.119839:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721472 00000100:00100000:1.0:1716999789.119869:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45677 00000100:00100000:1.0:1716999789.119875:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+615:11420:x1800404480721472:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.119898:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.119908:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc674f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ee1 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.119942:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6756 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.119951:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6756 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.119957:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6756 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.119969:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc675d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.119974:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc675d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.119979:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc675d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120031:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6756 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120036:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6756 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120041:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6756 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120046:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.120049:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6756 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120054:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6756 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120062:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.120064:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.120067:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6756 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120071:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6756 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120079:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc675d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120084:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc675d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120088:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc675d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120091:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.120093:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc675d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120097:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc675d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120102:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x778ea4fb (ffff88008a83f600) 00010000:00010000:1.0:1716999789.120104:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.120106:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc675d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120110:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc675d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.120137:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc674f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ee1 expref: 616 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.120144:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc674f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ee1 expref: 616 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.120150:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216fa80, rc 0) 00000100:00100000:1.0:1716999789.120173:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+615:11420:x1800404480721472:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 298us (1352us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999789.120181:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45677 00000100:00100000:0.0:1716999789.123258:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.123511:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.123581:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721600 00000100:00100000:1.0:1716999789.123588:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721600 00000100:00100000:3.0:1716999789.123705:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721536 00000100:00100000:3.0:1716999789.123709:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721536 00000100:00100000:1.0:1716999789.123767:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9122 00000100:00100000:1.0:1716999789.123773:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+616:11419:x1800404480721600:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999789.124604:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45678 00000100:00100000:3.0:1716999789.124609:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+617:11420:x1800404480721536:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.124618:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.124633:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6764 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ee8 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.124655:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ee8 expref: 618 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.124665:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6764 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ee8 expref: 618 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.124672:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.124674:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.124676:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdc000, rc 0) 00000100:00100000:3.0:1716999789.126044:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+618:11420:x1800404480721536:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1431us (2788us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.126051:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45678 00000100:00100000:1.0:1716999789.129731:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+616:11419:x1800404480721600:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5950us (6212us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.129742:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9122 00000100:00100000:0.0:1716999789.129797:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.131032:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721664 00000100:00100000:1.0:1716999789.131039:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721664 00000100:00100000:1.0:1716999789.131096:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9123 00000100:00100000:1.0:1716999789.131101:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+616:11420:x1800404480721664:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999789.135654:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.137159:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721728 00000100:00100000:3.0:1716999789.137167:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721728 00000100:00100000:3.0:1716999789.137205:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45679 00000100:00100000:3.0:1716999789.137212:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+617:11419:x1800404480721728:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.137227:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.137242:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc676b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65eef expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.137287:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc6772 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137297:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc6772 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137306:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc6772 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137316:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6779 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137321:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137325:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137386:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc6772 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137392:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc6772 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137397:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc6772 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137403:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.137406:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc6772 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137411:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc6772 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137421:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.137423:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.137426:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc6772 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137430:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc6772 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137443:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6779 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137447:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6779 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137451:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137454:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.137456:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6779 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137460:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6779 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137464:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x4f529a91 (ffff88012e3f8f00) 00010000:00010000:3.0:1716999789.137467:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.137468:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6779 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137472:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6779 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.137501:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc676b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65eef expref: 618 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.137507:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc676b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65eef expref: 618 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.137516:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdcd80, rc 0) 00000100:00100000:1.0:1716999789.138471:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+617:11420:x1800404480721664:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 7366us (8671us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.138479:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9123 00000100:00100000:3.0:1716999789.138556:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+616:11419:x1800404480721728:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1344us (2907us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.138561:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45679 00000100:00100000:0.0:1716999789.140524:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.140600:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721856 00000100:00100000:3.0:1716999789.140605:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721856 00000100:00100000:3.0:1716999789.140626:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45680 00000100:00100000:3.0:1716999789.140631:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+616:11420:x1800404480721856:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.140643:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.140645:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1716999789.140660:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6764 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ee8 expref: 616 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.140675:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.140678:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.140686:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc6780 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ef6 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.140771:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6787 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.140778:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6787 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.140784:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6787 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.140792:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc678e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.140797:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc678e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.140801:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc678e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:3.0:1716999789.141215:0:11055:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60d:0x0], index 1: 0 00000040:00080000:3.0:1716999789.141273:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11501, 184 off2056784 00010000:00010000:3.0:1716999789.141361:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc6795 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.141367:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc6795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.141372:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc6795 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.141393:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6787 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.141398:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6787 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.141402:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6787 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.141407:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.141410:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6787 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.141415:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6787 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.141421:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.141423:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.141426:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6787 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.141430:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6787 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:3.0:1716999789.141437:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800889fd500 reply state ffff88009c08f000 transno 4294986102 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc678e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.141442:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999789.141457:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc6780 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ef6 expref: 618 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.141467:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc6795 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ef6 expref: 617 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.141472:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc51:0x0].0x0 (ffff88012e3f8700) 00010000:00010000:3.0:1716999789.141473:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999789.141475:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdef40, rc 0) 00000100:00100000:3.0:1716999789.141528:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+618:11420:x1800404480721856:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 895us (1006us total) trans 4294986102 rc 0/0 00000100:00100000:3.0:1716999789.141534:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45680 00010000:00010000:2.0:1716999789.142590:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc678e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.142597:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc678e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.142603:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc678e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.142607:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.142609:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc678e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.142613:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc678e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.142621:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x778ea4fb (ffff88012e3f8d00) 00010000:00010000:2.0:1716999789.142622:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.142624:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc678e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.142629:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc678e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.143372:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.143528:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721920 00000100:00100000:3.0:1716999789.143534:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721920 00000100:00100000:3.0:1716999789.143571:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10046 00000100:00100000:3.0:1716999789.143577:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+75:1959:x1800404480721920:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.143588:0:19196:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.143601:0:19196:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135bdd200/0x6d188eabd8dc67a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65efd expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1716999789.143617:0:19196:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x60d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1716999789.143630:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.143631:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.143637:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdd200/0x6d188eabd8dc67a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65efd expref: 76 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999789.143647:0:19196:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135bdd200/0x6d188eabd8dc67a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65efd expref: 76 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999789.143655:0:19196:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd200, rc 0) 00000100:00100000:3.0:1716999789.143691:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+76:1959:x1800404480721920:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 114us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.143697:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10046 00000100:00100000:0.0:1716999789.147709:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.147789:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480721984 00000100:00100000:2.0:1716999789.147797:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480721984 00000100:00100000:2.0:1716999789.147851:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45681 00000100:00100000:2.0:1716999789.147857:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+617:11419:x1800404480721984:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.147875:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.147918:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc67aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f04 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.147962:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67b1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.147973:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.147982:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.147992:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.147997:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148002:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148057:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67b1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148062:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67b1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148067:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148075:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb4d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.148077:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148083:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67b1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148091:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.148094:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.148096:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148101:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148118:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148123:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148127:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148130:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.148132:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148137:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148142:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x63bf9fee (ffff8800990ea700) 00010000:00010000:2.0:1716999789.148144:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.148146:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148150:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.148179:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc67aa lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f04 expref: 618 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.148186:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc67aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f04 expref: 618 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.148192:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb4b40, rc 0) 00000100:00100000:2.0:1716999789.148239:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+617:11419:x1800404480721984:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 380us (536us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.148245:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45681 00000100:00100000:1.0:1716999789.154379:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.154445:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480722112 00000100:00100000:0.0:1716999789.154452:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480722112 00000100:00100000:0.0:1716999789.154996:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9124 00000100:00100000:0.0:1716999789.155003:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+617:11420:x1800404480722112:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999789.155344:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11502, 168 off2056952 00000001:00080000:0.0:1716999789.155350:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986103 00000100:00100000:0.0:1716999789.155619:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+619:11420:x1800404480722112:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 614us (1246us total) trans 4294986104 rc 0/0 00000100:00100000:0.0:1716999789.155625:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9124 00000020:00080000:0.0:1716999789.155629:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.157380:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.157453:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480722176 00000100:00100000:3.0:1716999789.157459:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480722176 00000100:00100000:3.0:1716999789.157489:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45682 00000100:00100000:3.0:1716999789.157494:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+619:11419:x1800404480722176:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.157507:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.157519:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc67bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f0b expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.157557:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc67c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157568:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc67c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157576:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc67c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157586:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc67cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157591:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc67cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157595:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc67cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157647:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc67c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157651:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc67c6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157655:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc67c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157660:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdfcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.157663:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc67c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157668:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc67c6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157676:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.157678:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.157680:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc67c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157684:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc67c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157702:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc67cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157707:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc67cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157711:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc67cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157715:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.157717:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc67cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157721:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc67cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.157727:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x640c9ef0 (ffff88012e3f8900) 00010000:00010000:3.0:1716999789.157729:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1716999789.157848:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.158020:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480722304 00000100:00100000:2.0:1716999789.158024:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480722304 00000100:00100000:2.0:1716999789.158052:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45683 00000100:00100000:2.0:1716999789.158057:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+621:11420:x1800404480722304:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.158066:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.158073:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc67d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f12 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.158112:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67db lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.158118:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc51:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.158127:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc51:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:2.0:1716999789.158135:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc51:0x0]: returning size 0 00010000:00010000:2.0:1716999789.158207:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc67d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f12 expref: 624 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.158222:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc51:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f12 expref: 623 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.158227:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc51:0x0].0x0 (ffff88012e3f8700) 00010000:00010000:2.0:1716999789.158229:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999789.158231:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb7600, rc 0) 00000100:00100000:2.0:1716999789.158259:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+623:11420:x1800404480722304:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 201us (410us total) trans 4294986105 rc 0/0 00010000:00010000:3.0:1716999789.158262:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc67cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999789.158264:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45683 00010000:00010000:3.0:1716999789.158266:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc67cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.158298:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc67bf lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f0b expref: 622 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.158304:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc67bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f0b expref: 622 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.158310:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd680, rc 0) 00000100:00100000:3.0:1716999789.158661:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+621:11419:x1800404480722176:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1165us (1282us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.158666:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45682 00000100:00100000:0.0:1716999789.160330:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.160707:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.161100:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480722496 00000100:00100000:3.0:1716999789.161105:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480722496 00000100:00100000:3.0:1716999789.161130:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45684 00000100:00100000:3.0:1716999789.161136:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+621:11419:x1800404480722496:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.161152:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.161164:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc67e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f20 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.161237:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc67f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161246:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc67f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161253:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc67f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161261:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc67f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161267:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc67f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161272:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc67f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161300:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc67f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161305:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc67f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161310:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc67f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161314:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.161317:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc67f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161322:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc67f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161330:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.161334:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.161337:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc67f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161341:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc67f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161350:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc67f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161354:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc67f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161358:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc67f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161362:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.161364:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc67f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161368:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc67f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161373:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x640c9ef0 (ffff88012e3f8f00) 00010000:00010000:3.0:1716999789.161375:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.161377:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc67f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161381:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc67f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.161399:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc67e9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f20 expref: 622 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.161405:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc67e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f20 expref: 622 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.161411:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bded00, rc 0) 00000100:00100000:3.0:1716999789.161444:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+621:11419:x1800404480722496:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 307us (737us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.161450:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45684 00000100:00100000:2.0:1716999789.161664:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480722368 00000100:00100000:2.0:1716999789.161669:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480722368 00000100:00100000:2.0:1716999789.161689:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10047 00000100:00100000:2.0:1716999789.161693:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+76:11420:x1800404480722368:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.161700:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.161709:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f19 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.161724:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdd200/0x6d188eabd8dc67a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65efd expref: 77 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.161735:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.161736:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.161739:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f19 expref: 77 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.161760:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdd200/0x6d188eabd8dc67a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65efd expref: 77 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.161769:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdd200/0x6d188eabd8dc67a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65efd expref: 77 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:2.0:1716999789.161779:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483015168:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999789.161824:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008eaf5300 going to sleep for 11 seconds 00000100:00100000:0.0:1716999789.162978:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.163018:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480722560 00000100:00100000:2.0:1716999789.163022:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480722560 00000100:00100000:2.0:1716999789.163049:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45685 00000100:00100000:2.0:1716999789.163054:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+621:11419:x1800404480722560:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.163063:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.163071:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6805 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f27 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.163100:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc680c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163108:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc680c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163117:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc680c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163126:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6813 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163130:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163134:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163169:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc680c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163174:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc680c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163178:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc680c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163183:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb6d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.163185:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc680c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163190:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc680c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163196:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.163198:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.163201:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc680c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163205:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc680c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163212:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6813 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163216:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6813 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163220:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163223:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb6ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.163224:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6813 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163228:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6813 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163232:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x63bf9fee (ffff8800990eaa00) 00010000:00010000:2.0:1716999789.163233:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.163235:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6813 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163238:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6813 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.163259:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6805 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f27 expref: 622 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.163265:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6805 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f27 expref: 622 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.163271:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb46c0, rc 0) 00000100:00100000:2.0:1716999789.163301:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+621:11419:x1800404480722560:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 245us (324us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.163307:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45685 00000100:00100000:1.0:1716999789.165403:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.165444:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.165592:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480722688 00000100:00100000:3.0:1716999789.165598:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480722688 00000100:00100000:3.0:1716999789.165623:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45686 00000100:00100000:3.0:1716999789.165629:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+621:11419:x1800404480722688:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.165640:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.165651:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc681a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f2e expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.165736:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6821 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165746:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6821 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165754:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6821 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165763:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6828 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165768:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165773:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165812:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6821 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165817:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6821 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165823:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165828:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.165831:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6821 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165837:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6821 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165845:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.165847:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.165849:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6821 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165854:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6821 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165866:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6828 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165870:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6828 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165875:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6828 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165893:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.165895:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6828 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165899:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6828 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999789.165903:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480722752 00010000:00010000:3.0:1716999789.165905:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x63bf9fee (ffff88012e3f8100) 00010000:00010000:3.0:1716999789.165907:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1716999789.165907:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480722752 00010000:00010000:3.0:1716999789.165909:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6828 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.165916:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc6828 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.165923:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdd200/0x6d188eabd8dc67a3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65efd expref: 78 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:2.0:1716999789.165925:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483015168:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999789.165935:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc681a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f2e expref: 622 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999789.165939:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4560 00010000:00010000:3.0:1716999789.165942:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc681a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f2e expref: 622 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.165943:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 3/0,0 mode: --/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f19 expref: 78 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999789.165943:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+78:1958:x1800404480722752:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999789.165948:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdfcc0, rc 0) 00010000:00010000:0.0:1716999789.165951:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999789.165953:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb4d80, rc 0) 00010000:00010000:0.0:1716999789.165963:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdd200/0x6d188eabd8dc67a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65efd expref: 78 pid: 19196 timeout: 408 lvb_type: 1 00010000:00010000:0.0:1716999789.165972:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdd200/0x6d188eabd8dc67a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65efd expref: 78 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:3.0:1716999789.165977:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+621:11419:x1800404480722688:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 347us (577us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.165979:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+78:11420:x1800404480722368:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 4286us (5652us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.165982:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45686 00010000:00010000:0.0:1716999789.165983:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdd200/0x6d188eabd8dc67a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65efd expref: 78 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:2.0:1716999789.165985:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10047 00010000:00010000:0.0:1716999789.165994:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999789.165996:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999789.166000:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f19 expref: 76 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.166007:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f19 expref: 76 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.166226:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f19 expref: 76 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999789.166237:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483015232:192.168.203.3@tcp:105: 00000100:00100000:0.0:1716999789.166577:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20b480 going to sleep for 11 seconds 00000100:00100000:0.0:1716999789.168326:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.168712:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480722816 00000100:00100000:3.0:1716999789.168718:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480722816 00000100:00100000:3.0:1716999789.168759:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45687 00000100:00100000:3.0:1716999789.168765:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+621:11419:x1800404480722816:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.168776:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.168787:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc682f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f35 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.168834:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6836 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168844:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168850:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168862:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc683d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168867:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc683d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168871:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc683d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168945:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6836 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168950:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6836 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168954:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6836 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168958:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.168961:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6836 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168966:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6836 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168975:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.168977:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.168980:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6836 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168984:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde640/0x6d188eabd8dc6836 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.168995:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc683d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.169000:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc683d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.169004:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc683d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.169007:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.169010:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc683d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.169014:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc683d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.169019:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x640c9ef0 (ffff88012e3f8f00) 00010000:00010000:3.0:1716999789.169021:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.169023:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc683d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.169027:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf3c0/0x6d188eabd8dc683d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.169056:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc682f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f35 expref: 622 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.169063:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bded00/0x6d188eabd8dc682f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f35 expref: 622 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.169069:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bded00, rc 0) 00000100:00100000:3.0:1716999789.169099:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+621:11419:x1800404480722816:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 334us (775us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.169104:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45687 00000100:00100000:1.0:1716999789.169399:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483015232:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999789.169412:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999789.169445:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+76:1958:x1800404480722752:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3500us (4000us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.169452:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4560 00000100:00100000:0.0:1716999789.170054:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.170109:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480722880 00000100:00100000:2.0:1716999789.170113:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480722880 00000100:00100000:2.0:1716999789.170141:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45688 00000100:00100000:2.0:1716999789.170146:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+621:11420:x1800404480722880:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.170154:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.170161:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6844 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f3c expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.170498:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc684b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170506:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc684b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170512:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc684b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170523:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6852 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x78ea50f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170528:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170532:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170566:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc684b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170570:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc684b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170574:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc684b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170579:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.170581:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc684b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170585:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc684b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170592:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.170595:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.170597:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc684b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170601:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc684b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170608:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6852 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170613:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6852 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170617:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170621:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.170623:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6852 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170626:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6852 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170631:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x78ea50f (ffff8800990ea600) 00010000:00010000:2.0:1716999789.170632:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.170634:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6852 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170638:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6852 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.170662:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6844 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f3c expref: 622 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.170669:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc6844 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f3c expref: 622 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.170675:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb73c0, rc 0) 00000100:00100000:2.0:1716999789.170710:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+621:11420:x1800404480722880:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 563us (656us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.170716:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45688 00000100:00100000:0.0:1716999789.171749:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.171801:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480723008 00000100:00100000:2.0:1716999789.171816:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480723008 00000100:00100000:0.0:1716999789.171820:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.171846:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480723072 00000100:00100000:2.0:1716999789.171848:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480723072 00000100:00100000:3.0:1716999789.171876:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45689 00000100:00100000:3.0:1716999789.171901:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+622:11419:x1800404480723008:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.171910:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1716999789.171941:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45690 00000100:00100000:2.0:1716999789.171945:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+622:11420:x1800404480723072:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.171949:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.171956:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc6859 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f4a expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.171970:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc6859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f4a expref: 623 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.171978:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc6859 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f4a expref: 623 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.171994:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6860 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f43 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.172047:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6867 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172054:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6867 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172059:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6867 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.172142:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.172144:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.172146:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb58c0, rc 0) 00000100:00100000:2.0:1716999789.172178:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+624:11420:x1800404480723072:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 231us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.172184:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45690 00010000:00010000:3.0:1716999789.172224:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc686e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172230:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc686e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172236:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc686e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172269:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6867 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172274:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6867 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172282:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6867 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172286:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.172288:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6867 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172294:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6867 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172300:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.172302:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.172304:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6867 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172307:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde1c0/0x6d188eabd8dc6867 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172422:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc686e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172426:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc686e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172431:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc686e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172434:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdcd80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.172436:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc686e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172440:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc686e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172447:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x640c9ef0 (ffff88012e3f8d00) 00010000:00010000:3.0:1716999789.172449:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.172451:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc686e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172454:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcd80/0x6d188eabd8dc686e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.172475:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6860 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f43 expref: 623 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.172482:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd680/0x6d188eabd8dc6860 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f43 expref: 623 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.172487:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdd680, rc 0) 00000100:00100000:3.0:1716999789.172519:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+622:11419:x1800404480723008:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 617us (816us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.172525:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45689 00000100:00100000:0.0:1716999789.173681:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.174014:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480723136 00000100:00100000:2.0:1716999789.174020:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480723136 00000100:00100000:2.0:1716999789.174041:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9125 00000100:00100000:2.0:1716999789.174046:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec20450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+622:11420:x1800404480723136:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999789.175959:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.176049:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480723200 00000100:00100000:3.0:1716999789.176055:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480723200 00000100:00100000:3.0:1716999789.176085:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45691 00000100:00100000:3.0:1716999789.176090:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+624:11419:x1800404480723200:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.176099:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.176110:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6875 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f51 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.176150:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc687c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176163:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc687c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176170:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc687c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176180:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6883 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176185:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176191:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176236:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc687c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176241:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc687c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176245:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc687c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176249:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.176251:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc687c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176256:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc687c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176264:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.176266:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.176268:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc687c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176272:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc480/0x6d188eabd8dc687c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176281:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6883 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176285:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6883 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176289:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6883 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176292:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdc000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.176294:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6883 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176298:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6883 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176303:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x63bf9fee (ffff88012e3f8100) 00010000:00010000:3.0:1716999789.176304:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.176306:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6883 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176310:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdc000/0x6d188eabd8dc6883 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.176339:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6875 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f51 expref: 625 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.176345:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfcc0/0x6d188eabd8dc6875 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f51 expref: 625 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.176352:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135bdfcc0, rc 0) 00000100:00100000:3.0:1716999789.176382:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+624:11419:x1800404480723200:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 292us (426us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.176387:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45691 00000100:00100000:3.0:1716999789.177208:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec20450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+622:11420:x1800404480723136:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3159us (3526us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.177215:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9125 00000100:00100000:0.0:1716999789.179037:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.179068:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.179104:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480723328 00000100:00100000:3.0:1716999789.179111:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480723328 00000100:00100000:3.0:1716999789.179140:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480723392 00000100:00100000:3.0:1716999789.179143:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480723392 00000100:00100000:3.0:1716999789.179154:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45692 00000100:00100000:3.0:1716999789.179160:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+623:11419:x1800404480723328:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.179171:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.179174:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1716999789.179189:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf840/0x6d188eabd8dc6748 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65eda expref: 623 pid: 11055 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999789.179189:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45693 00000100:00100000:2.0:1716999789.179195:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+623:11420:x1800404480723392:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.179202:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.179206:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.179209:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.179212:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc688a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f5f expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.179215:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6891 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f58 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.179242:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6898 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179251:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6898 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179257:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6898 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179265:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc689f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179270:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc689f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179274:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc689f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.179299:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc68a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.179302:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6898 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.179306:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc68a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.179306:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6898 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179310:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6898 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.179313:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc68a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.179314:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb61c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.179317:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6898 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.179321:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc68ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.179321:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6898 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.179326:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc68ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.179328:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.179330:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.179331:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc68ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.179333:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6898 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179336:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6898 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179345:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc689f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179349:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc689f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179352:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc689f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179355:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.179357:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc689f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179362:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc689f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179367:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xec6f74b7 (ffff8800990eaa00) 00010000:00010000:2.0:1716999789.179369:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.179370:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc689f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179375:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc689f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0xec6f74b7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.179401:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc688a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f5f expref: 624 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.179407:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc688a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f5f expref: 624 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.179414:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb7a80, rc 0) 00000100:00100000:2.0:1716999789.179441:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+623:11420:x1800404480723392:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 245us (372us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.179447:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45693 00000004:00080000:3.0:1716999789.179710:0:11055:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60d:0x0], index 0: 0 00000040:00080000:3.0:1716999789.179763:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11503, 184 off2057136 00010000:00010000:3.0:1716999789.179857:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc68b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.179864:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc68b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.179869:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc68b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.179907:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc68a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.179913:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc68a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.179918:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc68a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.179922:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bde400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.179925:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc68a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.179929:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc68a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.179936:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.179938:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.179940:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc68a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.179945:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde400/0x6d188eabd8dc68a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:3.0:1716999789.179952:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012b7f5500 reply state ffff88009a6da000 transno 4294986106 ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc68ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.179957:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999789.179972:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf600/0x6d188eabd8dc6891 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f58 expref: 624 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.179980:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc68b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f58 expref: 623 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.180520:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc52:0x0].0x0 (ffff88012e3f8200) 00010000:00010000:3.0:1716999789.180524:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999789.180526:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f8ef40, rc 0) 00000100:00100000:3.0:1716999789.181108:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+624:11419:x1800404480723328:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1946us (2072us total) trans 4294986106 rc 0/0 00000100:00100000:3.0:1716999789.181115:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45692 00000100:00100000:0.0:1716999789.181675:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.181780:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480723456 00000100:00100000:3.0:1716999789.181786:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480723456 00000100:00100000:3.0:1716999789.181820:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45694 00000100:00100000:3.0:1716999789.181825:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+624:11420:x1800404480723456:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.181836:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.181847:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc68c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f66 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.181908:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc68c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182012:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc68c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182020:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc68c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182030:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc68d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x9c159348 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182035:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc68d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182039:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc68d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182092:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc68c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182097:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc68c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182101:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc68c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182109:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.182111:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc68c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182117:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc68c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182124:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.182126:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.182129:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc68c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182133:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc68c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182141:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc68d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182145:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc68d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182149:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc68d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182153:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.182155:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc68d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182159:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc68d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182164:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x9c159348 (ffff8800b4877e00) 00010000:00010000:3.0:1716999789.182166:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.182168:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc68d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182171:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc68d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x9c159348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.182199:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc68c2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f66 expref: 625 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.182206:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ed00/0x6d188eabd8dc68c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f66 expref: 625 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.182211:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131f8ed00, rc 0) 00000100:00100000:3.0:1716999789.182235:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+624:11420:x1800404480723456:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 409us (560us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.182240:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45694 00010000:00010000:0.0:1716999789.182566:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc68ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.182573:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc68ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.182577:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc68ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.182580:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880135bdd200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.182582:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc68ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.182586:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc68ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.182593:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x63bf9fee (ffff88012e3f8900) 00010000:00010000:0.0:1716999789.182595:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.182598:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc68ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.182601:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdd200/0x6d188eabd8dc68ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.183980:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.184059:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480723520 00000100:00100000:2.0:1716999789.184065:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480723520 00000100:00100000:2.0:1716999789.184091:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10048 00000100:00100000:2.0:1716999789.184097:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480723520:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.184108:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.184122:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc68d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f6d expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999789.184141:0:17365:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x60d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999789.184155:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.184157:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.184162:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc68d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f6d expref: 79 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.184173:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc68d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f6d expref: 79 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.184182:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb4900, rc 0) 00000100:00100000:2.0:1716999789.184217:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480723520:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 120us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.184224:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10048 00000100:00100000:0.0:1716999789.186153:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.186281:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480723648 00000100:00100000:3.0:1716999789.186288:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480723648 00000100:00100000:3.0:1716999789.186329:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9126 00000100:00100000:3.0:1716999789.186335:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+623:11419:x1800404480723648:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999789.186663:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11504, 168 off2057304 00000001:00080000:3.0:1716999789.186669:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986107 00000100:00100000:3.0:1716999789.186749:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+625:11419:x1800404480723648:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 413us (598us total) trans 4294986108 rc 0/0 00000100:00100000:3.0:1716999789.186755:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9126 00000020:00080000:3.0:1716999789.186758:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.188519:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.188559:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480723776 00000100:00100000:2.0:1716999789.188564:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480723776 00000100:00100000:2.0:1716999789.188597:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45695 00000100:00100000:2.0:1716999789.188602:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+625:11419:x1800404480723776:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.188614:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.188626:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc68de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f74 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.188676:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc68e5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.188685:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc68e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc52:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.188691:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc68e5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc52:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:2.0:1716999789.188698:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc52:0x0]: returning size 0 00010000:00010000:2.0:1716999789.188774:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc68de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f74 expref: 628 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.189223:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc68e5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc52:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f74 expref: 627 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.189230:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc52:0x0].0x0 (ffff88012e3f8200) 00010000:00010000:2.0:1716999789.189232:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999789.189234:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb6880, rc 0) 00000100:00100000:2.0:1716999789.189267:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+627:11419:x1800404480723776:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 665us (750us total) trans 4294986109 rc 0/0 00000100:00100000:2.0:1716999789.189273:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45695 00000100:00100000:0.0:1716999789.190951:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.191001:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480723840 00000100:00100000:2.0:1716999789.191006:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480723840 00000100:00100000:2.0:1716999789.191042:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10049 00000100:00100000:2.0:1716999789.191048:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+79:11419:x1800404480723840:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.191057:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.191068:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f7b expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.191086:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc68d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f6d expref: 80 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.191092:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.191093:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.191096:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f7b expref: 80 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.191118:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc68d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f6d expref: 80 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.191128:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc68d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f6d expref: 80 pid: 17365 timeout: 408 lvb_type: 1 00000100:00100000:2.0:1716999789.191138:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483015296:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999789.191183:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008eaf5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1716999789.192162:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.192203:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480723968 00000100:00100000:2.0:1716999789.192208:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480723968 00000100:00100000:2.0:1716999789.192244:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9127 00000100:00100000:2.0:1716999789.192249:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+627:11420:x1800404480723968:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999789.192586:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11505, 168 off2057472 00000001:00080000:2.0:1716999789.192591:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986110 00000100:00100000:2.0:1716999789.192668:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+629:11420:x1800404480723968:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 417us (506us total) trans 4294986111 rc 0/0 00000100:00100000:2.0:1716999789.192674:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9127 00000020:00080000:2.0:1716999789.192678:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.193032:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.193085:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724032 00000100:00100000:1.0:1716999789.193090:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724032 00010000:00010000:1.0:1716999789.193108:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc68d7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f6d expref: 81 pid: 17365 timeout: 408 lvb_type: 1 00000100:00100000:1.0:1716999789.193126:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4561 00000100:00100000:1.0:1716999789.193130:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+81:1959:x1800404480724032:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999789.193138:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999789.193152:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc68d7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f6d expref: 81 pid: 17365 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.193162:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc68d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f6d expref: 81 pid: 17365 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.193177:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.193179:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.193184:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f7b expref: 81 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.193190:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f7b expref: 81 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.193210:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f7b expref: 81 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999789.193219:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880088b2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483015360:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999789.193256:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e361300 going to sleep for 11 seconds 00010000:00010000:2.0:1716999789.193324:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008efb4900/0x6d188eabd8dc68d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f6d expref: 81 pid: 17365 timeout: 408 lvb_type: 1 00000100:00100000:2.0:1716999789.193334:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483015296:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999789.193349:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f7b expref: 80 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.193357:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb7840, rc 0) 00000100:00100000:2.0:1716999789.193385:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+80:11419:x1800404480723840:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2337us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.193392:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10049 00000100:00100000:0.0:1716999789.194862:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.194948:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880088b2c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483015360:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999789.194961:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999789.194983:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480724032:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1851us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.194990:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4561 00000100:00100000:2.0:1716999789.195049:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724160 00000100:00100000:2.0:1716999789.195055:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724160 00000100:00100000:2.0:1716999789.195123:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45696 00000100:00100000:2.0:1716999789.195128:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+629:11420:x1800404480724160:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.195157:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1716999789.195171:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9b00/0x6d188eabd8dc61fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc4a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d0c expref: 629 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.195186:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc61c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65cf0 expref: 628 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.195195:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4a:0x0].0x0 (ffff88008a83ff00) 00010000:00010000:2.0:1716999789.195207:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb58c0/0x6d188eabd8dc6859 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f4a expref: 627 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.195214:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.195217:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.195235:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc68fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195245:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc68fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195251:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc68fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195260:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6901 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195265:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195270:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195342:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6908 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195347:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6908 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195353:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6908 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:2.0:1716999789.195715:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1487, 64 off103424 00000040:00080000:2.0:1716999789.195732:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11506, 184 off2057656 00010000:00010000:2.0:1716999789.195779:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc690f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195785:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc690f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195790:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc690f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195796:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc690f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195801:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc690f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195822:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc690f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195827:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc690f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195831:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5f80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999789.195834:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc690f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195839:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc690f lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195845:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4a:0x0].0x0 (ffff8800990eab00) 00010000:00010000:2.0:1716999789.195847:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999789.195850:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc690f lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195853:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5f80/0x6d188eabd8dc690f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195872:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6908 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.195876:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6908 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.196426:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6908 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.196430:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb7a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.196433:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6908 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.196437:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6908 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.196443:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4a:0x0].0x0 (ffff8800990eab00) 00010000:00010000:2.0:1716999789.196445:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.196447:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6908 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.196451:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7a80/0x6d188eabd8dc6908 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.196485:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc68fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.196489:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc68fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.196493:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc68fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.196497:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb4480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.196498:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc68fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.196502:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc68fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.196507:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.196508:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.196510:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc68fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.196513:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4480/0x6d188eabd8dc68fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999789.196519:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012b7f6300 reply state ffff88012dbc3000 transno 4294986112 ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.196523:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.196567:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+628:11420:x1800404480724160:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1437us (1710us total) trans 4294986112 rc 0/0 00000100:00100000:2.0:1716999789.196573:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45696 00000100:00100000:0.0:1716999789.197025:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.197069:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724224 00000100:00100000:2.0:1716999789.197074:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724224 00000100:00100000:2.0:1716999789.197104:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45697 00000100:00100000:2.0:1716999789.197109:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+628:11419:x1800404480724224:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.197118:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.197129:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6916 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f82 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.197160:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc691d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.197168:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.197175:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:2.0:1716999789.197208:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x705:0x0]: returning size 12800 00000004:00200000:2.0:1716999789.197211:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999789.197220:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc691d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.197234:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb61c0/0x6d188eabd8dc6916 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f82 expref: 630 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.197243:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc691d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f82 expref: 629 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.197249:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.197252:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1716999789.197254:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb73c0, rc 0) 00000100:00100000:2.0:1716999789.197283:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+629:11419:x1800404480724224:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 173us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.197290:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45697 00010000:00010000:2.0:1716999789.197305:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6901 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.197314:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6901 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.197319:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6901 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.197366:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.197782:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6901 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.197789:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6901 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.197797:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x522b8500 (ffff8800990eaa00) 00010000:00010000:2.0:1716999789.197799:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.197801:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6901 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.197816:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5680/0x6d188eabd8dc6901 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x522b8500 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999789.200172:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.200238:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724352 00000100:00100000:3.0:1716999789.200244:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724352 00000100:00100000:3.0:1716999789.200287:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9128 00000100:00100000:3.0:1716999789.200293:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+628:11420:x1800404480724352:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999789.200520:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.200607:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724416 00000100:00100000:2.0:1716999789.200611:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724416 00000100:00100000:2.0:1716999789.200642:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45698 00000100:00100000:2.0:1716999789.200646:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11419:x1800404480724416:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.200654:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.200667:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6924 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f89 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00000040:00080000:3.0:1716999789.200690:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11507, 168 off2057824 00000001:00080000:3.0:1716999789.200696:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986113 00010000:00010000:2.0:1716999789.200701:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc692b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200712:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc692b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200725:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc692b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200736:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6932 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200741:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200745:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999789.200776:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+632:11420:x1800404480724352:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 481us (609us total) trans 4294986114 rc 0/0 00000100:00100000:3.0:1716999789.200782:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9128 00010000:00010000:2.0:1716999789.200785:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc692b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00000020:00080000:3.0:1716999789.200786:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1716999789.200790:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc692b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200795:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc692b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200800:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.200803:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc692b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200821:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc692b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200830:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.200832:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.200835:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc692b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200840:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5b00/0x6d188eabd8dc692b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200848:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6932 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200852:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6932 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200856:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200859:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb46c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.200861:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6932 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200865:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6932 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200870:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x52a89496 (ffff8800990eaf00) 00010000:00010000:2.0:1716999789.200872:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.200874:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6932 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200906:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb46c0/0x6d188eabd8dc6932 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.200938:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6924 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f89 expref: 631 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.200944:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7180/0x6d188eabd8dc6924 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f89 expref: 631 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.200952:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008efb7180, rc 0) 00000100:00100000:2.0:1716999789.200980:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11419:x1800404480724416:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 332us (460us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.200985:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45698 00000100:00100000:0.0:1716999789.201647:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.201685:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724544 00000100:00100000:2.0:1716999789.201689:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724544 00000100:00100000:2.0:1716999789.201730:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45699 00000100:00100000:2.0:1716999789.201734:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11420:x1800404480724544:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.201756:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999789.201766:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc634a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc4b:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d75 expref: 630 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.201778:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc632e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d67 expref: 629 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.201785:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4b:0x0].0x0 (ffff880092624d00) 00010000:00010000:2.0:1716999789.201791:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.201815:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6939 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.201823:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6939 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.201829:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6939 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.201837:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6940 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.201845:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.201850:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.201935:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc6947 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.201941:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc6947 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.201946:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc6947 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:2.0:1716999789.202276:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1488, 64 off103488 00000040:00080000:2.0:1716999789.202291:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11508, 184 off2058008 00010000:00010000:2.0:1716999789.202339:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc694e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202346:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc694e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202352:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc694e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202357:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc694e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202362:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc694e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202366:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc694e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202374:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc694e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202377:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb5d40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999789.202380:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc694e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202385:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc694e lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202391:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4b:0x0].0x0 (ffff88012de9c000) 00010000:00010000:2.0:1716999789.202392:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999789.202395:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc694e lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202399:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5d40/0x6d188eabd8dc694e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202413:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc6947 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202417:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc6947 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202421:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc6947 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202425:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb4b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.202427:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc6947 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202432:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc6947 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202441:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4b:0x0].0x0 (ffff88012de9c000) 00010000:00010000:2.0:1716999789.202443:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.202445:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc6947 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202449:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4b40/0x6d188eabd8dc6947 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202489:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6939 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202494:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6939 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202498:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6939 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202502:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb6ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.202504:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6939 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202508:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6939 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202514:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.202516:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.202518:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6939 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.202522:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6ac0/0x6d188eabd8dc6939 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999789.202529:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008eb8bb80 reply state ffff8800940ed000 transno 4294986115 ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.202534:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.202570:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11420:x1800404480724544:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 834us (922us total) trans 4294986115 rc 0/0 00000100:00100000:2.0:1716999789.202576:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45699 00000100:00100000:0.0:1716999789.202647:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.202693:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724608 00000100:00100000:3.0:1716999789.202697:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724608 00000100:00100000:3.0:1716999789.202722:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9129 00000100:00100000:3.0:1716999789.202726:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11419:x1800404480724608:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:1.0:1716999789.203246:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6940 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.203254:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6940 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.203260:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6940 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.203264:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88008efb6d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.203267:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6940 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.203272:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6940 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.203280:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x5a9c1470 (ffff8800990ea600) 00010000:00010000:1.0:1716999789.203282:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.203284:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6940 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.203289:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6d00/0x6d188eabd8dc6940 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x5a9c1470 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999789.203822:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.203976:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724672 00000100:00100000:2.0:1716999789.203980:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724672 00000100:00100000:2.0:1716999789.203997:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45700 00000100:00100000:2.0:1716999789.204001:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+631:11420:x1800404480724672:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.204010:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.204019:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc6955 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f90 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.204044:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc695c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204051:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc695c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204057:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc695c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204065:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6963 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204070:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204074:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204100:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc695c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204105:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc695c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204109:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc695c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204113:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.204115:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc695c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204120:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc695c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204127:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.204129:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.204131:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc695c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204135:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc695c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204141:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6963 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204145:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6963 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204150:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204153:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.204155:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6963 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204163:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6963 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204168:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x4f529a91 (ffff88012de9cb00) 00010000:00010000:2.0:1716999789.204170:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.204172:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6963 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204176:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.204201:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc6955 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f90 expref: 632 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.204207:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc6955 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f90 expref: 632 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.204213:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97600, rc 0) 00000100:00100000:2.0:1716999789.204242:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+631:11420:x1800404480724672:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 240us (421us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.204249:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45700 00000100:00100000:3.0:1716999789.205208:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+629:11419:x1800404480724608:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2478us (2559us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.205220:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9129 00000100:00100000:0.0:1716999789.205395:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.205453:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724736 00000100:00100000:2.0:1716999789.205457:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724736 00000100:00100000:2.0:1716999789.205530:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45701 00000100:00100000:2.0:1716999789.205535:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+629:11420:x1800404480724736:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.205543:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.205551:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc696a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f97 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.205572:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc696a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f97 expref: 630 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.205580:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc696a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f97 expref: 630 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.205586:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.205588:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.205590:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95f80, rc 0) 00000100:00100000:2.0:1716999789.205616:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+630:11420:x1800404480724736:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 80us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.205622:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45701 00000100:00100000:1.0:1716999789.207058:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.207133:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724800 00000100:00100000:3.0:1716999789.207138:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724800 00000100:00100000:3.0:1716999789.207163:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9130 00000100:00100000:3.0:1716999789.207167:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11420:x1800404480724800:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999789.209059:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec20050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11420:x1800404480724800:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 1886us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.209068:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9130 00000100:00100000:0.0:1716999789.209579:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.210099:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724864 00000100:00100000:3.0:1716999789.210108:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724864 00000100:00100000:3.0:1716999789.210166:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45702 00000100:00100000:3.0:1716999789.210172:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11419:x1800404480724864:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.210184:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.210197:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6971 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65f9e expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.210238:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6978 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.210248:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6978 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.210257:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6978 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.210266:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc697f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.210271:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc697f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.210277:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc697f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.210328:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6978 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.210333:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6978 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.210338:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6978 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.210343:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.210346:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6978 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.210352:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6978 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.210363:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.210366:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.210368:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6978 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.210372:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6978 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.211030:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc697f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.211036:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc697f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.211041:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc697f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.211046:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.211048:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc697f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.211053:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc697f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.211059:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6c9b575e (ffff8800b4877e00) 00010000:00010000:3.0:1716999789.211061:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.211064:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc697f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.211068:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc697f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.211105:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6971 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f9e expref: 631 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.211112:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6971 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f9e expref: 631 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.211118:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c53180, rc 0) 00000100:00100000:3.0:1716999789.211153:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11419:x1800404480724864:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 980us (1575us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.211159:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45702 00000100:00100000:1.0:1716999789.212645:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.212684:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724928 00000100:00100000:3.0:1716999789.212689:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724928 00000100:00100000:3.0:1716999789.212851:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45703 00000100:00100000:3.0:1716999789.212857:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11420:x1800404480724928:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.212869:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.212986:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc6986 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65fa5 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.213099:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc698d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213110:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc698d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213116:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc698d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213126:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213131:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213135:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213178:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc698d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213183:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc698d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213188:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc698d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213192:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.213194:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc698d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213200:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc698d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213207:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.213209:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.213211:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc698d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213215:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc698d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213226:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213231:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6994 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213236:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213239:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.213242:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213246:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6994 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213251:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x4f529a91 (ffff880135ac4c00) 00010000:00010000:0.0:1716999789.213253:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.213255:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6994 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213259:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x4f529a91 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.213284:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc6986 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fa5 expref: 631 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.213291:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc6986 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fa5 expref: 631 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.213297:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c53cc0, rc 0) 00000100:00100000:0.0:1716999789.213651:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11420:x1800404480724928:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 793us (1006us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999789.213660:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45703 00000100:00100000:0.0:1716999789.214354:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.214718:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480724992 00000100:00100000:2.0:1716999789.214723:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480724992 00000100:00100000:2.0:1716999789.214751:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45704 00000100:00100000:2.0:1716999789.214756:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11419:x1800404480724992:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.214765:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.214775:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc699b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65fac expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.214801:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc69a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214823:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc69a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214831:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc69a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214841:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc69a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6ce85660 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214846:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc69a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214852:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc69a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214904:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc69a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214910:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc69a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214915:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc69a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214919:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.214921:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc69a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214927:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc69a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214934:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.214936:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.214939:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc69a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214944:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc69a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214965:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc69a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214971:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc69a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214975:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc69a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214979:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.214981:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc69a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214986:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc69a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.214995:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6ce85660 (ffff88009a3d8100) 00010000:00010000:2.0:1716999789.214997:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.214999:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc69a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.215004:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc69a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.215098:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc699b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fac expref: 631 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.215105:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc699b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fac expref: 631 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.215113:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97600, rc 0) 00000100:00100000:2.0:1716999789.215145:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11419:x1800404480724992:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 388us (793us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.215151:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45704 00000100:00100000:0.0:1716999789.217756:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.217829:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480725120 00000100:00100000:2.0:1716999789.217835:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480725120 00000100:00100000:2.0:1716999789.217857:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45705 00000100:00100000:2.0:1716999789.217862:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+630:11419:x1800404480725120:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.217873:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.217875:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1716999789.217907:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb73c0/0x6d188eabd8dc691d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f82 expref: 630 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.217918:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.217922:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.217930:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc69b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65fb3 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.218007:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc69b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218016:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc69b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218023:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc69b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218031:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc69be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218036:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc69be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218045:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc69be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:2.0:1716999789.218389:0:6823:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60e:0x0], index 1: 0 00000040:00080000:2.0:1716999789.218444:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11509, 184 off2058192 00010000:00010000:2.0:1716999789.218525:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc69c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218532:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc69c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218537:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc69c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218557:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc69b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218562:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc69b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218567:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc69b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218571:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.218574:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc69b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218585:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc69b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218592:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.218594:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.218597:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc69b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.218601:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc69b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999789.218608:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008eb8b480 reply state ffff880090b17000 transno 4294986116 ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc69be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.218613:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999789.218629:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc69b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fb3 expref: 632 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.218637:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc69c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fb3 expref: 631 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.218642:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc53:0x0].0x0 (ffff88012de9cb00) 00010000:00010000:2.0:1716999789.218644:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999789.218646:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c961c0, rc 0) 00000100:00100000:2.0:1716999789.218695:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+632:11419:x1800404480725120:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 832us (943us total) trans 4294986116 rc 0/0 00000100:00100000:2.0:1716999789.218701:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45705 00010000:00010000:2.0:1716999789.220012:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc69be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.220022:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc69be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.220028:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc69be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.220032:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.220035:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc69be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.220040:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc69be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.220049:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6c9b575e (ffff88012de9c000) 00010000:00010000:2.0:1716999789.220051:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.220054:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc69be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.220058:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc69be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999789.220160:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.220220:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480725184 00000100:00100000:2.0:1716999789.220225:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480725184 00000100:00100000:2.0:1716999789.220254:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10050 00000100:00100000:2.0:1716999789.220259:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+76:1959:x1800404480725184:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.220268:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.220279:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090c96d00/0x6d188eabd8dc69d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65fba expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999789.220295:0:17365:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x60e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999789.220307:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.220309:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.220315:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c96d00/0x6d188eabd8dc69d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fba expref: 77 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.220325:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090c96d00/0x6d188eabd8dc69d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fba expref: 77 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.220336:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96d00, rc 0) 00000100:00100000:2.0:1716999789.220365:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480725184:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 105us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.220371:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10050 00000100:00100000:1.0:1716999789.220955:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.221113:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480725248 00000100:00100000:2.0:1716999789.221117:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480725248 00000100:00100000:2.0:1716999789.221144:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45706 00000100:00100000:2.0:1716999789.221149:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+631:11420:x1800404480725248:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.221159:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.221167:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc69da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65fc1 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.221197:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc69e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221206:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc69e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221212:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc69e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221221:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc69e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221227:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc69e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221232:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc69e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221278:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc69e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221283:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc69e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221287:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc69e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221291:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.221294:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc69e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221299:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc69e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221305:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.221307:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.221310:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc69e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221314:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc69e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221321:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc69e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221325:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc69e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221329:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc69e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221336:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.221338:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc69e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221343:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc69e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221348:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x63bf9fee (ffff8800923b8d00) 00010000:00010000:2.0:1716999789.221350:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.221351:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc69e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221355:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc69e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.221377:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc69da lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fc1 expref: 632 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.221384:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc69da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fc1 expref: 632 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.221390:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94480, rc 0) 00000100:00100000:2.0:1716999789.221421:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+631:11420:x1800404480725248:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 271us (466us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.221426:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45706 00000100:00100000:0.0:1716999789.223482:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.223520:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.223565:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480725440 00000100:00100000:3.0:1716999789.223572:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480725440 00000100:00100000:3.0:1716999789.223595:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45707 00000100:00100000:3.0:1716999789.223601:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+631:11420:x1800404480725440:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.223612:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.223623:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc69ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65fc8 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999789.223655:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480725376 00010000:00010000:3.0:1716999789.223656:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc69f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.223659:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480725376 00010000:00010000:3.0:1716999789.223665:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc69f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223673:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc69f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.223678:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9131 00010000:00010000:3.0:1716999789.223682:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc69fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.223682:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+633:11419:x1800404480725376:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:3.0:1716999789.223687:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc69fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223691:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc69fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223748:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc69f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223753:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc69f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223758:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc69f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223762:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.223765:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc69f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223770:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc69f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223783:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.223786:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.223788:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc69f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223792:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc69f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223815:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc69fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223820:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc69fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223824:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc69fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223827:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.223830:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc69fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223834:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc69fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223840:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x640c9ef0 (ffff8800b4877e00) 00010000:00010000:3.0:1716999789.223842:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.223844:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc69fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223848:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc69fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.223897:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc69ef lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fc8 expref: 634 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.223905:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc69ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fc8 expref: 634 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.223912:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c52ac0, rc 0) 00000100:00100000:3.0:1716999789.223951:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+633:11420:x1800404480725440:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 349us (429us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.223957:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45707 00000040:00080000:2.0:1716999789.224006:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11510, 168 off2058360 00000001:00080000:2.0:1716999789.224010:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986117 00000100:00100000:2.0:1716999789.224073:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+633:11419:x1800404480725376:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 390us (596us total) trans 4294986118 rc 0/0 00000100:00100000:2.0:1716999789.224079:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9131 00000020:00080000:2.0:1716999789.224082:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.225824:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.225857:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.225895:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480725632 00000100:00100000:2.0:1716999789.225901:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480725632 00000100:00100000:2.0:1716999789.225923:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480725696 00000100:00100000:2.0:1716999789.225925:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480725696 00000100:00100000:3.0:1716999789.225935:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45708 00000100:00100000:3.0:1716999789.225941:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+634:11420:x1800404480725632:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:2.0:1716999789.225941:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45709 00000100:00100000:2.0:1716999789.225946:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+634:11419:x1800404480725696:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.225958:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.225964:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.225969:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6a04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65fd6 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.225972:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc6a0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65fcf expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.226016:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6a12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.226024:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6a12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc53:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.226029:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6a19 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.226031:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6a12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc53:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.226036:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00000004:00200000:2.0:1716999789.226038:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc53:0x0]: returning size 0 00010000:00010000:3.0:1716999789.226041:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226049:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6a20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226054:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226058:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226084:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6a19 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226088:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6a19 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226096:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226099:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.226101:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6a19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.226102:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6a04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fd6 expref: 638 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.226105:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6a19 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226111:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.226113:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.226113:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6a12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc53:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fd6 expref: 637 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.226115:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6a19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226119:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6a19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.226120:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc53:0x0].0x0 (ffff88012de9cb00) 00010000:00010000:2.0:1716999789.226122:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999789.226124:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94900, rc 0) 00010000:00010000:3.0:1716999789.226125:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6a20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226129:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6a20 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226133:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226136:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.226138:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6a20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226142:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6a20 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.226148:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x640c9ef0 (ffff8800b4877900) 00010000:00010000:3.0:1716999789.226150:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.226152:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6a20 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.226153:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+637:11419:x1800404480725696:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 206us (295us total) trans 4294986119 rc 0/0 00010000:00010000:3.0:1716999789.226156:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6a20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.226159:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45709 00010000:00010000:3.0:1716999789.226174:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc6a0b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fcf expref: 636 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.226181:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc6a0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fcf expref: 636 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.226187:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c53cc0, rc 0) 00000100:00100000:3.0:1716999789.226204:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+635:11420:x1800404480725632:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 263us (383us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.226210:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45708 00000100:00100000:0.0:1716999789.228040:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.228245:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480725760 00000100:00100000:2.0:1716999789.228250:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480725760 00000100:00100000:2.0:1716999789.228284:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10051 00000100:00100000:2.0:1716999789.228288:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+77:11419:x1800404480725760:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.228298:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.228311:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65fdd expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.228329:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c96d00/0x6d188eabd8dc69d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fba expref: 78 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.228336:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.228338:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.228340:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fdd expref: 78 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.228362:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090c96d00/0x6d188eabd8dc69d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fba expref: 78 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.228371:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090c96d00/0x6d188eabd8dc69d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fba expref: 78 pid: 17365 timeout: 408 lvb_type: 1 00000100:00100000:2.0:1716999789.228382:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483015424:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999789.228416:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008eaf56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1716999789.228877:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.228999:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480725824 00000100:00100000:3.0:1716999789.229004:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480725824 00000100:00100000:0.0:1716999789.229606:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45710 00000100:00100000:0.0:1716999789.229613:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+635:11420:x1800404480725824:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.229624:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.229634:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6a35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65fe4 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.229667:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6a3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.229677:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6a3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.229685:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6a3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.229693:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6a43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.229699:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.229707:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.229752:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6a3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.229756:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6a3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.229762:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6a3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.229766:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.229769:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6a3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.229774:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6a3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.229782:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.229784:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.229787:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6a3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.229792:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6a3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.230433:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6a43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.230439:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6a43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.230444:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.230449:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.230451:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6a43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.230460:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6a43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.230467:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x63bf9fee (ffff880135ac4800) 00010000:00010000:0.0:1716999789.230470:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.230472:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6a43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.230476:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6a43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999789.230508:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999789.230511:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6a35 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fe4 expref: 636 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.230517:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6a35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fe4 expref: 636 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.230523:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130b40, rc 0) 00000100:00100000:1.0:1716999789.230525:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480725888 00000100:00100000:1.0:1716999789.230529:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480725888 00010000:00010000:1.0:1716999789.230544:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090c96d00/0x6d188eabd8dc69d3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fba expref: 79 pid: 17365 timeout: 408 lvb_type: 1 00000100:00100000:0.0:1716999789.230551:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+635:11420:x1800404480725824:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 938us (1674us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999789.230557:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45710 00000100:00100000:1.0:1716999789.230566:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4562 00000100:00100000:1.0:1716999789.230571:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+79:1958:x1800404480725888:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999789.230578:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999789.230592:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090c96d00/0x6d188eabd8dc69d3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fba expref: 79 pid: 17365 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.230600:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090c96d00/0x6d188eabd8dc69d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fba expref: 79 pid: 17365 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.230613:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.230615:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.230619:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fdd expref: 79 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.230626:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fdd expref: 79 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.230646:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fdd expref: 79 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999789.230655:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880088b2d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483015488:192.168.203.3@tcp:105: 00010000:00010000:2.0:1716999789.230710:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090c96d00/0x6d188eabd8dc69d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fba expref: 79 pid: 17365 timeout: 408 lvb_type: 1 00000100:00100000:2.0:1716999789.230721:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483015424:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999789.230734:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fdd expref: 78 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.230741:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95b00, rc 0) 00000100:00100000:2.0:1716999789.230769:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+78:11419:x1800404480725760:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 2480us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.230775:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10051 00000100:00100000:1.0:1716999789.231029:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e361300 going to sleep for 11 seconds 00000100:00100000:3.0:1716999789.232041:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.232073:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480726016 00000100:00100000:0.0:1716999789.232078:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480726016 00000100:00100000:0.0:1716999789.232112:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45711 00000100:00100000:0.0:1716999789.232117:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+635:11420:x1800404480726016:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.232128:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.232138:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6a4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65feb expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.232193:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6a51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232202:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6a51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232209:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6a51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232218:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6a58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232229:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232234:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232259:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6a51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232264:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6a51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232268:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6a51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232273:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.232276:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6a51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232281:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6a51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232288:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.232290:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.232293:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6a51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232297:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6a51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232305:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6a58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232309:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6a58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232313:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232316:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.232319:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6a58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232323:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6a58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232327:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x63bf9fee (ffff880135ac4c00) 00010000:00010000:0.0:1716999789.232329:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.232331:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6a58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232335:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6a58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.232353:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6a4a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65feb expref: 636 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.232359:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6a4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65feb expref: 636 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.232365:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131f80, rc 0) 00000100:00100000:0.0:1716999789.232400:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+635:11420:x1800404480726016:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 282us (360us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999789.232405:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45711 00000100:00100000:0.0:1716999789.235924:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.236533:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880088b2d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483015488:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999789.236549:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999789.236595:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+77:1958:x1800404480725888:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 6023us (6087us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.236604:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4562 00000100:00100000:0.0:1716999789.236855:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.236917:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480726080 00000100:00100000:0.0:1716999789.236923:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480726080 00000100:00100000:0.0:1716999789.236945:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480726144 00000100:00100000:0.0:1716999789.236947:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480726144 00000100:00100000:2.0:1716999789.236958:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45712 00000100:00100000:0.0:1716999789.236964:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45713 00000100:00100000:2.0:1716999789.236965:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+636:11419:x1800404480726080:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:0.0:1716999789.236969:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+636:11420:x1800404480726144:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.236979:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.236980:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.236994:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6a5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ff2 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.236994:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6a66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f65ff9 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.237033:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6a6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.237034:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6a74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.237043:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6a6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.237043:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6a74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.237052:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6a6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.237052:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6a74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.237061:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6a82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.237062:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6a7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.237066:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.237066:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.237070:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.237071:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.237124:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6a74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.237126:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6a6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.237130:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6a74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.237131:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6a6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.237135:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6a74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.237136:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6a6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.237140:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.237140:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.237143:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6a74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.237148:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6a74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.237156:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.237158:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.237161:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6a74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.237165:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6a74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.237178:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6a7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.237183:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6a7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.237188:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.237192:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.237194:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6a7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.237199:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6a7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.237201:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6a6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.237203:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x640c9ef0 (ffff8800990eaf00) 00010000:00010000:0.0:1716999789.237205:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.237206:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6a7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.237207:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6a6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.237210:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6a7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.237213:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.237215:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.237218:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6a6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.237222:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6a6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.237230:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6a82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.237235:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6a82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.237238:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.237238:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6a66 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ff9 expref: 638 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.237242:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c973c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.237244:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6a82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.237245:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6a66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ff9 expref: 638 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.237247:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6a82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.237252:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x54f6b75a (ffff8800923b8a00) 00010000:00010000:0.0:1716999789.237252:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131d40, rc 0) 00010000:00010000:2.0:1716999789.237253:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.237255:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6a82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.237259:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6a82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.237285:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6a5f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ff2 expref: 637 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999789.237288:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+637:11420:x1800404480726144:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 318us (433us total) trans 0 rc 301/301 00010000:00010000:2.0:1716999789.237292:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6a5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ff2 expref: 637 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999789.237294:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45713 00010000:00010000:2.0:1716999789.237298:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96880, rc 0) 00000100:00100000:2.0:1716999789.237316:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+635:11419:x1800404480726080:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 352us (1399us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.237322:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45712 00000100:00100000:0.0:1716999789.241976:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.242022:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.242044:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480726208 00000100:00100000:2.0:1716999789.242051:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480726208 00000100:00100000:2.0:1716999789.242079:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480726336 00000100:00100000:2.0:1716999789.242080:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480726336 00000100:00100000:2.0:1716999789.242092:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45714 00000100:00100000:2.0:1716999789.242098:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+636:11419:x1800404480726208:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.242112:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.242126:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc6a89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66000 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.242149:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc6a89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66000 expref: 637 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.242159:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc6a89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66000 expref: 637 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.242165:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.242167:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.242169:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94480, rc 0) 00000100:00100000:1.0:1716999789.242182:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45715 00000100:00100000:1.0:1716999789.242189:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+637:11420:x1800404480726336:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.242198:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.242206:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6a90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66007 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999789.242210:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+637:11419:x1800404480726208:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 112us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.242215:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45714 00010000:00010000:1.0:1716999789.242278:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6a97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242287:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6a97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242295:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6a97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242304:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc6a9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242309:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc6a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242314:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc6a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242345:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6a97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242355:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6a97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242360:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6a97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242365:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.242368:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6a97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242373:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6a97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242382:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.242384:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.242387:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6a97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242391:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6a97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242827:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc6a9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242834:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc6a9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242838:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc6a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242842:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216fa80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.242844:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc6a9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242851:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc6a9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242857:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x640c9ef0 (ffff88008a83f100) 00010000:00010000:1.0:1716999789.242859:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.242861:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc6a9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242865:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fa80/0x6d188eabd8dc6a9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x640c9ef0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.242911:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6a90 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66007 expref: 637 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.242918:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f840/0x6d188eabd8dc6a90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66007 expref: 637 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.242923:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216f840, rc 0) 00000100:00100000:1.0:1716999789.242951:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+636:11420:x1800404480726336:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 762us (929us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999789.242956:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45715 00000100:00100000:0.0:1716999789.245184:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.245250:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480726400 00000100:00100000:2.0:1716999789.245257:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480726400 00000100:00100000:0.0:1716999789.245260:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.245293:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9132 00000100:00100000:2.0:1716999789.245299:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+636:11419:x1800404480726400:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999789.245450:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480726464 00000100:00100000:1.0:1716999789.245454:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480726464 00000100:00100000:1.0:1716999789.245472:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45716 00000100:00100000:1.0:1716999789.245476:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+637:11420:x1800404480726464:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.245483:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.245495:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6aa5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6600e expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.245533:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6aac lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245543:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245549:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245558:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc6ab3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245562:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc6ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245567:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc6ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245609:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6aac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245613:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6aac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245617:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245621:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216d440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.245623:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6aac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245628:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6aac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245638:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.245640:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.245643:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6aac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245647:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d440/0x6d188eabd8dc6aac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245654:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc6ab3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245658:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc6ab3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245662:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc6ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245665:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.245667:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc6ab3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245670:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc6ab3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245674:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x63bf9fee (ffff88008a83f600) 00010000:00010000:1.0:1716999789.245675:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.245677:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc6ab3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245680:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e1c0/0x6d188eabd8dc6ab3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.245702:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6aa5 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6600e expref: 638 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.245708:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d8c0/0x6d188eabd8dc6aa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6600e expref: 638 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.245714:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216d8c0, rc 0) 00000100:00100000:1.0:1716999789.245754:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+637:11420:x1800404480726464:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 276us (492us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999789.245759:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45716 00000100:00100000:3.0:1716999789.247504:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.247561:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480726592 00000100:00100000:1.0:1716999789.247566:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480726592 00000100:00100000:1.0:1716999789.247591:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45717 00000100:00100000:1.0:1716999789.247596:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+637:11420:x1800404480726592:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.247605:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.247607:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999789.247620:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc696a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f97 expref: 637 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.247630:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.247632:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.247638:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc6aba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66015 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.247703:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6ac1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.247710:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.247715:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.247723:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6ac8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.247727:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.247732:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999789.247786:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+637:11419:x1800404480726400:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2486us (2606us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.247792:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9132 00000004:00080000:1.0:1716999789.248182:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60e:0x0], index 0: 0 00000040:00080000:1.0:1716999789.248243:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11511, 184 off2058544 00010000:00010000:1.0:1716999789.248331:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc6acf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.248338:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc6acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.248344:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc6acf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.248365:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6ac1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.248370:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6ac1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.248373:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6ac1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.248377:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216c240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.248379:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6ac1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.248387:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6ac1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.248393:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.248395:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.248397:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6ac1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.248400:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c240/0x6d188eabd8dc6ac1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:1.0:1716999789.248407:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099447100 reply state ffff8800b536f000 transno 4294986120 ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999789.248411:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999789.248426:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216fcc0/0x6d188eabd8dc6aba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66015 expref: 638 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.248434:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc6acf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc54:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66015 expref: 637 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.248438:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc54:0x0].0x0 (ffff88008a83fb00) 00010000:00010000:1.0:1716999789.248440:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999789.248441:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c480, rc 0) 00000100:00100000:1.0:1716999789.248730:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+638:11420:x1800404480726592:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1132us (1228us total) trans 4294986120 rc 0/0 00000100:00100000:1.0:1716999789.248735:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45717 00010000:00010000:1.0:1716999789.249663:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6ac8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.249673:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6ac8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.249677:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6ac8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.249680:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216f3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.249682:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6ac8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.249687:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6ac8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.249694:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x63bf9fee (ffff88008a83f200) 00010000:00010000:1.0:1716999789.249696:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.249698:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6ac8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.249702:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f3c0/0x6d188eabd8dc6ac8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999789.251256:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.251340:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.251416:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480726656 00000100:00100000:2.0:1716999789.251422:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480726656 00000100:00100000:1.0:1716999789.251506:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480726720 00000100:00100000:1.0:1716999789.251510:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480726720 00000100:00100000:1.0:1716999789.251537:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45718 00000100:00100000:1.0:1716999789.251542:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+637:11419:x1800404480726720:12345-192.168.203.3@tcp:101:dbench.0 00000100:00100000:2.0:1716999789.251551:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10052 00000100:00100000:2.0:1716999789.251555:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480726656:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.251558:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.251561:0:17365:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.251571:0:17365:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6ae4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6601c expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.251571:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6add lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66023 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999789.251586:0:17365:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x60e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999789.251595:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.251597:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.251602:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6ae4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6601c expref: 80 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999789.251607:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6aeb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.251611:0:17365:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6ae4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6601c expref: 80 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999789.251616:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6aeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.251619:0:17365:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94b40, rc 0) 00010000:00010000:1.0:1716999789.251622:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6aeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251630:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6af2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251634:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251638:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999789.251649:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:107d663a-2216-406b-94c6-b2fcb1558728+80:1959:x1800404480726656:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 92us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.251654:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10052 00010000:00010000:1.0:1716999789.251683:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6aeb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251689:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6aeb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251693:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6aeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251697:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216eac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.251699:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6aeb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251704:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6aeb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251712:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.251714:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.251717:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6aeb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251721:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216eac0/0x6d188eabd8dc6aeb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251729:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6af2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251734:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6af2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251738:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6af2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251742:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009216e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.251744:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6af2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251748:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6af2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251754:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x54f6b75a (ffff88008a83f300) 00010000:00010000:1.0:1716999789.251756:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.251757:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6af2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251762:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e640/0x6d188eabd8dc6af2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.251791:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6add lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66023 expref: 638 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.251797:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c6c0/0x6d188eabd8dc6add lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66023 expref: 638 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.251816:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009216c6c0, rc 0) 00000100:00100000:1.0:1716999789.251837:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+637:11419:x1800404480726720:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 295us (497us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999789.251843:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45718 00000100:00100000:3.0:1716999789.254862:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.255035:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480726848 00000100:00100000:0.0:1716999789.255042:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480726848 00000100:00100000:0.0:1716999789.255070:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9133 00000100:00100000:0.0:1716999789.255076:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+637:11420:x1800404480726848:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999789.255413:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11512, 168 off2058712 00000001:00080000:0.0:1716999789.255420:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986121 00000100:00100000:0.0:1716999789.255488:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+639:11420:x1800404480726848:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 411us (632us total) trans 4294986122 rc 0/0 00000100:00100000:0.0:1716999789.255493:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9133 00000020:00080000:0.0:1716999789.255497:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.256708:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.256795:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480726912 00000100:00100000:1.0:1716999789.256801:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480726912 00000100:00100000:1.0:1716999789.257031:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45719 00000100:00100000:1.0:1716999789.257037:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+639:11419:x1800404480726912:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.257049:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.257063:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc6af9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6602a expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.257102:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6b00 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257112:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6b00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257121:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6b00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257131:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc6b07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257136:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc6b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257814:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc6b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257867:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6b00 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257873:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6b00 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257890:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6b00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257896:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8801339f8240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.257899:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6b00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257905:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6b00 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257915:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.257918:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.257921:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6b00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257925:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6b00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257933:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc6b07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257937:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc6b07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257941:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc6b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257948:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8801339fba80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.257949:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc6b07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257953:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc6b07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257958:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6cad4e9d (ffff88008a83ff00) 00010000:00010000:1.0:1716999789.257960:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.257961:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc6b07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257965:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fba80/0x6d188eabd8dc6b07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.257994:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc6af9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6602a expref: 640 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.258000:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc6af9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6602a expref: 640 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.258007:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801339f9f80, rc 0) 00000100:00100000:1.0:1716999789.258728:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+639:11419:x1800404480726912:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1689us (2020us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999789.258734:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45719 00000100:00100000:0.0:1716999789.259239:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.259362:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480727040 00000100:00100000:1.0:1716999789.259368:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480727040 00000100:00100000:1.0:1716999789.259395:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45720 00000100:00100000:1.0:1716999789.259400:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+639:11420:x1800404480727040:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.259414:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.259425:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6b0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66031 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.259476:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc6b15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.259484:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc6b15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc54:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.259491:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc6b15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc54:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:1.0:1716999789.259498:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc54:0x0]: returning size 0 00010000:00010000:1.0:1716999789.259579:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6b0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66031 expref: 642 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.259589:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc6b15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc54:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66031 expref: 641 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.259594:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc54:0x0].0x0 (ffff88008a83fb00) 00010000:00010000:1.0:1716999789.259597:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1716999789.259598:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a8900240, rc 0) 00000100:00100000:1.0:1716999789.259633:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+641:11420:x1800404480727040:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 232us (395us total) trans 4294986123 rc 0/0 00000100:00100000:1.0:1716999789.259639:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45720 00000100:00100000:3.0:1716999789.261135:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.261188:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480727104 00000100:00100000:0.0:1716999789.261192:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480727104 00000100:00100000:0.0:1716999789.262035:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45721 00000100:00100000:0.0:1716999789.262042:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+641:11419:x1800404480727104:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.262056:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.262069:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6b23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66038 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.262102:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262111:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262118:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262126:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262131:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262135:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262184:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262190:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262195:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262199:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.262202:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262208:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262216:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999789.262218:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.262221:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262225:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262233:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262237:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262241:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262244:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.262246:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262250:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262254:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6cfa4d9f (ffff8800990eaf00) 00010000:00010000:0.0:1716999789.262255:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.262257:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262260:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.262281:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6b23 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66038 expref: 642 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.262288:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6b23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66038 expref: 642 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.262294:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133840, rc 0) 00000100:00100000:0.0:1716999789.262334:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+641:11419:x1800404480727104:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 293us (1201us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999789.262339:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45721 00000100:00100000:0.0:1716999789.264339:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.265362:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.265437:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480727168 00000100:00100000:2.0:1716999789.265445:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480727168 00000100:00100000:2.0:1716999789.265485:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10053 00000100:00100000:2.0:1716999789.265491:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+80:11420:x1800404480727168:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.265503:0:19196:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.265517:0:19196:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6603f expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.265538:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6ae4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6601c expref: 81 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.265544:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.265546:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.265549:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6603f expref: 81 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.265581:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6ae4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6601c expref: 81 pid: 17365 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.265591:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6ae4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6601c expref: 81 pid: 17365 timeout: 408 lvb_type: 1 00000100:00100000:2.0:1716999789.265601:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483015552:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999789.265650:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff88008eaf59c0 going to sleep for 11 seconds 00000100:00100000:1.0:1716999789.266450:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480727296 00000100:00100000:1.0:1716999789.266455:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480727296 00000100:00100000:1.0:1716999789.266478:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45722 00000100:00100000:1.0:1716999789.266483:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+641:11419:x1800404480727296:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.266495:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.266507:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc6b3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66046 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.266581:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6b46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266591:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6b46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266599:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6b46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266611:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc6b4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266616:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc6b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266621:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc6b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266652:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6b46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266658:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6b46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266663:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6b46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266667:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.266670:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6b46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266675:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6b46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266683:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.266685:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.266688:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6b46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266692:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6b46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266701:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc6b4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266705:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc6b4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266709:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc6b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266711:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.266713:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc6b4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266717:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc6b4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266721:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6cfa4d9f (ffff880094791d00) 00010000:00010000:1.0:1716999789.266723:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.266725:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc6b4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266728:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365b00/0x6d188eabd8dc6b4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.266748:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc6b3f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66046 expref: 642 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.266754:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc6b3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66046 expref: 642 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.266761:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364d80, rc 0) 00000100:00100000:1.0:1716999789.267526:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+641:11419:x1800404480727296:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1040us (2163us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999789.267533:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45722 00000100:00100000:2.0:1716999789.269977:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483015552:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999789.270001:0:19196:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6603f expref: 81 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.270015:0:19196:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94fc0, rc 0) 00000100:00100000:2.0:1716999789.270046:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+81:11420:x1800404480727168:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 4554us (5709us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.270053:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10053 00000100:00100000:0.0:1716999789.270633:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.270721:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480727360 00000100:00100000:1.0:1716999789.270728:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480727360 00010000:00010000:1.0:1716999789.270757:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6ae4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6601c expref: 81 pid: 17365 timeout: 408 lvb_type: 1 00000100:00100000:1.0:1716999789.270788:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4563 00000100:00100000:1.0:1716999789.270793:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+81:1959:x1800404480727360:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999789.270815:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999789.270832:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6ae4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6601c expref: 81 pid: 17365 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.270841:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6ae4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6601c expref: 81 pid: 17365 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.270858:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6ae4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6601c expref: 81 pid: 17365 timeout: 408 lvb_type: 1 00010000:00010000:1.0:1716999789.270872:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.270874:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.270898:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6603f expref: 80 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.270906:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6603f expref: 80 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.270930:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6603f expref: 80 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999789.270940:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880088b2d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483015616:192.168.203.3@tcp:105: 00000100:00100000:1.0:1716999789.270981:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e361b40 going to sleep for 11 seconds 00000100:00100000:0.0:1716999789.271497:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.271549:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480727424 00000100:00100000:1.0:1716999789.271552:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480727424 00000100:00100000:1.0:1716999789.271572:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45723 00000100:00100000:1.0:1716999789.271576:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+641:11419:x1800404480727424:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.271588:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.271599:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6b54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6604d expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.271635:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6b5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271644:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6b5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271655:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6b5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271665:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6b62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271669:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271673:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271723:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6b5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271728:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6b5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271733:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6b5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271736:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.271739:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6b5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271744:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6b5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271751:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.271753:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.271756:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6b5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271760:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6b5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271768:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6b62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271773:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6b62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271777:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271780:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.271782:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6b62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271786:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6b62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271791:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6cad4e9d (ffff880094791900) 00010000:00010000:1.0:1716999789.271793:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.271795:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6b62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271798:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6b62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.271841:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6b54 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6604d expref: 642 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.271848:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6b54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6604d expref: 642 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.271854:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091366ac0, rc 0) 00000100:00100000:1.0:1716999789.274932:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+641:11419:x1800404480727424:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 3345us (3425us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999789.274942:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45723 00000100:00100000:3.0:1716999789.275837:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.275911:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480727488 00000100:00100000:0.0:1716999789.275917:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480727488 00000100:00100000:0.0:1716999789.275952:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45724 00000100:00100000:0.0:1716999789.275957:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+641:11420:x1800404480727488:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.275970:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.275983:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6b69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66054 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.276026:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.276037:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.276046:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:0.0:1716999789.276097:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x704:0x0]: returning size 12800 00000004:00200000:0.0:1716999789.276100:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999789.276112:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.276129:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6b69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66054 expref: 643 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.276144:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66054 expref: 642 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.276150:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.276153:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1716999789.276155:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131d40, rc 0) 00000100:00100000:0.0:1716999789.276190:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+642:11420:x1800404480727488:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 233us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.276195:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45724 00000100:00100000:1.0:1716999789.276448:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880088b2d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483015616:192.168.203.3@tcp:105: 00010000:00010000:1.0:1716999789.276464:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999789.277006:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+80:1959:x1800404480727360:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 6211us (6373us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.277014:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4563 00000100:00100000:3.0:1716999789.278394:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.278674:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480727616 00000100:00100000:2.0:1716999789.278681:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480727616 00000100:00100000:2.0:1716999789.278715:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45725 00000100:00100000:2.0:1716999789.278720:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+642:11419:x1800404480727616:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.278733:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1716999789.278758:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.278863:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480727680 00000100:00100000:0.0:1716999789.278868:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480727680 00010000:00010000:2.0:1716999789.278917:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc6b77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6605b expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999789.278920:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45726 00000100:00100000:0.0:1716999789.278926:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+643:11420:x1800404480727680:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.278933:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.278940:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66062 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.278967:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6b85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.278979:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6b85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.278986:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6b85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.278989:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6b8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.278996:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.278996:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6b93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.279000:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.279002:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.279005:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.279011:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6b9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.279016:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.279020:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.279040:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6b85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.279044:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6b8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.279045:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6b85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.279049:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6b8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.279050:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6b85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.279053:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.279054:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.279057:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6b85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.279058:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.279060:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6b8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.279062:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6b85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.279065:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6b8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.279070:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.279071:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999789.279072:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.279073:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.279076:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6b8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.279076:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6b85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.279079:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6b8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.279080:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6b85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.279087:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6b93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.279092:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6b93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.279096:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.279100:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.279102:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6b9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.279102:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6b93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.279106:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6b93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.279107:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6b9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.279111:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6b9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.279111:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x52a89496 (ffff8800990ea600) 00010000:00010000:0.0:1716999789.279112:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.279114:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6b93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.279115:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.279117:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6b93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x52a89496 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.279118:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6b9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.279122:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6b9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.279128:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6cad4e9d (ffff8800923b8800) 00010000:00010000:2.0:1716999789.279131:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.279133:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6b9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.279136:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94d80/0x6d188eabd8dc6b9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.279144:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b7e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66062 expref: 645 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.279151:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6b7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66062 expref: 645 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.279154:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc6b77 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6605b expref: 645 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.279158:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133cc0, rc 0) 00010000:00010000:2.0:1716999789.279160:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95d40/0x6d188eabd8dc6b77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6605b expref: 644 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.279167:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c95d40, rc 0) 00000100:00100000:0.0:1716999789.279198:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+643:11420:x1800404480727680:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 272us (439us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.279203:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+643:11419:x1800404480727616:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 482us (811us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999789.279204:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45726 00000100:00100000:2.0:1716999789.279209:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45725 00000100:00100000:0.0:1716999789.280392:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.280467:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480727744 00000100:00100000:2.0:1716999789.280472:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480727744 00000100:00100000:2.0:1716999789.280491:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45727 00000100:00100000:2.0:1716999789.280497:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+642:11419:x1800404480727744:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.280506:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.280515:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc6ba1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66069 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.280540:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc6ba8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280548:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc6ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280557:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc6ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280566:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6baf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280571:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280576:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280608:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc6ba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280614:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc6ba8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280618:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc6ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280622:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c94000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.280624:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc6ba8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280629:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc6ba8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280636:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.280639:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.280641:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc6ba8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280645:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94000/0x6d188eabd8dc6ba8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280654:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6baf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280658:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6baf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280662:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6baf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280666:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.280668:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6baf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280672:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6baf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280678:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6cfa4d9f (ffff8800923b8f00) 00010000:00010000:2.0:1716999789.280680:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.280682:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6baf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280686:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97cc0/0x6d188eabd8dc6baf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.280713:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc6ba1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66069 expref: 643 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.280719:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97600/0x6d188eabd8dc6ba1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66069 expref: 643 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.280726:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c97600, rc 0) 00000100:00100000:2.0:1716999789.280773:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+642:11419:x1800404480727744:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 275us (381us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.280779:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45727 00000100:00100000:1.0:1716999789.281375:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.281412:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480727808 00000100:00100000:3.0:1716999789.281417:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480727808 00000100:00100000:3.0:1716999789.282351:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9134 00000100:00100000:3.0:1716999789.282358:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+642:11420:x1800404480727808:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999789.283621:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.283747:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480727936 00000100:00100000:1.0:1716999789.283753:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480727936 00000100:00100000:1.0:1716999789.283784:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45728 00000100:00100000:1.0:1716999789.283790:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+644:11419:x1800404480727936:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.283799:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.283820:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc6bb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66070 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.283873:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6bbd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283901:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6bbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283908:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6bbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283918:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6bc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283923:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283928:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283951:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6bbd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283956:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6bbd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283961:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6bbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283965:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.283967:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6bbd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283971:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6bbd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283979:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.283981:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.283984:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6bbd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283987:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6bbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.283997:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6bc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.284001:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6bc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.284008:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.284011:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.284013:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6bc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.284017:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6bc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.284023:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6cfa4d9f (ffff880094791d00) 00010000:00010000:1.0:1716999789.284025:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.284027:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6bc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.284031:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6bc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.284052:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc6bb6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66070 expref: 645 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.284058:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc6bb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66070 expref: 645 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.284063:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364fc0, rc 0) 00000100:00100000:1.0:1716999789.284086:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+644:11419:x1800404480727936:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 296us (467us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999789.284092:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45728 00000100:00100000:3.0:1716999789.285442:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+642:11420:x1800404480727808:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3082us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.285449:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9134 00000100:00100000:3.0:1716999789.286003:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.286214:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480728000 00000100:00100000:2.0:1716999789.286219:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480728000 00000100:00100000:2.0:1716999789.286246:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45729 00000100:00100000:2.0:1716999789.286251:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+642:11419:x1800404480728000:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.286260:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.286269:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6bcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66077 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.286298:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6bd2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286306:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286312:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286321:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6bd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286325:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286329:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286362:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6bd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286366:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6bd2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286371:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286375:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c97a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.286377:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6bd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286382:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6bd2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286389:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.286391:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.286393:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6bd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286397:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97a80/0x6d188eabd8dc6bd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286404:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6bd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286408:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6bd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286412:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286414:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c95f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.286416:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6bd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286419:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6bd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286424:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6cad4e9d (ffff8800923b8100) 00010000:00010000:2.0:1716999789.286426:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.286427:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6bd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286430:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95f80/0x6d188eabd8dc6bd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.286451:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6bcb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66077 expref: 643 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.286456:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94b40/0x6d188eabd8dc6bcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66077 expref: 643 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.286461:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c94b40, rc 0) 00000100:00100000:2.0:1716999789.287339:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+642:11419:x1800404480728000:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1085us (1334us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.287346:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45729 00000100:00100000:0.0:1716999789.290784:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.291259:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480728064 00000100:00100000:2.0:1716999789.291267:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480728064 00000100:00100000:2.0:1716999789.291314:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45730 00000100:00100000:2.0:1716999789.291321:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+642:11420:x1800404480728064:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.291336:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.291352:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6be0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6607e expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.291396:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6be7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291410:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6be7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291419:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6be7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291430:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6bee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291436:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291441:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291494:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6be7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291499:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6be7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291504:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6be7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291509:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c973c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.291511:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6be7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291517:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6be7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291525:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.291528:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.291531:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6be7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291536:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c973c0/0x6d188eabd8dc6be7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291545:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6bee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291550:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6bee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291554:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291558:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.291560:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6bee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291565:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6bee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291570:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6c9b575e (ffff8800923b8a00) 00010000:00010000:2.0:1716999789.291572:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.291574:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6bee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291578:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96640/0x6d188eabd8dc6bee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.291607:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6be0 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6607e expref: 643 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.291613:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96880/0x6d188eabd8dc6be0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6607e expref: 643 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.291620:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090c96880, rc 0) 00000100:00100000:2.0:1716999789.292734:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+642:11420:x1800404480728064:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1410us (1953us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.292740:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45730 00000100:00100000:1.0:1716999789.292867:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.293194:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480728192 00000100:00100000:2.0:1716999789.293199:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480728192 00000100:00100000:2.0:1716999789.293220:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45731 00000100:00100000:2.0:1716999789.293225:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+642:11419:x1800404480728192:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.293234:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.293237:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1716999789.293249:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94480/0x6d188eabd8dc6a89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66000 expref: 642 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.293259:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.293261:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.293267:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6bf5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66085 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.293534:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6bfc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.293544:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6bfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.293550:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6bfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.293561:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6c03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.293567:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6c03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.293572:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6c03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:2.0:1716999789.293986:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x60f:0x0], index 1: 0 00000040:00080000:2.0:1716999789.294044:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11513, 184 off2058896 00010000:00010000:2.0:1716999789.294131:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc6c0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.294137:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc6c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.294142:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc6c0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.294164:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6bfc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.294168:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6bfc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.294174:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6bfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.294178:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880090c96ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.294180:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6bfc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.294185:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6bfc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.294191:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.294194:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.294196:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6bfc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.294200:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96ac0/0x6d188eabd8dc6bfc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999789.294208:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880088b2fb80 reply state ffff880089305000 transno 4294986124 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6c03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999789.294213:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999789.294230:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c96d00/0x6d188eabd8dc6bf5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66085 expref: 644 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.294239:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc6c0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66085 expref: 643 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.294244:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc55:0x0].0x0 (ffff8800923b8700) 00010000:00010000:2.0:1716999789.294246:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999789.294247:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801339f9f80, rc 0) 00000100:00100000:2.0:1716999789.294291:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+644:11419:x1800404480728192:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1064us (1424us total) trans 4294986124 rc 0/0 00000100:00100000:2.0:1716999789.294296:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45731 00010000:00010000:2.0:1716999789.295797:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6c03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.295814:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6c03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.295819:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6c03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.295826:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a8901680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.295829:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6c03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.295834:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6c03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.295843:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6cad4e9d (ffff8800923b8d00) 00010000:00010000:2.0:1716999789.295845:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.295848:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6c03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.295852:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901680/0x6d188eabd8dc6c03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999789.295994:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.296040:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480728256 00000100:00100000:2.0:1716999789.296045:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480728256 00000100:00100000:2.0:1716999789.296077:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10054 00000100:00100000:2.0:1716999789.296082:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+77:1959:x1800404480728256:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.296092:0:19196:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.296108:0:19196:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8801339fba80/0x6d188eabd8dc6c18 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6608c expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999789.296125:0:19196:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x60f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999789.296136:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.296138:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.296143:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8801339fba80/0x6d188eabd8dc6c18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6608c expref: 78 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.296157:0:19196:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8801339fba80/0x6d188eabd8dc6c18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6608c expref: 78 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.296165:0:19196:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801339fba80, rc 0) 00000100:00100000:2.0:1716999789.296189:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480728256:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 106us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.296194:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10054 00000100:00100000:0.0:1716999789.297497:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.297538:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480728320 00000100:00100000:2.0:1716999789.297542:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480728320 00000100:00100000:2.0:1716999789.297579:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45732 00000100:00100000:2.0:1716999789.297585:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+643:11420:x1800404480728320:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.297600:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.297611:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6c1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66093 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.297649:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6c26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297658:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6c26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297665:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6c26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297673:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6c2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6ce85660 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297677:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6c2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297682:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6c2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297727:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6c26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297731:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6c26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297735:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6c26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297740:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.297742:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6c26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297747:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6c26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297754:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.297756:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.297759:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6c26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297764:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6c26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297772:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6c2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297776:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6c2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297780:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6c2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297784:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.297786:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6c2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297791:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6c2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297796:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6ce85660 (ffff880092351100) 00010000:00010000:2.0:1716999789.297798:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.297799:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6c2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297812:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6c2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6ce85660 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.297843:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6c1f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66093 expref: 644 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.297849:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8240/0x6d188eabd8dc6c1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66093 expref: 644 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.297855:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8801339f8240, rc 0) 00000100:00100000:2.0:1716999789.298309:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+643:11420:x1800404480728320:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 722us (812us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.298314:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45732 00000100:00100000:0.0:1716999789.298723:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.298768:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480728448 00000100:00100000:3.0:1716999789.298773:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480728448 00000100:00100000:3.0:1716999789.298816:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9135 00000100:00100000:3.0:1716999789.298822:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013077e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+643:11419:x1800404480728448:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999789.299167:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11514, 168 off2059064 00000001:00080000:3.0:1716999789.299173:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986125 00000100:00100000:3.0:1716999789.299571:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013077e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+645:11419:x1800404480728448:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 746us (846us total) trans 4294986126 rc 0/0 00000100:00100000:3.0:1716999789.299577:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9135 00000020:00080000:3.0:1716999789.299581:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999789.302622:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.302723:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480728576 00000100:00100000:2.0:1716999789.302730:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480728576 00000100:00100000:2.0:1716999789.302789:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45733 00000100:00100000:2.0:1716999789.302796:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+645:11420:x1800404480728576:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.302819:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.302822:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1716999789.302841:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6b70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66054 expref: 645 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.302853:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.302857:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.302867:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6c34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6609a expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.302981:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6c3b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.302991:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6c3b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.302998:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6c3b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.303009:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.303013:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.303018:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:2.0:1716999789.303389:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x60f:0x0], index 0: 0 00000040:00080000:2.0:1716999789.303448:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11515, 184 off2059248 00010000:00010000:2.0:1716999789.303530:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc6c49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.303540:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc6c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.303546:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc6c49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.303566:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6c3b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.303571:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6c3b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.303576:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6c3b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.303580:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.303583:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6c3b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.303589:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6c3b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.303596:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.303599:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.303601:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6c3b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.303606:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6c3b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999789.303613:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099446300 reply state ffff88009a31e000 transno 4294986127 ns: mdt-lustre-MDT0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999789.303622:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999789.303638:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6c34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6609a expref: 647 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.303647:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc6c49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc56:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6609a expref: 646 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.303653:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc56:0x0].0x0 (ffff880088977800) 00010000:00010000:2.0:1716999789.303654:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999789.303656:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091833a80, rc 0) 00000100:00100000:2.0:1716999789.304333:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+647:11420:x1800404480728576:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1535us (1715us total) trans 4294986127 rc 0/0 00000100:00100000:2.0:1716999789.304340:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45733 00000100:00100000:0.0:1716999789.304557:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.304610:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480728704 00000100:00100000:2.0:1716999789.304616:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480728704 00000100:00100000:2.0:1716999789.304644:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45734 00000100:00100000:2.0:1716999789.304649:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+647:11419:x1800404480728704:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.304660:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.304669:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6c57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660a1 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.304711:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc6c5e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.304718:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc6c5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc55:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.304723:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc6c5e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc55:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:2.0:1716999789.304730:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc55:0x0]: returning size 0 00010000:00010000:2.0:1716999789.304784:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6c57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660a1 expref: 650 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.304794:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc6c5e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc55:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660a1 expref: 649 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.304799:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc55:0x0].0x0 (ffff8800923b8700) 00010000:00010000:2.0:1716999789.304801:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999789.304802:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091830240, rc 0) 00000100:00100000:2.0:1716999789.304850:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+649:11419:x1800404480728704:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 200us (293us total) trans 4294986128 rc 0/0 00000100:00100000:2.0:1716999789.304856:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45734 00010000:00010000:1.0:1716999789.305301:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.305309:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.305314:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.305318:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.305320:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.305325:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.305333:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6c9b575e (ffff880088977d00) 00010000:00010000:1.0:1716999789.305335:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.305337:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.305341:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999789.307561:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.307606:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.307763:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480728768 00000100:00100000:2.0:1716999789.307770:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480728768 00000100:00100000:2.0:1716999789.307793:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480728832 00000100:00100000:2.0:1716999789.307795:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480728832 00000100:00100000:2.0:1716999789.307825:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10055 00000100:00100000:2.0:1716999789.307831:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+80:1958:x1800404480728768:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.307843:0:19196:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.307857:0:19196:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6c6c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660a8 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1716999789.307873:0:19196:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x240000400:0x60f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1716999789.307907:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.307909:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.307915:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6c6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660a8 expref: 81 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.307926:0:19196:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6c6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660a8 expref: 81 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.307934:0:19196:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091831f80, rc 0) 00000100:00100000:2.0:1716999789.307963:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+81:1958:x1800404480728768:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 132us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.307968:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10055 00000100:00100000:2.0:1716999789.307980:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10056 00000100:00100000:2.0:1716999789.307984:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+78:11419:x1800404480728832:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.307990:0:19196:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.307999:0:19196:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660af expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.308011:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339fba80/0x6d188eabd8dc6c18 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6608c expref: 79 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.308017:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.308018:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.308020:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660af expref: 79 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.308041:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801339fba80/0x6d188eabd8dc6c18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6608c expref: 79 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.308050:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801339fba80/0x6d188eabd8dc6c18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6608c expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:2.0:1716999789.308060:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:19196:1800404483015680:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999789.308086:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136962cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999789.310775:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:19196:1800404483015680:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999789.310799:0:19196:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660af expref: 79 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.310822:0:19196:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918333c0, rc 0) 00000100:00100000:2.0:1716999789.311314:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+79:11419:x1800404480728832:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 3280us (3659us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.311322:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10056 00000100:00100000:1.0:1716999789.311433:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.311491:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480728896 00000100:00100000:2.0:1716999789.311496:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480728896 00010000:00010000:2.0:1716999789.311514:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801339fba80/0x6d188eabd8dc6c18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6608c expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:1.0:1716999789.311550:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.311571:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4564 00000100:00100000:2.0:1716999789.311576:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480728896:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999789.311588:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999789.311605:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801339fba80/0x6d188eabd8dc6c18 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x60f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6608c expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:3.0:1716999789.311638:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729024 00010000:00010000:2.0:1716999789.311639:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801339fba80/0x6d188eabd8dc6c18 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x60f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6608c expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:3.0:1716999789.311642:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729024 00010000:00010000:2.0:1716999789.311660:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801339fba80/0x6d188eabd8dc6c18 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x60f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6608c expref: 79 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:3.0:1716999789.311669:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9136 00010000:00010000:2.0:1716999789.311669:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.311670:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1716999789.311673:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+648:11420:x1800404480729024:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:2.0:1716999789.311675:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660af expref: 78 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.311681:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660af expref: 78 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.311702:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660af expref: 78 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999789.311711:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483015744:192.168.203.3@tcp:105: 00000100:00100000:2.0:1716999789.311752:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136962cc0 going to sleep for 11 seconds 00000040:00080000:3.0:1716999789.312152:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11516, 168 off2059416 00000001:00080000:3.0:1716999789.312157:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986129 00000100:00100000:3.0:1716999789.312329:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+650:11420:x1800404480729024:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 653us (777us total) trans 4294986130 rc 0/0 00000100:00100000:3.0:1716999789.312335:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9136 00000020:00080000:3.0:1716999789.312339:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999789.312999:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008ea7c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6809:1800404483015744:192.168.203.3@tcp:105: 00010000:00010000:2.0:1716999789.313011:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999789.313039:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480728896:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1462us (1606us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.313045:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4564 00000100:00100000:2.0:1716999789.313358:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.313408:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729152 00000100:00100000:0.0:1716999789.313412:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729152 00000100:00100000:0.0:1716999789.313433:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45735 00000100:00100000:0.0:1716999789.313437:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+650:11420:x1800404480729152:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.313447:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.313458:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6c7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660b6 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.313506:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6c81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc56:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.313516:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6c81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc56:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.313524:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6c81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc56:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:0.0:1716999789.313531:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc56:0x0]: returning size 0 00010000:00010000:0.0:1716999789.313590:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6c7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660b6 expref: 653 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.313615:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6c81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc56:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660b6 expref: 652 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.313622:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc56:0x0].0x0 (ffff880088977800) 00010000:00010000:0.0:1716999789.313624:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1716999789.313626:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131b00, rc 0) 00000100:00100000:0.0:1716999789.313644:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+652:11420:x1800404480729152:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 206us (286us total) trans 4294986131 rc 0/0 00000100:00100000:0.0:1716999789.313649:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45735 00000100:00100000:0.0:1716999789.315482:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.315540:0:25372:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729216 00000100:00100000:2.0:1716999789.315545:0:25372:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729216 00002000:00100000:2.0:1716999789.315568:0:25372:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x60d:0x0] (0->4095) req@ffff88008c706a00 x1800404480729216/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:695/0 lens 4584/0 e 0 to 0 dl 1716999800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999789.315582:0:25372:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c706a00 with x1800404480729216 ext(0->4095) 00002000:00010000:2.0:1716999789.315586:0:25372:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c706a00 00000100:00100000:2.0:1716999789.315691:0:25372:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1438 00000100:00100000:2.0:1716999789.315697:0:25372:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:107d663a-2216-406b-94c6-b2fcb1558728+81:1959:x1800404480729216:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:2.0:1716999789.316288:0:25372:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:107d663a-2216-406b-94c6-b2fcb1558728+83:1959:x1800404480729216:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 590us (808us total) trans 4294970154 rc 0/0 00000100:00100000:2.0:1716999789.316295:0:25372:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1438 00002000:00100000:2.0:1716999789.316301:0:25372:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x60d:0x0] (0->4095) req@ffff88008c706a00 x1800404480729216/t4294970154(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:695/0 lens 4584/448 e 0 to 0 dl 1716999800 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999789.316307:0:25372:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c706a00 with x1800404480729216 ext(0->4095) 00002000:00010000:2.0:1716999789.316310:0:25372:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c706a00 00000100:00100000:0.0:1716999789.316311:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.316325:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729280 00000100:00100000:2.0:1716999789.316328:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729280 00000100:00100000:2.0:1716999789.316355:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10057 00000100:00100000:2.0:1716999789.316359:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+83:11420:x1800404480729280:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.316366:0:19196:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.316413:0:19196:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660bd expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.316431:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6c6c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660a8 expref: 84 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.316437:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.316438:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.316442:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660bd expref: 84 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.316464:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6c6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660a8 expref: 84 pid: 19196 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1716999789.316478:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6c6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660a8 expref: 84 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:2.0:1716999789.316488:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483015808:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999789.316518:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136962cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999789.317459:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b7f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483015808:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999789.317473:0:19196:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660bd expref: 84 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.317481:0:19196:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091832ac0, rc 0) 00000100:00100000:2.0:1716999789.317503:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:107d663a-2216-406b-94c6-b2fcb1558728+84:11420:x1800404480729280:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1143us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.317508:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10057 00000100:00100000:0.0:1716999789.317682:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.317716:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729408 00000100:00100000:3.0:1716999789.317720:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729408 00010000:00010000:3.0:1716999789.317731:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6c6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660a8 expref: 84 pid: 19196 timeout: 408 lvb_type: 1 00000100:00100000:3.0:1716999789.317746:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4565 00000100:00100000:3.0:1716999789.317750:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+84:1959:x1800404480729408:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999789.317757:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999789.317768:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6c6c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x60f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660a8 expref: 84 pid: 19196 timeout: 408 lvb_type: 1 00010000:00010000:3.0:1716999789.317776:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6c6c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x60f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660a8 expref: 84 pid: 19196 timeout: 408 lvb_type: 1 00010000:00010000:3.0:1716999789.318054:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6c6c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x60f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660a8 expref: 84 pid: 19196 timeout: 408 lvb_type: 1 00010000:00010000:3.0:1716999789.318072:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.318074:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.318079:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660bd expref: 83 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.318116:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660bd expref: 83 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.318141:0:6809:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660bd expref: 83 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999789.318148:0:6809:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099447800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483015872:192.168.203.3@tcp:105: 00000100:00100000:3.0:1716999789.318175:0:6809:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135481480 going to sleep for 11 seconds 00000100:00100000:0.0:1716999789.318414:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.318445:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729344 00000100:00100000:2.0:1716999789.318448:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729344 00000100:00100000:2.0:1716999789.318465:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45736 00000100:00100000:2.0:1716999789.318469:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+652:11419:x1800404480729344:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:3.0:1716999789.320450:0:6809:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099447800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6809:1800404483015872:192.168.203.3@tcp:105: 00010000:00010000:3.0:1716999789.320466:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999789.320563:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+83:1959:x1800404480729408:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 2810us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.320571:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4565 00000100:00100000:0.0:1716999789.322187:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.322207:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729472 00000100:00100000:0.0:1716999789.322212:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729472 00000100:00100000:0.0:1716999789.322250:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45737 00000100:00100000:0.0:1716999789.322255:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+653:11420:x1800404480729472:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.322268:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.322280:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6c96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660c4 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.322319:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6c9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322327:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322332:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322339:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322342:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322344:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322405:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6c9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322408:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6c9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322411:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6c9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322414:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.322416:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6c9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322420:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6c9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322426:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.322427:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.322430:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6c9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322433:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6c9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322448:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322452:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ca4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322456:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322460:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.322462:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322466:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ca4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322471:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x54f6b75a (ffff88008a83ff00) 00010000:00010000:0.0:1716999789.322473:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.322475:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ca4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322479:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.322548:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6c96 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660c4 expref: 654 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.322555:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6c96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660c4 expref: 654 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.322563:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130240, rc 0) 00000100:00100000:0.0:1716999789.322594:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+653:11420:x1800404480729472:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 339us (409us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999789.322600:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45737 00000100:00100000:2.0:1716999789.324741:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.324935:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729536 00000100:00100000:0.0:1716999789.324940:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729536 00000100:00100000:0.0:1716999789.324962:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45738 00000100:00100000:0.0:1716999789.324967:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+653:11420:x1800404480729536:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.324977:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.324988:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6cab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660cb expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.325007:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660cb expref: 654 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.325016:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6cab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660cb expref: 654 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.325022:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.325024:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.325026:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130d80, rc 0) 00000100:00100000:0.0:1716999789.325052:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480729536:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 84us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.325057:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45738 00000100:00100000:0.0:1716999789.327507:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.327563:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729600 00000100:00100000:3.0:1716999789.327567:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729600 00000100:00100000:3.0:1716999789.327584:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9137 00000100:00100000:3.0:1716999789.327588:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480729600:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999789.330179:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480729600:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2583us (2668us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.330191:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9137 00000100:00100000:3.0:1716999789.333785:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.334206:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729664 00000100:00100000:2.0:1716999789.334214:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729664 00000100:00100000:2.0:1716999789.334245:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45739 00000100:00100000:2.0:1716999789.334251:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480729664:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.334266:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.334282:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6cb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660d2 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.334327:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc6cb9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334338:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc6cb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334346:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc6cb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334355:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc6cc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334360:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc6cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334364:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc6cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334412:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc6cb9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334417:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc6cb9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334423:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc6cb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334427:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918306c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.334430:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc6cb9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334435:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc6cb9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334444:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.334446:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.334449:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc6cb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334453:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc6cb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334460:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc6cc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334464:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc6cc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334469:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc6cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334472:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.334474:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc6cc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334478:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc6cc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334483:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x54f6b75a (ffff880088977100) 00010000:00010000:2.0:1716999789.334485:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.334487:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc6cc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334491:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc6cc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x54f6b75a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.334522:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6cb2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660d2 expref: 655 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.334529:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc6cb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660d2 expref: 655 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.334535:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091831f80, rc 0) 00000100:00100000:2.0:1716999789.334569:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480729664:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 317us (788us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.334575:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45739 00000100:00100000:0.0:1716999789.340560:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.340602:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729728 00000100:00100000:2.0:1716999789.340609:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729728 00000100:00100000:2.0:1716999789.340633:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45740 00000100:00100000:2.0:1716999789.340637:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480729728:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.340649:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.340660:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6cc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660d9 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.340694:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc6cce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340704:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc6cce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340711:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc6cce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340717:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6cd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340721:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340723:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340767:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc6cce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340770:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc6cce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340774:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc6cce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340777:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.340779:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc6cce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340782:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc6cce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340789:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.340790:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.340793:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc6cce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340795:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc6cce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340800:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6cd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340802:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6cd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340823:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340827:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.340829:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6cd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340832:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6cd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340837:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6cad4e9d (ffff880088977900) 00010000:00010000:2.0:1716999789.340840:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.340841:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6cd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340845:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6cd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.340870:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6cc7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660d9 expref: 655 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.340874:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6cc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660d9 expref: 655 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.340907:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091831200, rc 0) 00000100:00100000:2.0:1716999789.340943:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480729728:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 304us (386us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.340948:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45740 00000100:00100000:1.0:1716999789.344355:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.344498:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729792 00000100:00100000:2.0:1716999789.344505:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729792 00000100:00100000:2.0:1716999789.344534:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45741 00000100:00100000:2.0:1716999789.344540:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480729792:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999789.344553:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.344566:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6cdc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660e0 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.344604:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6ce3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344614:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344622:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344632:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6cea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344637:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344642:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344695:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344700:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6ce3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344706:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344710:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.344713:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344719:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6ce3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344726:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.344729:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.344732:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6ce3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344737:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6ce3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344743:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6cea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344748:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6cea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344753:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344759:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.344762:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6cea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344766:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6cea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344771:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6cfa4d9f (ffff880088977700) 00010000:00010000:2.0:1716999789.344773:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.344774:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6cea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344779:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6cea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.344817:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6cdc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660e0 expref: 655 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.344824:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6cdc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660e0 expref: 655 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.344831:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918318c0, rc 0) 00000100:00100000:2.0:1716999789.344862:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480729792:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 322us (510us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999789.344868:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45741 00000100:00100000:2.0:1716999789.346764:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.346814:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729920 00000100:00100000:3.0:1716999789.346820:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729920 00000100:00100000:3.0:1716999789.346849:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45742 00000100:00100000:3.0:1716999789.346854:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480729920:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:3.0:1716999789.346865:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999789.346902:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc6cf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660e7 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.346973:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6cf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.346983:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.346990:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.346999:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6cff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347004:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6cff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347008:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6cff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347037:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6cf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347042:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6cf8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347047:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347052:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.347055:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6cf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347060:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6cf8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347067:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.347070:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.347072:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6cf8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347076:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc6cf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347082:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6cff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347087:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6cff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347091:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6cff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347095:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.347097:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6cff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347101:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6cff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347106:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6cfa4d9f (ffff88012e3f8100) 00010000:00010000:3.0:1716999789.347108:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.347111:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6cff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347114:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc6cff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.347131:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc6cf1 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660e7 expref: 655 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.347137:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc6cf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660e7 expref: 655 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.347144:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c53cc0, rc 0) 00000100:00100000:3.0:1716999789.347170:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+654:11420:x1800404480729920:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 316us (410us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999789.347175:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45742 00000001:00080000:2.0:1716999789.349743:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986131 is committed 00000004:00080000:2.0:1716999789.349760:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 138 committed 00000100:00100000:3.0:1716999789.349981:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+589:11419:x1800404480729344:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 31507us (31563us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.349988:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45736 00000100:00100000:3.0:1716999789.350211:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483015936:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999789.350244:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999789.350259:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483016192:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999789.350272:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999789.350283:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1716999789.350288:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483016128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999789.350299:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999789.350314:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483016000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999789.350327:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999789.350336:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1716999789.350339:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483016064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999789.350353:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999789.350373:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483015936 00000100:00100000:3.0:1716999789.350377:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483015936 00000100:00100000:3.0:1716999789.350396:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483016192 00000100:00100000:3.0:1716999789.350398:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483016192 00000100:00100000:3.0:1716999789.350406:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483016128 00000100:00100000:3.0:1716999789.350408:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483016128 00000100:00100000:3.0:1716999789.350417:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483016000 00000100:00100000:3.0:1716999789.350418:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483016000 00000100:00100000:3.0:1716999789.350425:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483016064 00000100:00100000:3.0:1716999789.350426:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483016064 00000100:00100000:3.0:1716999789.350435:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10058 00000100:00100000:3.0:1716999789.350440:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+9:3218:x1800404483015936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999789.350456:0:19200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1540 count 1 00010000:00010000:3.0:1716999789.350471:0:19200:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350483:0:19200:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f2 expref: 82 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350490:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999789.350491:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999789.350493:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350514:0:19200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f2 expref: 82 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350524:0:19200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f2 expref: 82 pid: 17700 timeout: 408 lvb_type: 0 00000100:00100000:3.0:1716999789.350534:0:19200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008927d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:19200:1800404483016256:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999789.350555:0:19200:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e361300 going to sleep for 11 seconds 00000100:00100000:3.0:1716999789.350568:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10059 00000100:00100000:3.0:1716999789.350572:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3218:x1800404483016192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999789.350584:0:17864:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1547 count 1 00010000:00010000:3.0:1716999789.350592:0:17864:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350601:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e2b expref: 82 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350607:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999789.350608:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999789.350610:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350624:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e2b expref: 82 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350631:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e2b expref: 82 pid: 19196 timeout: 408 lvb_type: 0 00000100:00100000:3.0:1716999789.350639:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099583800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483016320:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999789.350654:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e361c00 going to sleep for 11 seconds 00000100:00100000:3.0:1716999789.350666:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10060 00000100:00100000:3.0:1716999789.350670:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3218:x1800404483016128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999789.350679:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1546 count 1 00010000:00010000:3.0:1716999789.350687:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350696:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65da6 expref: 82 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350701:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999789.350702:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999789.350704:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350718:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65da6 expref: 82 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350725:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65da6 expref: 82 pid: 19196 timeout: 408 lvb_type: 0 00000100:00100000:3.0:1716999789.350732:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099582300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483016384:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999789.350747:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e361600 going to sleep for 11 seconds 00000100:00100000:3.0:1716999789.350760:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10061 00000100:00100000:3.0:1716999789.350764:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3219:x1800404483016000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999789.350772:0:8341:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1539 count 1 00010000:00010000:3.0:1716999789.350779:0:8341:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350787:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6589e expref: 82 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350792:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999789.350793:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999789.350795:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350824:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6589e expref: 82 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.350831:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6589e expref: 82 pid: 11262 timeout: 408 lvb_type: 0 00000100:00100000:3.0:1716999789.350838:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099581f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483016448:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999789.350853:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012e361b40 going to sleep for 11 seconds 00000100:00100000:2.0:1716999789.350988:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10062 00000100:00100000:2.0:1716999789.350993:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+9:3219:x1800404483016064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1716999789.351003:0:19196:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1541 count 1 00010000:00010000:2.0:1716999789.351012:0:19196:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.351020:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f659bd expref: 82 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.351024:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999789.351025:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999789.351027:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.351040:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f659bd expref: 82 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.351046:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f659bd expref: 82 pid: 11262 timeout: 408 lvb_type: 0 00000100:00100000:2.0:1716999789.351053:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483016512:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999789.351068:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136962000 going to sleep for 11 seconds 00000100:00100000:2.0:1716999789.351105:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.351335:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480729984 00000100:00100000:3.0:1716999789.351340:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480729984 00000100:00100000:0.0:1716999789.352615:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45743 00000100:00100000:0.0:1716999789.352621:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480729984:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.352631:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.352642:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc6d29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660ee expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.352686:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc6d30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352695:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc6d30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352702:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc6d30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352711:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc6d37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352715:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc6d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352720:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc6d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352769:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc6d30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352774:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc6d30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352778:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc6d30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352783:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.352787:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc6d30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352792:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc6d30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352801:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.352813:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.352816:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc6d30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352820:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc6d30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352831:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc6d37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352835:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc6d37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352839:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc6d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352843:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.352845:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc6d37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352850:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc6d37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352856:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6cad4e9d (ffff88008a83f300) 00010000:00010000:0.0:1716999789.352857:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.352860:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc6d37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.352867:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc6d37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.353008:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc6d29 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660ee expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.353015:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc6d29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660ee expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.353023:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132640, rc 0) 00000100:00100000:0.0:1716999789.353583:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480729984:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 960us (2477us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999789.353589:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45743 00000100:00100000:3.0:1716999789.355071:0:19200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008927d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:19200:1800404483016256:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999789.355131:0:19200:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999789.355155:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.355168:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099582300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483016384:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999789.355172:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999789.355179:0:17365:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999789.355185:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.355195:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480730048 00000100:00100000:2.0:1716999789.355197:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.355198:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480730048 00000100:00100000:2.0:1716999789.355209:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999789.355215:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f2 expref: 83 pid: 17700 timeout: 408 lvb_type: 0 00000100:00100000:3.0:1716999789.355230:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480730176 00000100:00100000:2.0:1716999789.355230:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.355232:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480730176 00010000:00010000:3.0:1716999789.355239:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65da6 expref: 84 pid: 19196 timeout: 408 lvb_type: 0 00000100:00100000:2.0:1716999789.355243:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480730112 00000100:00100000:2.0:1716999789.355245:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480730112 00000100:00100000:3.0:1716999789.355248:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480730240 00000100:00100000:3.0:1716999789.355250:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480730240 00010000:00010000:2.0:1716999789.355254:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e2b expref: 86 pid: 19196 timeout: 408 lvb_type: 0 00010000:00010000:3.0:1716999789.355255:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6589e expref: 86 pid: 11262 timeout: 408 lvb_type: 0 00000100:00100000:3.0:1716999789.355262:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480730368 00000100:00100000:3.0:1716999789.355264:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480730368 00000100:00100000:2.0:1716999789.355266:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4566 00010000:00010000:3.0:1716999789.355270:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f659bd expref: 87 pid: 11262 timeout: 408 lvb_type: 0 00000100:00100000:2.0:1716999789.355270:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+87:1958:x1800404480730048:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1716999789.355278:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4567 00010000:00010000:2.0:1716999789.355278:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1716999789.355281:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+87:1958:x1800404480730176:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999789.355282:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f2 expref: 87 pid: 17700 timeout: 408 lvb_type: 0 00010000:00010000:3.0:1716999789.355286:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999789.355288:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65da6 expref: 87 pid: 19196 timeout: 408 lvb_type: 0 00010000:00010000:2.0:1716999789.355289:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f2 expref: 87 pid: 17700 timeout: 408 lvb_type: 0 00010000:00010000:3.0:1716999789.355295:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65da6 expref: 87 pid: 19196 timeout: 408 lvb_type: 0 00010000:00010000:3.0:1716999789.355302:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c131440/0x6d188eabd8dc63ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65da6 expref: 87 pid: 19196 timeout: 408 lvb_type: 0 00010000:00010000:2.0:1716999789.355302:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8480/0x6d188eabd8dc5597 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658f2 expref: 87 pid: 17700 timeout: 408 lvb_type: 0 00010000:00010000:3.0:1716999789.355311:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.355311:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.355313:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.355313:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.355316:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.355316:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.355323:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.355326:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.355334:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.355335:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999789.355353:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+85:1958:x1800404480730048:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.355361:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4566 00000100:00100000:2.0:1716999789.355373:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4568 00000100:00100000:2.0:1716999789.355377:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+84:1958:x1800404480730112:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1716999789.355383:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4569 00000100:00100000:0.0:1716999789.355387:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+84:1958:x1800404480730240:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999789.355394:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999789.355397:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6589e expref: 84 pid: 11262 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.355404:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6589e expref: 84 pid: 11262 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.355417:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999789.355418:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999789.355420:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.355429:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.355437:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.355465:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999789.355468:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e2b expref: 84 pid: 19196 timeout: 408 lvb_type: 0 00010000:00010000:2.0:1716999789.355475:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e2b expref: 84 pid: 19196 timeout: 408 lvb_type: 0 00010000:00010000:2.0:1716999789.355483:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.355484:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999789.355486:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.355491:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.355498:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999789.355584:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+84:1958:x1800404480730176:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 301us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.355589:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4567 00000100:00100000:3.0:1716999789.355615:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4570 00000100:00100000:3.0:1716999789.355618:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+83:1958:x1800404480730368:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999789.355623:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999789.355626:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f659bd expref: 83 pid: 11262 timeout: 408 lvb_type: 0 00010000:00010000:3.0:1716999789.355632:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f659bd expref: 83 pid: 11262 timeout: 408 lvb_type: 0 00010000:00010000:3.0:1716999789.355640:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.355641:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.355643:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.355648:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.355655:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999789.355664:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+83:1958:x1800404480730368:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 45us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.355668:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4570 00010000:00010000:3.0:1716999789.355691:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008efb6400/0x6d188eabd8dc652d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e2b expref: 82 pid: 19196 timeout: 408 lvb_type: 0 00000100:00100000:3.0:1716999789.355698:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099583800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483016320:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999789.355705:0:17864:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.355711:0:17864:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.355722:0:17864:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.355728:0:17864:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.355733:0:17864:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.355738:0:17864:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.355743:0:17864:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999789.355745:0:17864:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.355755:0:17864:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.355762:0:17864:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.355767:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c51440/0x6d188eabd8dc6d0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999789.356009:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+10:3218:x1800404483016192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5436us (5735us total) trans 4294970155 rc 0/0 00000100:00100000:3.0:1716999789.356015:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10059 00000100:00100000:3.0:1716999789.356025:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480730304 00000100:00100000:3.0:1716999789.356028:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480730304 00000100:00100000:3.0:1716999789.356053:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10063 00000100:00100000:3.0:1716999789.356057:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+82:1958:x1800404480730304:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:3.0:1716999789.356100:0:3218:0:(client.c:2952:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294970151 gen 2 00000004:00080000:3.0:1716999789.356104:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009c2c7100, transno 4294970139 00000004:00080000:3.0:1716999789.356109:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131d5ed80, transno 4294970140 00000004:00080000:3.0:1716999789.356111:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008af52300, transno 4294970141 00000004:00080000:3.0:1716999789.356113:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9fd880, transno 4294970142 00000004:00080000:3.0:1716999789.356115:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801339fed80, transno 4294970143 00000004:00080000:3.0:1716999789.356117:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9fdf80, transno 4294970144 00000004:00080000:3.0:1716999789.356119:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9fc700, transno 4294970145 00000004:00080000:3.0:1716999789.356121:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8801339fd880, transno 4294970146 00000004:00080000:3.0:1716999789.356123:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e442d80, transno 4294970147 00000004:00080000:3.0:1716999789.356125:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e442680, transno 4294970148 00000004:00080000:3.0:1716999789.356126:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e442a00, transno 4294970149 00000004:00080000:3.0:1716999789.356128:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e440700, transno 4294970150 00000004:00080000:3.0:1716999789.356130:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e443800, transno 4294970151 00000100:00100000:3.0:1716999789.356135:0:3218:0:(client.c:2996:ptlrpc_free_committed()) @@@ stopping search req@ffff880092df2680 x1800404483016192/t4294970155(4294970155) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1716999805 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1716999789.356142:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092df2680/2, rc 0, transno 2859 00000100:00100000:3.0:1716999789.356145:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483016192:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999789.356156:0:17365:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356162:0:17365:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356167:0:17365:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356172:0:17365:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356178:0:17365:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356183:0:17365:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999789.356185:0:17365:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356190:0:17365:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356198:0:17365:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356202:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc6d14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999789.356394:0:8674:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 5 in progress, 4 in flight, 13 done 00010000:00010000:3.0:1716999789.356621:0:19200:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356627:0:19200:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356634:0:19200:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356639:0:19200:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356644:0:19200:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356649:0:19200:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999789.356651:0:19200:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356660:0:19200:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356669:0:19200:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.356675:0:19200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc6d06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999789.356750:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3218:x1800404483016128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6079us (6448us total) trans 4294970156 rc 0/0 00000100:00100000:3.0:1716999789.356756:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10060 00000004:00080000:3.0:1716999789.356784:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092df1c00/2, rc 0, transno 2860 00000100:00100000:3.0:1716999789.356788:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483016128:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999789.356853:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+82:1958:x1800404480730112:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1474us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.356859:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4568 00010000:00010000:2.0:1716999789.356903:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc5814 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f659bd expref: 81 pid: 11262 timeout: 408 lvb_type: 0 00000100:00100000:2.0:1716999789.356911:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b7f5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483016512:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999789.356922:0:19196:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.356928:0:19196:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.356933:0:19196:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.356938:0:19196:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.356943:0:19196:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.356949:0:19196:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.356953:0:19196:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918321c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999789.356956:0:19196:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999789.356957:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+10:3218:x1800404483015936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6517us (6713us total) trans 4294970157 rc 0/0 00000100:00100000:3.0:1716999789.356962:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10058 00010000:00010000:2.0:1716999789.356962:0:19196:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.356970:0:19196:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999789.356979:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099444e00/2, rc 0, transno 2861 00010000:00010000:2.0:1716999789.356980:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6d22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999789.356983:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483015936:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999789.357143:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+10:3219:x1800404483016064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6149us (6790us total) trans 4294970158 rc 0/0 00000100:00100000:2.0:1716999789.357149:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10062 00000100:00100000:0.0:1716999789.357344:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+80:1958:x1800404480730240:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1954us (2131us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.357352:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4569 00010000:00010000:0.0:1716999789.357381:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009216f180/0x6d188eabd8dc54d3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x603:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6589e expref: 79 pid: 11262 timeout: 408 lvb_type: 0 00000100:00100000:0.0:1716999789.357391:0:8341:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099581f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483016448:192.168.203.3@tcp:104: 00000004:00080000:3.0:1716999789.357394:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092df3480/2, rc 0, transno 2862 00000100:00100000:3.0:1716999789.357401:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483016064:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1716999789.357504:0:8341:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.357516:0:8341:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.357522:0:8341:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999789.357528:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999789.357528:0:8341:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.357533:0:8341:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.357543:0:8341:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.357548:0:8341:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999789.357550:0:8341:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.357556:0:8341:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.357565:0:8341:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.357570:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc6d1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x603:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999789.357990:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3219:x1800404483016000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7224us (7660us total) trans 4294970159 rc 0/0 00000100:00100000:0.0:1716999789.357996:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10061 00000004:00080000:1.0:1716999789.358001:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb88e00/2, rc 0, transno 2863 00000100:00100000:1.0:1716999789.358007:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483016000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999789.358016:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480730496 00000100:00100000:0.0:1716999789.358020:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480730496 00000100:00100000:0.0:1716999789.358039:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45744 00000100:00100000:0.0:1716999789.358043:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480730496:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.358055:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.358066:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6d3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660f5 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.358157:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6d45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358167:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358174:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358184:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6d4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358189:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358193:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358223:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6d45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358228:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6d45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358232:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6d45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358236:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.358238:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6d45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358242:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6d45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358251:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.358254:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.358256:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6d45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358260:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc6d45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358267:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6d4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358271:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6d4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358275:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6d4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358279:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.358281:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6d4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358285:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6d4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358290:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6cad4e9d (ffff88008a83f100) 00010000:00010000:0.0:1716999789.358292:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.358294:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6d4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358298:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc6d4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.358318:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6d3e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660f5 expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.358325:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6d3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660f5 expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.358332:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132880, rc 0) 00000100:00100000:0.0:1716999789.358358:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480730496:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 314us (831us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999789.358363:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45744 00000100:00100000:3.0:1716999789.360451:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.360521:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480730560 00000100:00100000:0.0:1716999789.360641:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480730560 00000100:00100000:0.0:1716999789.360690:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45745 00000100:00100000:0.0:1716999789.360696:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480730560:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.360705:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.360714:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6d53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f660fc expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.360746:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6d5a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.360755:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6d5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.360762:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6d5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.360831:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6d61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.360837:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6d61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.360846:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6d61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.360995:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6d5a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361001:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6d5a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361005:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6d5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361009:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.361011:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6d5a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361016:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6d5a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361024:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.361026:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.361029:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6d5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361033:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6d5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361040:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6d61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361045:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6d61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361049:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6d61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361054:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.361056:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6d61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361059:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6d61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361064:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6cfa4d9f (ffff88008a83ff00) 00010000:00010000:0.0:1716999789.361065:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.361067:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6d61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361070:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6d61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.361103:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6d53 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660fc expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.361109:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6d53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660fc expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.361117:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130240, rc 0) 00000100:00100000:0.0:1716999789.361152:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480730560:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 455us (704us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999789.361158:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45745 00000100:00100000:2.0:1716999789.363175:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.363248:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480730688 00000100:00100000:0.0:1716999789.363253:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480730688 00000100:00100000:0.0:1716999789.363274:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45746 00000100:00100000:0.0:1716999789.363279:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480730688:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.363290:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.363298:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6d68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66103 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.363353:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6d6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363362:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6d6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363368:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6d6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363378:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6d76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363407:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363413:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363445:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6d6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363451:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6d6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363455:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6d6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363460:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.363462:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6d6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363468:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6d6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363475:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.363478:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.363480:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6d6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363484:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6d6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363491:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6d76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363495:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6d76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363499:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363503:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.363505:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6d76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363509:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6d76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363514:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6cfa4d9f (ffff88008a83fa00) 00010000:00010000:0.0:1716999789.363516:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.363518:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6d76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363522:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6d76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cfa4d9f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.363543:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6d68 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66103 expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.363572:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6d68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66103 expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.363579:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131d40, rc 0) 00000100:00100000:0.0:1716999789.363614:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480730688:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 334us (442us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999789.363620:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45746 00000100:00100000:0.0:1716999789.364761:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.364931:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480730752 00000100:00100000:1.0:1716999789.364936:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480730752 00000100:00100000:1.0:1716999789.364954:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45747 00000100:00100000:1.0:1716999789.364959:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480730752:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.364968:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.364976:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc6d7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6610a expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.365000:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6d84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365006:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365012:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365020:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6d8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365024:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365028:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365057:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6d84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365061:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6d84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365064:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6d84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365068:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.365071:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6d84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365075:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6d84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365081:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.365083:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.365085:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6d84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365088:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6d84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365095:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6d8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365098:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6d8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365102:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6d8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365105:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.365107:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6d8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365110:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6d8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365114:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6cad4e9d (ffff880131c40b00) 00010000:00010000:1.0:1716999789.365116:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.365117:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6d8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365121:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6d8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.365141:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc6d7d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6610a expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.365147:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc6d7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6610a expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.365152:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364fc0, rc 0) 00000100:00100000:1.0:1716999789.365185:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480730752:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 225us (424us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999789.365191:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45747 00000100:00100000:2.0:1716999789.367174:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.367195:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480730880 00000100:00100000:1.0:1716999789.367201:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480730880 00000100:00100000:1.0:1716999789.367225:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45748 00000100:00100000:1.0:1716999789.367230:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+589:11420:x1800404480730880:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.367241:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.367243:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1716999789.367260:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6cab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660cb expref: 589 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.367271:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.367275:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.367286:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6d92 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66111 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.367370:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6d99 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.367380:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6d99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.367392:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6d99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.367403:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6da0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.367408:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6da0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.367413:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6da0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:1.0:1716999789.367870:0:6822:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x610:0x0], index 1: 0 00000040:00080000:1.0:1716999789.367989:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11517, 184 off2059600 00010000:00010000:1.0:1716999789.368098:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc6da7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.368105:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc6da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.368111:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc6da7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.368132:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6d99 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.368137:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6d99 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.368143:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6d99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.368148:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.368152:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6d99 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.368158:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6d99 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.368166:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.368168:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.368170:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6d99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.368175:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6d99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:1.0:1716999789.368184:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bcbb80 reply state ffff88012d290000 transno 4294986132 ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6da0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999789.368189:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999789.368206:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6d92 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66111 expref: 591 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.368214:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc6da7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66111 expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.368220:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc57:0x0].0x0 (ffff880131c40100) 00010000:00010000:1.0:1716999789.368222:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999789.368223:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364900, rc 0) 00000100:00100000:1.0:1716999789.368261:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480730880:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1031us (1090us total) trans 4294986132 rc 0/0 00000100:00100000:1.0:1716999789.368267:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45748 00000100:00100000:2.0:1716999789.370426:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.370446:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480730944 00000100:00100000:1.0:1716999789.370451:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480730944 00000100:00100000:1.0:1716999789.370475:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10064 00000100:00100000:1.0:1716999789.370480:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480730944:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.370490:0:8341:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.370502:0:8341:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091365440/0x6d188eabd8dc6db5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66118 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1716999789.370518:0:8341:0:(ofd_lvb.c:170:ofd_lvbo_init()) res: [0x280000400:0x610:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1716999789.370567:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999789.370569:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6da0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.370569:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.370574:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091365440/0x6d188eabd8dc6db5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66118 expref: 79 pid: 8341 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999789.370579:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6da0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.370584:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6da0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.370584:0:8341:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091365440/0x6d188eabd8dc6db5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66118 expref: 79 pid: 8341 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1716999789.370589:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.370592:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6da0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.370592:0:8341:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365440, rc 0) 00010000:00010000:3.0:1716999789.370597:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6da0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.370606:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6cad4e9d (ffff880131c40d00) 00010000:00010000:3.0:1716999789.370608:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.370611:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6da0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999789.370613:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480730944:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 133us (191us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999789.370615:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6da0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999789.370617:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10064 00000100:00100000:1.0:1716999789.372684:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.372984:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731072 00000100:00100000:3.0:1716999789.372990:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731072 00000100:00100000:3.0:1716999789.373014:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9138 00000100:00100000:3.0:1716999789.373020:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+590:11420:x1800404480731072:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999789.373321:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11518, 168 off2059768 00000001:00080000:3.0:1716999789.373326:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986133 00000100:00100000:3.0:1716999789.373405:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480731072:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 384us (723us total) trans 4294986134 rc 0/0 00000100:00100000:3.0:1716999789.373411:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9138 00000020:00080000:3.0:1716999789.373415:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.375977:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.376222:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731200 00000100:00100000:1.0:1716999789.376228:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731200 00000100:00100000:1.0:1716999789.376257:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45749 00000100:00100000:1.0:1716999789.376263:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480731200:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.376281:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.376294:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6dbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6611f expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.376363:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc6dc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xc57:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.376373:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc6dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc57:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.376385:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc6dc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xc57:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:1.0:1716999789.376393:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc57:0x0]: returning size 0 00010000:00010000:1.0:1716999789.376556:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6dbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6611f expref: 595 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.376622:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc6dc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xc57:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6611f expref: 594 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.376629:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc57:0x0].0x0 (ffff880131c40100) 00010000:00010000:1.0:1716999789.376631:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1716999789.376633:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364d80, rc 0) 00000100:00100000:1.0:1716999789.376659:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+594:11420:x1800404480731200:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 397us (687us total) trans 4294986135 rc 0/0 00000100:00100000:1.0:1716999789.376664:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45749 00000100:00100000:0.0:1716999789.379061:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.379096:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731264 00000100:00100000:1.0:1716999789.379101:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731264 00000100:00100000:1.0:1716999789.379452:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10065 00000100:00100000:1.0:1716999789.379459:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+79:11420:x1800404480731264:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.379470:0:8341:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.379481:0:8341:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66126 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.379500:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091365440/0x6d188eabd8dc6db5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66118 expref: 80 pid: 8341 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999789.379507:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.379508:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999789.379511:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66126 expref: 80 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.379532:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091365440/0x6d188eabd8dc6db5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66118 expref: 80 pid: 8341 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1716999789.379541:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091365440/0x6d188eabd8dc6db5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66118 expref: 80 pid: 8341 timeout: 408 lvb_type: 1 00000100:00100000:1.0:1716999789.379552:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8341:1800404483016576:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999789.379584:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800921ea540 going to sleep for 11 seconds 00000100:00100000:0.0:1716999789.380625:0:8341:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008fc1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8341:1800404483016576:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999789.380641:0:8341:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66126 expref: 80 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.380651:0:8341:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365b00, rc 0) 00000100:00100000:0.0:1716999789.380672:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+80:11420:x1800404480731264:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1213us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.380677:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10065 00000100:00100000:2.0:1716999789.383472:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.383620:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731328 00000100:00100000:0.0:1716999789.383626:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731328 00010000:00010000:0.0:1716999789.383648:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091365440/0x6d188eabd8dc6db5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66118 expref: 80 pid: 8341 timeout: 408 lvb_type: 1 00000100:00100000:0.0:1716999789.383682:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4571 00000100:00100000:0.0:1716999789.383687:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+80:1958:x1800404480731328:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999789.383699:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999789.383716:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091365440/0x6d188eabd8dc6db5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66118 expref: 80 pid: 8341 timeout: 408 lvb_type: 1 00010000:00010000:0.0:1716999789.383725:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091365440/0x6d188eabd8dc6db5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66118 expref: 80 pid: 8341 timeout: 408 lvb_type: 1 00010000:00010000:0.0:1716999789.383740:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091365440/0x6d188eabd8dc6db5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66118 expref: 80 pid: 8341 timeout: 408 lvb_type: 1 00010000:00010000:0.0:1716999789.383753:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999789.383754:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999789.383760:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66126 expref: 79 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.383766:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66126 expref: 79 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.383790:0:15839:0:(ldlm_lockd.c:1135:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66126 expref: 79 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999789.383800:0:15839:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c704700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483016640:192.168.203.3@tcp:105: 00000100:00100000:0.0:1716999789.384291:0:15839:0:(client.c:2542:ptlrpc_set_wait()) set ffff88012b20b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1716999789.387272:0:15839:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008c704700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:15839:1800404483016640:192.168.203.3@tcp:105: 00010000:00010000:0.0:1716999789.387286:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999789.387314:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+79:1958:x1800404480731328:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3625us (3845us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.387332:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4571 00000100:00100000:0.0:1716999789.389502:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+78:1958:x1800404480730304:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 33437us (34309us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.389510:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10063 00000001:00080000:1.0:1716999789.389682:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970154 is committed 00000001:00080000:1.0:1716999789.389694:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970155 is committed 00000100:00100000:1.0:1716999789.390378:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.390470:0:25372:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731392 00000100:00100000:2.0:1716999789.390477:0:25372:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731392 00002000:00100000:2.0:1716999789.390505:0:25372:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x60e:0x0] (0->4095) req@ffff88008fc1ce00 x1800404480731392/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:695/0 lens 4584/0 e 0 to 0 dl 1716999800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999789.390514:0:25372:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc1ce00 with x1800404480731392 ext(0->4095) 00002000:00010000:2.0:1716999789.390518:0:25372:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc1ce00 00000100:00100000:2.0:1716999789.390540:0:25372:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1439 00000100:00100000:2.0:1716999789.390546:0:25372:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:107d663a-2216-406b-94c6-b2fcb1558728+76:1958:x1800404480731392:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:2.0:1716999789.390865:0:25372:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:107d663a-2216-406b-94c6-b2fcb1558728+78:1958:x1800404480731392:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 318us (488us total) trans 4294970160 rc 0/0 00000100:00100000:2.0:1716999789.390871:0:25372:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1439 00002000:00100000:2.0:1716999789.390877:0:25372:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x60e:0x0] (0->4095) req@ffff88008fc1ce00 x1800404480731392/t4294970160(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:695/0 lens 4584/448 e 0 to 0 dl 1716999800 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999789.390903:0:25372:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff88008fc1ce00 with x1800404480731392 ext(0->4095) 00002000:00010000:2.0:1716999789.390906:0:25372:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008fc1ce00 00000100:00100000:1.0:1716999789.391319:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.391386:0:25372:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731456 00000100:00100000:2.0:1716999789.391390:0:25372:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731456 00002000:00100000:2.0:1716999789.391405:0:25372:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x60e:0x0] (0->4095) req@ffff880091558e00 x1800404480731456/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:695/0 lens 4584/0 e 0 to 0 dl 1716999800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999789.391411:0:25372:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091558e00 with x1800404480731456 ext(0->4095) 00002000:00010000:2.0:1716999789.391414:0:25372:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091558e00 00000100:00100000:2.0:1716999789.391425:0:25372:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1440 00000100:00100000:2.0:1716999789.391434:0:25372:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:107d663a-2216-406b-94c6-b2fcb1558728+79:1958:x1800404480731456:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:2.0:1716999789.391695:0:25372:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:107d663a-2216-406b-94c6-b2fcb1558728+81:1958:x1800404480731456:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 263us (375us total) trans 4294970198 rc 0/0 00000100:00100000:2.0:1716999789.391701:0:25372:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1440 00002000:00100000:2.0:1716999789.391706:0:25372:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x60e:0x0] (0->4095) req@ffff880091558e00 x1800404480731456/t4294970198(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:695/0 lens 4584/448 e 0 to 0 dl 1716999800 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999789.391712:0:25372:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091558e00 with x1800404480731456 ext(0->4095) 00002000:00010000:2.0:1716999789.391715:0:25372:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091558e00 00000100:00100000:3.0:1716999789.392436:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.392926:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731520 00000100:00100000:0.0:1716999789.392931:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731520 00000100:00100000:1.0:1716999789.392986:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.393071:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731584 00000100:00100000:0.0:1716999789.393074:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731584 00000100:00100000:3.0:1716999789.393080:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45750 00000100:00100000:3.0:1716999789.393086:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+595:11420:x1800404480731520:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:0.0:1716999789.393125:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45751 00000100:00100000:0.0:1716999789.393130:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+595:11419:x1800404480731584:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:3.0:1716999789.393158:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+595:11420:x1800404480731520:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 72us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.393161:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+595:11419:x1800404480731584:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 31us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.393164:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45750 00000100:00100000:0.0:1716999789.393166:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45751 00000100:00100000:3.0:1716999789.395329:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.395475:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.395609:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731712 00000100:00100000:0.0:1716999789.395615:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731712 00000100:00100000:1.0:1716999789.395620:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731648 00000100:00100000:1.0:1716999789.395625:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731648 00000100:00100000:0.0:1716999789.395639:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10066 00000100:00100000:1.0:1716999789.395645:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10067 00000100:00100000:0.0:1716999789.395645:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+81:1959:x1800404480731712:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:1.0:1716999789.395650:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480731648:12345-192.168.203.3@tcp:16:dbench.0 00000001:00080000:2.0:1716999789.449045:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970198 is committed 00000100:00100000:1.0:1716999789.449568:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+79:1959:x1800404480731712:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 53918us (54238us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.449577:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10066 00000100:00100000:1.0:1716999789.456509:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.456832:0:25372:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731776 00000100:00100000:2.0:1716999789.456839:0:25372:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731776 00002000:00100000:2.0:1716999789.456870:0:25372:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x60f:0x0] (0->4095) req@ffff880091559180 x1800404480731776/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:695/0 lens 4584/0 e 0 to 0 dl 1716999800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999789.456896:0:25372:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091559180 with x1800404480731776 ext(0->4095) 00002000:00010000:2.0:1716999789.456901:0:25372:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091559180 00000100:00100000:2.0:1716999789.456918:0:25372:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1441 00000100:00100000:2.0:1716999789.456923:0:25372:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:107d663a-2216-406b-94c6-b2fcb1558728+79:1957:x1800404480731776:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:2.0:1716999789.457643:0:25372:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:107d663a-2216-406b-94c6-b2fcb1558728+81:1957:x1800404480731776:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 717us (1138us total) trans 4294970199 rc 0/0 00000100:00100000:2.0:1716999789.457649:0:25372:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1441 00002000:00100000:2.0:1716999789.457655:0:25372:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x60f:0x0] (0->4095) req@ffff880091559180 x1800404480731776/t4294970199(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:695/0 lens 4584/448 e 0 to 0 dl 1716999800 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:2.0:1716999789.457662:0:25372:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880091559180 with x1800404480731776 ext(0->4095) 00002000:00010000:2.0:1716999789.457665:0:25372:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091559180 00000100:00100000:1.0:1716999789.461344:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.461399:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731840 00000100:00100000:0.0:1716999789.461406:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731840 00000100:00100000:0.0:1716999789.461437:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45752 00000100:00100000:0.0:1716999789.461443:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480731840:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:0.0:1716999789.461521:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480731840:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 78us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.461527:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45752 00000100:00100000:2.0:1716999789.465116:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.465224:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731904 00000100:00100000:1.0:1716999789.465231:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731904 00000100:00100000:1.0:1716999789.465260:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10068 00000100:00100000:1.0:1716999789.465266:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+81:1959:x1800404480731904:12345-192.168.203.3@tcp:16:dbench.0 00000001:00080000:1.0:1716999789.474750:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970159 is committed 00000001:00080000:1.0:1716999789.474761:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970160 is committed 00000100:00100000:0.0:1716999789.474917:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+76:1959:x1800404480731648:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 79261us (79437us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.474927:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10067 00000100:00100000:2.0:1716999789.481254:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.481303:0:16536:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480731968 00000100:00100000:3.0:1716999789.481311:0:16536:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480731968 00002000:00100000:3.0:1716999789.481343:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x60f:0x0] (0->4095) req@ffff880099bc8a80 x1800404480731968/t0(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:695/0 lens 4584/0 e 0 to 0 dl 1716999800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999789.481352:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bc8a80 with x1800404480731968 ext(0->4095) 00002000:00010000:3.0:1716999789.481357:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bc8a80 00000100:00100000:3.0:1716999789.481373:0:16536:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 1442 00000100:00100000:3.0:1716999789.481379:0:16536:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+76:1956:x1800404480731968:12345-192.168.203.3@tcp:4:dbench.0 00000100:00100000:3.0:1716999789.482613:0:16536:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:107d663a-2216-406b-94c6-b2fcb1558728+78:1956:x1800404480731968:12345-192.168.203.3@tcp:4:dbench.0 Request processed in 1230us (1361us total) trans 4294970161 rc 0/0 00000100:00100000:3.0:1716999789.482621:0:16536:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 1442 00002000:00100000:3.0:1716999789.482629:0:16536:0:(ofd_dev.c:2616:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x60f:0x0] (0->4095) req@ffff880099bc8a80 x1800404480731968/t4294970161(0) o4->107d663a-2216-406b-94c6-b2fcb1558728@192.168.203.3@tcp:695/0 lens 4584/448 e 0 to 0 dl 1716999800 ref 1 fl Complete:/200/0 rc 0/0 job:'dbench.0' uid:0 gid:0 00002000:00100000:3.0:1716999789.482636:0:16536:0:(ofd_dev.c:2475:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bc8a80 with x1800404480731968 ext(0->4095) 00002000:00010000:3.0:1716999789.482639:0:16536:0:(ofd_dev.c:2621:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bc8a80 00000100:00100000:1.0:1716999789.484910:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.484936:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732032 00000100:00100000:1.0:1716999789.484941:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732032 00000100:00100000:1.0:1716999789.484970:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45753 00000100:00100000:1.0:1716999789.484976:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+594:11420:x1800404480732032:12345-192.168.203.3@tcp:44:dbench.0 00000100:00100000:1.0:1716999789.485051:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+594:11420:x1800404480732032:12345-192.168.203.3@tcp:44:dbench.0 Request processed in 75us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.485057:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45753 00000100:00100000:0.0:1716999789.486789:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.486923:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732096 00000100:00100000:1.0:1716999789.486929:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732096 00000100:00100000:1.0:1716999789.487140:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10069 00000100:00100000:1.0:1716999789.487146:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b87d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+78:1959:x1800404480732096:12345-192.168.203.3@tcp:16:dbench.0 00000100:00100000:1.0:1716999789.524024:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+81:1959:x1800404480731904:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 58751us (58907us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.524033:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10068 00000001:00080000:1.0:1716999789.524059:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970199 is committed 00000100:00100000:1.0:1716999789.532615:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.532639:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732160 00000100:00100000:1.0:1716999789.532650:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732160 00000100:00100000:1.0:1716999789.532680:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45754 00000100:00100000:1.0:1716999789.532686:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480732160:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.532701:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.532715:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6dd8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6612d expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.532754:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc6ddf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532765:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc6ddf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532773:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc6ddf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532783:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6de6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532788:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6de6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532793:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6de6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532864:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc6ddf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532870:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc6ddf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532875:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc6ddf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532900:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.532903:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc6ddf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532909:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc6ddf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532918:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.532920:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.532923:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc6ddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532928:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc6ddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532936:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6de6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532941:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6de6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532946:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6de6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532949:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091367600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.532951:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6de6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.532956:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6de6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.534005:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x78ea50f (ffff88009c21ff00) 00010000:00010000:1.0:1716999789.534008:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.534012:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6de6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.534016:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6de6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x78ea50f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.534144:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6dd8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6612d expref: 595 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.534152:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6dd8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6612d expref: 595 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.534160:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091365d40, rc 0) 00000100:00100000:1.0:1716999789.534200:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480732160:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 1514us (1590us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999789.534206:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45754 00000100:00100000:2.0:1716999789.537350:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.537446:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732224 00000100:00100000:0.0:1716999789.537453:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732224 00000100:00100000:0.0:1716999789.537481:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45755 00000100:00100000:0.0:1716999789.537486:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480732224:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.537499:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.537513:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6ded lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66134 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.537535:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66134 expref: 595 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.537545:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6ded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66134 expref: 595 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.537552:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999789.537554:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.537556:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133180, rc 0) 00000100:00100000:0.0:1716999789.537582:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+595:11419:x1800404480732224:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 96us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.537587:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45755 00000001:00080000:1.0:1716999789.540064:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970161 is committed 00000100:00100000:0.0:1716999789.540236:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b87d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+76:1959:x1800404480732096:12345-192.168.203.3@tcp:16:dbench.0 Request processed in 53087us (53445us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.540245:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10069 00000100:00100000:2.0:1716999789.542233:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.542297:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732288 00000100:00100000:3.0:1716999789.542304:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732288 00000100:00100000:3.0:1716999789.542355:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9139 00000100:00100000:3.0:1716999789.542361:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+595:11419:x1800404480732288:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999789.544422:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.544750:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732352 00000100:00100000:0.0:1716999789.544755:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732352 00000100:00100000:0.0:1716999789.544779:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9140 00000100:00100000:0.0:1716999789.544784:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+597:11420:x1800404480732352:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999789.548148:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+596:11419:x1800404480732288:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5779us (5911us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.548148:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+596:11420:x1800404480732352:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3355us (3722us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.548157:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9140 00000100:00100000:3.0:1716999789.548358:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9139 00000100:00100000:2.0:1716999789.551237:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.551302:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732416 00000100:00100000:3.0:1716999789.551309:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732416 00000100:00100000:3.0:1716999789.551334:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9141 00000100:00100000:3.0:1716999789.551340:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+595:11419:x1800404480732416:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999789.552176:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.552446:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732544 00000100:00100000:0.0:1716999789.552450:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732544 00000100:00100000:0.0:1716999789.552468:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9142 00000100:00100000:0.0:1716999789.552473:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+597:11420:x1800404480732544:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999789.552586:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+598:11420:x1800404480732544:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 112us (411us total) trans 4294986136 rc 0/0 00000100:00100000:0.0:1716999789.552592:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9142 00000100:00100000:3.0:1716999789.554499:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+596:11419:x1800404480732416:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3153us (3262us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.554507:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9141 00000100:00100000:2.0:1716999789.554991:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.555171:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732672 00000100:00100000:0.0:1716999789.555176:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732672 00000100:00100000:0.0:1716999789.555199:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45756 00000100:00100000:0.0:1716999789.555205:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+596:11420:x1800404480732672:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.555234:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.555250:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1f80/0x6d188eabd8d7b157 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c1:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4efc3 expref: 596 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.555265:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1b00/0x6d188eabd8d7b0cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ef8b expref: 595 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.555278:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c574480/0x6d188eabd8d701bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b3b7 expref: 594 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.555287:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c1:0x0].0x0 (ffff880092a37700) 00010000:00010000:0.0:1716999789.555297:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215c240/0x6d188eabd8d7a45a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4eb63 expref: 593 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.555303:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x0 (ffff880099d1be00) 00010000:00010000:0.0:1716999789.555306:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.555323:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6df4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555332:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6df4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555339:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6df4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555350:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6dfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171ee56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555355:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6dfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555360:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6dfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555436:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6e02 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555442:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6e02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555448:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6e02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999789.555856:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1488, 64 off103488 00000040:00080000:0.0:1716999789.555875:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11519, 184 off2059952 00010000:00010000:0.0:1716999789.555961:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6e09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555968:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6e09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555974:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6e09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555980:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6e09 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555985:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6e09 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555989:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6e09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555994:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6e09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.555999:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999789.556002:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6e09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556007:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6e09 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6c1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556013:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c1:0x0].0x0 (ffff88012ca38900) 00010000:00010000:0.0:1716999789.556016:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999789.556018:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6e09 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6c1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556022:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc6e09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556038:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6e02 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556043:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6e02 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556047:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6e02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556051:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.556053:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6e02 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556058:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6e02 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556063:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c1:0x0].0x0 (ffff88012ca38900) 00010000:00010000:0.0:1716999789.556064:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.556066:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6e02 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556070:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc6e02 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6c1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556102:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6df4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556107:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6df4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556112:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6df4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556116:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.556118:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6df4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556123:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6df4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556128:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x0 (ffff880099d1be00) 00010000:00010000:0.0:1716999789.556130:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.556132:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6df4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.556136:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc6df4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999789.556143:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bc9c00 reply state ffff880134b8b000 transno 4294986137 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6dfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.556149:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.556197:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+594:11420:x1800404480732672:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 991us (1206us total) trans 4294986137 rc 0/0 00000100:00100000:0.0:1716999789.556203:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45756 00010000:00010000:0.0:1716999789.559079:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6dfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.559090:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6dfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.559096:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6dfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.559100:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.559104:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6dfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.559110:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6dfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.559120:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x8171ee56 (ffff88012ca38600) 00010000:00010000:0.0:1716999789.559123:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.559126:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6dfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.559130:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc6dfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999789.562333:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.562374:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.562380:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732736 00000100:00100000:0.0:1716999789.562392:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732736 00000100:00100000:0.0:1716999789.562427:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45757 00000100:00100000:0.0:1716999789.562432:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+593:11420:x1800404480732736:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.562451:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.562465:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6e10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6613b expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.562508:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6e17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.562519:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.562527:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:0.0:1716999789.562580:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6fc:0x0]: returning size 11776 00000004:00200000:0.0:1716999789.562582:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999789.562592:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.562605:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc6e10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6613b expref: 595 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.562614:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6e17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6613b expref: 594 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.562619:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x0 (ffff88012ca38d00) 00010000:00010000:0.0:1716999789.562620:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1716999789.562622:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130240, rc 0) 00000100:00100000:1.0:1716999789.562648:0:4523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732800 00000100:00100000:1.0:1716999789.562652:0:4523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732800 00000100:00100000:0.0:1716999789.562661:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+595:11420:x1800404480732736:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 229us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.562665:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45757 00000100:00100000:1.0:1716999789.562670:0:4523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:1.0:1716999789.562675:0:4523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+594:1956:x1800404480732800:12345-192.168.203.3@tcp:63:ll_sa.0 00010000:00010000:1.0:1716999789.562695:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.562702:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6e1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66142 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.562720:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6e25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.562727:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6e25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.562734:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6e25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.562743:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6e2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.562748:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.562752:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563631:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc6e33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563640:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc6e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563646:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc6e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.563677:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6f5:0x0]: returning size 11776 00000004:00200000:1.0:1716999789.563679:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.563687:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc6e33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563694:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6e25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563699:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6e25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563704:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6e25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563712:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091366ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.563715:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6e25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563721:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6e25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563728:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:1.0:1716999789.563731:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.563733:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6e25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563738:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366ac0/0x6d188eabd8dc6e25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563746:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6e2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563751:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6e2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563755:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563759:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.563761:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6e2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563765:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6e2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563770:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x44a1a1a7 (ffff8800900d1600) 00010000:00010000:1.0:1716999789.563772:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.563774:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6e2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563779:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365f80/0x6d188eabd8dc6e2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563797:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366880/0x6d188eabd8dc6e1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66142 expref: 596 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.563817:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc6e33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66142 expref: 595 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.563822:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0x0 (ffff8800910ce400) 00010000:00010000:1.0:1716999789.563824:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.563826:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091364fc0, rc 0) 00010000:00010000:1.0:1716999789.563830:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.563836:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6e3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66149 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.563851:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6e41 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563857:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6e41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563863:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6e41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563871:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6e48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563876:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563911:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563957:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6e4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563964:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.563969:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.563990:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6cb:0x0]: returning size 11776 00000004:00200000:1.0:1716999789.563992:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.563998:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6e4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564003:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6e41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564008:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6e41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564012:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6e41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564016:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091364240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.564018:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6e41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564022:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6e41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564028:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:1.0:1716999789.564031:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.564033:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6e41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564037:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364240/0x6d188eabd8dc6e41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564044:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6e48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564048:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6e48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564052:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564056:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091365d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.564057:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6e48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564061:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6e48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564066:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x45435891 (ffff8800900d1200) 00010000:00010000:1.0:1716999789.564068:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.564070:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6e48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564073:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365d40/0x6d188eabd8dc6e48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564086:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366400/0x6d188eabd8dc6e3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66149 expref: 597 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.564098:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6e4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66149 expref: 596 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.564103:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x0 (ffff8800a660c800) 00010000:00010000:1.0:1716999789.564105:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.564106:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091367600, rc 0) 00010000:00010000:1.0:1716999789.564109:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.564114:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc6e56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66150 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.564129:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0fc0/0x6d188eabd8dc6e5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564134:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0fc0/0x6d188eabd8dc6e5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564140:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0fc0/0x6d188eabd8dc6e5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564148:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2400/0x6d188eabd8dc6e64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564152:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2400/0x6d188eabd8dc6e64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564157:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2400/0x6d188eabd8dc6e64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564194:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e33c0/0x6d188eabd8dc6e6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x730:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564200:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e33c0/0x6d188eabd8dc6e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564206:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e33c0/0x6d188eabd8dc6e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.564226:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x730:0x0]: returning size 11776 00000004:00200000:1.0:1716999789.564228:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.564234:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e33c0/0x6d188eabd8dc6e6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564239:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0fc0/0x6d188eabd8dc6e5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564243:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0fc0/0x6d188eabd8dc6e5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564248:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0fc0/0x6d188eabd8dc6e5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564251:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800999e0fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.564253:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0fc0/0x6d188eabd8dc6e5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564258:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0fc0/0x6d188eabd8dc6e5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564263:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:1.0:1716999789.564265:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.564267:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0fc0/0x6d188eabd8dc6e5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564271:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0fc0/0x6d188eabd8dc6e5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564278:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2400/0x6d188eabd8dc6e64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564282:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2400/0x6d188eabd8dc6e64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564287:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2400/0x6d188eabd8dc6e64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564290:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800999e2400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.564292:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2400/0x6d188eabd8dc6e64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564296:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2400/0x6d188eabd8dc6e64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564301:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x45439694 (ffff8800900d1a00) 00010000:00010000:1.0:1716999789.564303:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.564304:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2400/0x6d188eabd8dc6e64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564308:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2400/0x6d188eabd8dc6e64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564320:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365440/0x6d188eabd8dc6e56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66150 expref: 598 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.564328:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e33c0/0x6d188eabd8dc6e6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66150 expref: 597 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.564333:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x730:0x0].0x0 (ffff880131c40500) 00010000:00010000:1.0:1716999789.564335:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.564337:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999e33c0, rc 0) 00010000:00010000:1.0:1716999789.564339:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.564344:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3a80/0x6d188eabd8dc6e72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66157 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.564356:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2d00/0x6d188eabd8dc6e79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564361:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2d00/0x6d188eabd8dc6e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564366:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2d00/0x6d188eabd8dc6e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564373:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3600/0x6d188eabd8dc6e80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564378:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3600/0x6d188eabd8dc6e80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564384:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3600/0x6d188eabd8dc6e80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564418:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2ac0/0x6d188eabd8dc6e87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564424:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2ac0/0x6d188eabd8dc6e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564428:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2ac0/0x6d188eabd8dc6e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.564445:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x704:0x0]: returning size 12800 00000004:00200000:1.0:1716999789.564447:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.564453:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2ac0/0x6d188eabd8dc6e87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564458:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2d00/0x6d188eabd8dc6e79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564463:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2d00/0x6d188eabd8dc6e79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564468:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2d00/0x6d188eabd8dc6e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564471:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800999e2d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.564473:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2d00/0x6d188eabd8dc6e79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564478:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2d00/0x6d188eabd8dc6e79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564484:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:1.0:1716999789.564486:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.564488:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2d00/0x6d188eabd8dc6e79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564492:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2d00/0x6d188eabd8dc6e79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564498:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3600/0x6d188eabd8dc6e80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564502:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3600/0x6d188eabd8dc6e80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564506:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3600/0x6d188eabd8dc6e80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564510:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800999e3600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.564512:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3600/0x6d188eabd8dc6e80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564519:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3600/0x6d188eabd8dc6e80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564524:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x41aa9094 (ffff8800900d1d00) 00010000:00010000:1.0:1716999789.564526:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.564528:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3600/0x6d188eabd8dc6e80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564532:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3600/0x6d188eabd8dc6e80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564544:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3a80/0x6d188eabd8dc6e72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66157 expref: 599 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.564551:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2ac0/0x6d188eabd8dc6e87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66157 expref: 598 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.564556:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.564558:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.564560:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999e2ac0, rc 0) 00010000:00010000:1.0:1716999789.564562:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.564566:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1680/0x6d188eabd8dc6e8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6615e expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.564578:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1200/0x6d188eabd8dc6e95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564584:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1200/0x6d188eabd8dc6e95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564589:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1200/0x6d188eabd8dc6e95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564598:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012facf3c0/0x6d188eabd8dc6e9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564603:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012facf3c0/0x6d188eabd8dc6e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564608:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012facf3c0/0x6d188eabd8dc6e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564642:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012face640/0x6d188eabd8dc6ea3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564648:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012face640/0x6d188eabd8dc6ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564653:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012face640/0x6d188eabd8dc6ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.564674:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6dd:0x0]: returning size 12800 00000004:00200000:1.0:1716999789.564676:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.564682:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012face640/0x6d188eabd8dc6ea3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564687:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1200/0x6d188eabd8dc6e95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564691:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1200/0x6d188eabd8dc6e95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564696:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1200/0x6d188eabd8dc6e95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564700:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800999e1200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.564702:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1200/0x6d188eabd8dc6e95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564707:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1200/0x6d188eabd8dc6e95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564712:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:1.0:1716999789.564713:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.564715:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1200/0x6d188eabd8dc6e95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564719:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1200/0x6d188eabd8dc6e95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564726:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012facf3c0/0x6d188eabd8dc6e9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564730:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012facf3c0/0x6d188eabd8dc6e9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564735:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012facf3c0/0x6d188eabd8dc6e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564738:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88012facf3c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.564740:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012facf3c0/0x6d188eabd8dc6e9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564744:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012facf3c0/0x6d188eabd8dc6e9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564749:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x45524f8f (ffff8800900d1b00) 00010000:00010000:1.0:1716999789.564750:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.564752:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012facf3c0/0x6d188eabd8dc6e9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564756:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012facf3c0/0x6d188eabd8dc6e9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564769:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1680/0x6d188eabd8dc6e8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6615e expref: 600 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.564776:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012face640/0x6d188eabd8dc6ea3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6615e expref: 599 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.564781:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:1.0:1716999789.564783:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.564784:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012face640, rc 0) 00010000:00010000:1.0:1716999789.564787:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.564791:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c21c0/0x6d188eabd8dc6eaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66165 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.564816:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1680/0x6d188eabd8dc6eb1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564822:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1680/0x6d188eabd8dc6eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564827:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1680/0x6d188eabd8dc6eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564835:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1440/0x6d188eabd8dc6eb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564840:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1440/0x6d188eabd8dc6eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.564845:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1440/0x6d188eabd8dc6eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.566894:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c0b40/0x6d188eabd8dc6ebf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.566908:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c0b40/0x6d188eabd8dc6ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.566915:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c0b40/0x6d188eabd8dc6ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.566958:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6c3:0x0]: returning size 11776 00000004:00200000:1.0:1716999789.566961:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.566971:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c0b40/0x6d188eabd8dc6ebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.566978:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1680/0x6d188eabd8dc6eb1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.566983:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1680/0x6d188eabd8dc6eb1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.566989:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1680/0x6d188eabd8dc6eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.566993:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800997c1680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.566996:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1680/0x6d188eabd8dc6eb1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567001:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1680/0x6d188eabd8dc6eb1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567009:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:1.0:1716999789.567011:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.567013:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1680/0x6d188eabd8dc6eb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567019:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1680/0x6d188eabd8dc6eb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567029:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1440/0x6d188eabd8dc6eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567033:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1440/0x6d188eabd8dc6eb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567038:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1440/0x6d188eabd8dc6eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567042:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800997c1440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.567044:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1440/0x6d188eabd8dc6eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567048:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1440/0x6d188eabd8dc6eb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567053:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x44524f57 (ffff8800900d1300) 00010000:00010000:1.0:1716999789.567055:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.567057:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1440/0x6d188eabd8dc6eb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567061:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1440/0x6d188eabd8dc6eb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567082:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c21c0/0x6d188eabd8dc6eaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66165 expref: 601 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.567093:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c0b40/0x6d188eabd8dc6ebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66165 expref: 600 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.567103:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:1.0:1716999789.567105:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.567106:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800997c0b40, rc 0) 00010000:00010000:1.0:1716999789.567111:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.567117:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c2f40/0x6d188eabd8dc6ec6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6616c expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.567138:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef0240/0x6d188eabd8dc6ecd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567144:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef0240/0x6d188eabd8dc6ecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567149:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef0240/0x6d188eabd8dc6ecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567160:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468000/0x6d188eabd8dc6ed4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567165:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468000/0x6d188eabd8dc6ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567170:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468000/0x6d188eabd8dc6ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567224:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b3c0/0x6d188eabd8dc6edb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567230:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b3c0/0x6d188eabd8dc6edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567235:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b3c0/0x6d188eabd8dc6edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.567257:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6d1:0x0]: returning size 11776 00000004:00200000:1.0:1716999789.567259:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.567265:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b3c0/0x6d188eabd8dc6edb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567270:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef0240/0x6d188eabd8dc6ecd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567274:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef0240/0x6d188eabd8dc6ecd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567279:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef0240/0x6d188eabd8dc6ecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567283:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88012fef0240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.567285:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef0240/0x6d188eabd8dc6ecd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567289:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef0240/0x6d188eabd8dc6ecd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567295:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:1.0:1716999789.567297:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.567299:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef0240/0x6d188eabd8dc6ecd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567304:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef0240/0x6d188eabd8dc6ecd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567310:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468000/0x6d188eabd8dc6ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567314:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468000/0x6d188eabd8dc6ed4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567318:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468000/0x6d188eabd8dc6ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567322:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a6468000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.567324:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468000/0x6d188eabd8dc6ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567328:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468000/0x6d188eabd8dc6ed4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567333:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x5052ab9e (ffff8800900d1e00) 00010000:00010000:1.0:1716999789.567335:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.567336:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468000/0x6d188eabd8dc6ed4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567340:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468000/0x6d188eabd8dc6ed4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.567354:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c2f40/0x6d188eabd8dc6ec6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6616c expref: 602 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.567362:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b3c0/0x6d188eabd8dc6edb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6616c expref: 601 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.567367:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999789.567369:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.567370:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a646b3c0, rc 0) 00000100:00100000:1.0:1716999789.568131:0:4523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+601:1956:x1800404480732800:12345-192.168.203.3@tcp:63:ll_sa.0 Request processed in 5451us (5752us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.568139:0:4523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9 00000100:00100000:3.0:1716999789.568982:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.569905:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.569996:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732992 00000100:00100000:0.0:1716999789.569997:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480732928 00000100:00100000:2.0:1716999789.570003:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732992 00000100:00100000:0.0:1716999789.570003:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480732928 00000100:00100000:0.0:1716999789.570038:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9143 00000100:00100000:0.0:1716999789.570044:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480732928:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999789.570048:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9144 00000100:00100000:2.0:1716999789.570051:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480732992:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999789.570185:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480732928:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 141us (1205us total) trans 4294986138 rc 0/0 00000100:00100000:0.0:1716999789.570191:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9143 00000100:00100000:3.0:1716999789.573725:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.574332:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480732992:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4277us (4426us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.574342:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9144 00000100:00100000:0.0:1716999789.574447:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480733120 00000100:00100000:0.0:1716999789.574454:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480733120 00000100:00100000:0.0:1716999789.574478:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45758 00000100:00100000:0.0:1716999789.574484:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480733120:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.574520:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.574538:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c2400/0x6d188eabd8d7b046 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c0:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ef5a expref: 602 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.574554:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419d440/0x6d188eabd8d7afd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ef29 expref: 601 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.574568:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c576f40/0x6d188eabd8d7013f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b386 expref: 600 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.574577:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c0:0x0].0x0 (ffff8800939c9a00) 00010000:00010000:0.0:1716999789.574589:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695cb40/0x6d188eabd8d7a326 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4eb0f expref: 599 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.574595:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x0 (ffff880099d1bf00) 00010000:00010000:0.0:1716999789.574598:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.574615:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6ee2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.574624:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6ee2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.574631:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6ee2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.574641:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ee9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171ee56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.574646:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.574652:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.574731:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6ef0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.574736:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6ef0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.574742:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6ef0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999789.575179:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1489, 64 off103552 00000004:00080000:0.0:1716999789.575184:0:7785:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 308774303782ns, next at 309774302557ns, rc = 0 00000040:00080000:0.0:1716999789.575201:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11520, 184 off2060136 00010000:00010000:0.0:1716999789.575247:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6ef7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575254:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575260:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6ef7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575266:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6ef7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575270:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6ef7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575275:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6ef7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575280:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6ef7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575285:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132880 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999789.575288:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6ef7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575294:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6ef7 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575300:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c0:0x0].0x0 (ffff88009c21ff00) 00010000:00010000:0.0:1716999789.575302:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999789.575304:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6ef7 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575309:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc6ef7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575325:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6ef0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575329:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6ef0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575333:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6ef0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575337:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.575340:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6ef0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575344:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6ef0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575350:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c0:0x0].0x0 (ffff88009c21ff00) 00010000:00010000:0.0:1716999789.575352:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.575354:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6ef0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575358:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc6ef0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6c0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575389:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6ee2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575393:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6ee2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575398:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6ee2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575401:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.575403:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6ee2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575407:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6ee2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575413:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x0 (ffff880099d1bf00) 00010000:00010000:0.0:1716999789.575414:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.575416:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6ee2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.575421:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc6ee2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999789.575427:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880129f4a300 reply state ffff880134b8e000 transno 4294986139 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.575431:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.575458:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+600:11419:x1800404480733120:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 973us (1738us total) trans 4294986139 rc 0/0 00000100:00100000:0.0:1716999789.575464:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45758 00010000:00010000:0.0:1716999789.578324:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.578334:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ee9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.578339:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ee9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.578343:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.578347:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ee9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.578352:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ee9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.578363:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x8171ee56 (ffff88009c21fc00) 00010000:00010000:0.0:1716999789.578365:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.578368:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ee9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.578372:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc6ee9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171ee56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999789.582637:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.582670:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.582965:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.582999:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480733248 00000100:00100000:2.0:1716999789.583006:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480733248 00000100:00100000:2.0:1716999789.583032:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480733376 00000100:00100000:2.0:1716999789.583034:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480733376 00000100:00100000:2.0:1716999789.583171:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9145 00000100:00100000:2.0:1716999789.583178:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+600:11419:x1800404480733248:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999789.583218:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9146 00000100:00100000:0.0:1716999789.583222:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+600:11420:x1800404480733376:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999789.583777:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480733248:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 598us (1146us total) trans 4294986141 rc 0/0 00000100:00100000:2.0:1716999789.583785:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9145 00000100:00100000:2.0:1716999789.583898:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480733440 00000100:00100000:2.0:1716999789.583901:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480733440 00000100:00100000:2.0:1716999789.583918:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45759 00000100:00100000:2.0:1716999789.583922:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+602:11537:x1800404480733440:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:2.0:1716999789.583931:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.583944:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6efe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66173 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.583964:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6efe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66173 expref: 603 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.583975:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6efe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66173 expref: 603 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.583981:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x0 (ffff88012ca38d00) 00010000:00010000:2.0:1716999789.583984:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.583987:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091830d80, rc 0) 00000100:00100000:2.0:1716999789.584001:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11537:x1800404480733440:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 78us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.584006:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45759 00000040:00080000:0.0:1716999789.584361:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11521, 168 off2060304 00000001:00080000:0.0:1716999789.584366:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986140 00000100:00100000:0.0:1716999789.584410:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480733376:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1187us (1739us total) trans 4294986142 rc 0/0 00000100:00100000:0.0:1716999789.584417:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9146 00000020:00080000:0.0:1716999789.584420:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999789.588085:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.588446:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480733568 00000100:00100000:2.0:1716999789.588455:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480733568 00000100:00100000:2.0:1716999789.588487:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45760 00000100:00100000:2.0:1716999789.588493:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480733568:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.588532:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1716999789.588550:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8d7adec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6be:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ee88 expref: 603 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.588577:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c0d80/0x6d188eabd8d7ad3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6be:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ee42 expref: 602 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.588587:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012facdb00/0x6d188eabd8d700a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6be:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b340 expref: 601 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.588595:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6be:0x0].0x0 (ffff88009a3b6e00) 00010000:00010000:2.0:1716999789.588602:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.588624:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6f05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.588634:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6f05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.588641:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6f05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.588651:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6f0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171ed56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.588656:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6f0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.588661:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6f0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.588744:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6f13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6be:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.588751:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6f13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.588756:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6f13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999789.589222:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.589593:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480733632 00000100:00100000:1.0:1716999789.589598:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480733632 00000100:00100000:1.0:1716999789.589629:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9147 00000100:00100000:1.0:1716999789.589634:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+601:11537:x1800404480733632:12345-192.168.203.3@tcp:37:ll_sa.0 00000040:00080000:2.0:1716999789.589792:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1490, 64 off103616 00000040:00080000:2.0:1716999789.589819:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11522, 184 off2060488 00010000:00010000:2.0:1716999789.589867:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6f1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6be:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.589874:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6be:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.589952:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6f1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6be:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.589959:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6f1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6be:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.589964:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6f1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6be:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.589968:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6f1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6be:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.589972:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6f1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6be:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.589976:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918318c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999789.589978:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6f1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6be:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.589984:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6f1a lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6be:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.589990:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6be:0x0].0x0 (ffff880088977600) 00010000:00010000:2.0:1716999789.589992:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999789.589994:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6f1a lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6be:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.589998:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc6f1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6be:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590015:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6f13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590019:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6f13 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590022:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6f13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590025:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918321c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.590027:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6f13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590031:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6f13 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590035:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6be:0x0].0x0 (ffff880088977600) 00010000:00010000:2.0:1716999789.590037:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.590038:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6f13 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590042:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6f13 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6be:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590122:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6f05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590126:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6f05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590130:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6f05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590133:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.590135:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6f05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590139:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6f05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590145:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x0 (ffff880099d1bf00) 00010000:00010000:2.0:1716999789.590146:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.590149:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6f05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.590243:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6f05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999789.590251:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880129f48a80 reply state ffff8800911c8000 transno 4294986143 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6f0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999789.590257:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.590301:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+604:11419:x1800404480733568:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1806us (2221us total) trans 4294986143 rc 0/0 00000100:00100000:2.0:1716999789.590307:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45760 00000100:00100000:3.0:1716999789.590733:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.591539:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480733760 00000100:00100000:0.0:1716999789.591545:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480733760 00000100:00100000:0.0:1716999789.591578:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9148 00000100:00100000:0.0:1716999789.591584:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+604:11420:x1800404480733760:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999789.591714:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480733760:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 130us (981us total) trans 4294986144 rc 0/0 00000100:00100000:0.0:1716999789.591721:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9148 00010000:00010000:0.0:1716999789.595266:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6f0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.595276:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6f0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.595281:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6f0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.595285:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.595288:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6f0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.595293:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6f0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.595303:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x8171ed56 (ffff880088977400) 00010000:00010000:0.0:1716999789.595305:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.595308:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6f0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.595315:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc6f0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999789.595383:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.595436:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480733888 00000100:00100000:2.0:1716999789.595447:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480733888 00000100:00100000:2.0:1716999789.595482:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45761 00000100:00100000:2.0:1716999789.595488:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480733888:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:1.0:1716999789.595517:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11537:x1800404480733632:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 5882us (6295us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.595526:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9147 00010000:00010000:2.0:1716999789.595563:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1716999789.595575:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6f40/0x6d188eabd8d82fdc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6fe:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f518d5 expref: 602 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.595588:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009186c900/0x6d188eabd8d7e838 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6fe:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50197 expref: 601 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.595598:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf50000/0x6d188eabd8d7e77b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50166 expref: 600 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.595608:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8fa80/0x6d188eabd8d716f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc46 expref: 599 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.595615:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fe:0x0].0x0 (ffff88012bacd200) 00010000:00010000:2.0:1716999789.595624:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc6e17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6613b expref: 598 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.595631:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x0 (ffff88012ca38d00) 00010000:00010000:2.0:1716999789.595633:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.595652:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.595662:0:7785:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6efe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66173 expref: 597 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.595668:0:7785:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.595691:0:7785:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6efe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66173 expref: 597 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.595701:0:7785:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6efe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66173 expref: 597 pid: 11055 timeout: 408 lvb_type: 0 00000100:00100000:2.0:1716999789.595711:0:7785:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099bc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:7785:1800404483016704:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999789.595740:0:7785:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009c108c00 going to sleep for 11 seconds 00000100:00100000:3.0:1716999789.597284:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.597385:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480733952 00000100:00100000:0.0:1716999789.597390:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480733952 00010000:00010000:0.0:1716999789.597409:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6efe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66173 expref: 598 pid: 11055 timeout: 408 lvb_type: 0 00000100:00100000:0.0:1716999789.597479:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4572 00000100:00100000:0.0:1716999789.597484:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:1959:x1800404480733952:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999789.597494:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999789.597499:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6efe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66173 expref: 598 pid: 11055 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.597507:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6efe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66173 expref: 598 pid: 11055 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.597519:0:15839:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x0 (ffff88012ca38d00) 00010000:00010000:0.0:1716999789.597528:0:15839:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.597534:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.597539:0:15839:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.597552:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.597570:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc6efe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66173 expref: 598 pid: 11055 timeout: 408 lvb_type: 0 00000100:00100000:2.0:1716999789.597582:0:7785:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099bc9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:7785:1800404483016704:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999789.597595:0:7785:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.597603:0:7785:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.597607:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.597620:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6f28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6fc:0x0].0x582e84a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.597626:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.597632:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.597814:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6f2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6fe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.597822:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6f2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.597827:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6f2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.598016:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:1959:x1800404480733952:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 530us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.598025:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4572 00000040:00080000:2.0:1716999789.598303:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1491, 64 off103680 00000040:00080000:2.0:1716999789.598322:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11523, 176 off2060664 00010000:00010000:2.0:1716999789.598374:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6f36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6fe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598381:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598388:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6f36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598392:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6f36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598397:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6f36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598401:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6f36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598406:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6f36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598410:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999789.598413:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6f36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598419:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6f36 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598425:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fe:0x0].0x0 (ffff880088977100) 00010000:00010000:2.0:1716999789.598428:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999789.598430:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6f36 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598434:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc6f36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6fe:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598452:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6f2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598456:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6f2f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598460:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6f2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598464:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.598466:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6f2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598470:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6f2f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598476:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fe:0x0].0x0 (ffff880088977100) 00010000:00010000:2.0:1716999789.598477:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.598479:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6f2f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598482:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc6f2f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6fe:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598525:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598530:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598534:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598538:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.598540:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598543:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598549:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x0 (ffff88012ca38d00) 00010000:00010000:2.0:1716999789.598551:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.598553:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.598557:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc6f21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999789.598563:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880088b2d500 reply state ffff8800911c9000 transno 4294986145 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999789.598568:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.598615:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+598:11420:x1800404480733888:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3126us (3233us total) trans 4294986145 rc 0/0 00000100:00100000:2.0:1716999789.598621:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45761 00000100:00100000:3.0:1716999789.601016:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1716999789.601032:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483016768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1716999789.601073:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999789.601641:0:26516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483016768 00000100:00100000:2.0:1716999789.601647:0:26516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483016768 00000100:00100000:2.0:1716999789.601671:0:26516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1716999789.601677:0:26516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3220:x1800404483016768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1716999789.601693:0:26516:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 27262976 granted 259457024 pending 0 free 3807379456 avail 3798990848 00000100:00100000:2.0:1716999789.601725:0:26516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3220:x1800404483016768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.601730:0:26516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1716999789.601863:0:3220:0:(client.c:2952:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294970159 gen 2 00000004:00080000:0.0:1716999789.601868:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092df2680, transno 4294970155 00000004:00080000:0.0:1716999789.601896:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092df1c00, transno 4294970156 00000004:00080000:0.0:1716999789.601899:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099444e00, transno 4294970157 00000004:00080000:0.0:1716999789.601901:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092df3480, transno 4294970158 00000004:00080000:0.0:1716999789.601903:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb88e00, transno 4294970159 00000100:00100000:0.0:1716999789.601911:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099bc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483016768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1716999789.602427:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.602445:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.602479:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000004:00080000:1.0:1716999789.602648:0:8674:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 3 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:1.0:1716999789.602662:0:4523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480734144 00000100:00100000:1.0:1716999789.602665:0:4523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480734144 00000100:00100000:1.0:1716999789.602684:0:4523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:1.0:1716999789.602688:0:4523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+598:1958:x1800404480734144:12345-192.168.203.3@tcp:63:ll_sa.0 00010000:00010000:1.0:1716999789.602709:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.602723:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b600/0x6d188eabd8dc6f3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6617a expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.602756:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b840/0x6d188eabd8dc6f44 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.602766:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b840/0x6d188eabd8dc6f44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.602774:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b840/0x6d188eabd8dc6f44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.602784:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646aac0/0x6d188eabd8dc6f4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.602787:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646aac0/0x6d188eabd8dc6f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.602794:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646aac0/0x6d188eabd8dc6f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.602961:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646a1c0/0x6d188eabd8dc6f52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.602968:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646a1c0/0x6d188eabd8dc6f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.602973:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646a1c0/0x6d188eabd8dc6f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.603004:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x705:0x0]: returning size 12800 00000004:00200000:1.0:1716999789.603006:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.603018:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646a1c0/0x6d188eabd8dc6f52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603024:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b840/0x6d188eabd8dc6f44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603029:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b840/0x6d188eabd8dc6f44 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603033:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b840/0x6d188eabd8dc6f44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603037:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a646b840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.603040:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b840/0x6d188eabd8dc6f44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603046:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b840/0x6d188eabd8dc6f44 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603054:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999789.603056:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.603060:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b840/0x6d188eabd8dc6f44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603064:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b840/0x6d188eabd8dc6f44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603076:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646aac0/0x6d188eabd8dc6f4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603080:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646aac0/0x6d188eabd8dc6f4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603084:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646aac0/0x6d188eabd8dc6f4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603088:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a646aac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.603090:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646aac0/0x6d188eabd8dc6f4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603093:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646aac0/0x6d188eabd8dc6f4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603099:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x41aa9094 (ffff8800900d1c00) 00010000:00010000:1.0:1716999789.603101:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.603103:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646aac0/0x6d188eabd8dc6f4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603107:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646aac0/0x6d188eabd8dc6f4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603126:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b600/0x6d188eabd8dc6f3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6617a expref: 600 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.603138:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646a1c0/0x6d188eabd8dc6f52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6617a expref: 599 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.603143:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.603144:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.603146:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a646a1c0, rc 0) 00010000:00010000:1.0:1716999789.603149:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.603155:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468000/0x6d188eabd8dc6f59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66181 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.603169:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4000/0x6d188eabd8dc6f60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603175:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4000/0x6d188eabd8dc6f60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603180:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4000/0x6d188eabd8dc6f60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603188:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6640/0x6d188eabd8dc6f67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603193:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6640/0x6d188eabd8dc6f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603198:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6640/0x6d188eabd8dc6f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603238:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7a80/0x6d188eabd8dc6f6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603245:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7a80/0x6d188eabd8dc6f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603250:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7a80/0x6d188eabd8dc6f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.603274:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6ca:0x0]: returning size 11776 00000004:00200000:1.0:1716999789.603276:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.603283:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7a80/0x6d188eabd8dc6f6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603289:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4000/0x6d188eabd8dc6f60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603293:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4000/0x6d188eabd8dc6f60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603297:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4000/0x6d188eabd8dc6f60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603301:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88012bbf4000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.603302:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4000/0x6d188eabd8dc6f60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603306:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4000/0x6d188eabd8dc6f60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603312:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999789.603313:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.603315:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4000/0x6d188eabd8dc6f60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603319:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4000/0x6d188eabd8dc6f60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603325:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6640/0x6d188eabd8dc6f67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603329:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6640/0x6d188eabd8dc6f67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603333:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6640/0x6d188eabd8dc6f67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603336:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88012bbf6640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.603338:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6640/0x6d188eabd8dc6f67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603341:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6640/0x6d188eabd8dc6f67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603345:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x45435891 (ffff8800900d1700) 00010000:00010000:1.0:1716999789.603347:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.603348:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6640/0x6d188eabd8dc6f67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603351:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6640/0x6d188eabd8dc6f67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603365:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468000/0x6d188eabd8dc6f59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66181 expref: 601 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.603374:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7a80/0x6d188eabd8dc6f6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66181 expref: 600 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.603379:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x0 (ffff8800a660c200) 00010000:00010000:1.0:1716999789.603381:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.603383:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbf7a80, rc 0) 00010000:00010000:1.0:1716999789.603386:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.603392:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4fc0/0x6d188eabd8dc6f75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66188 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.603407:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5f80/0x6d188eabd8dc6f7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603412:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5f80/0x6d188eabd8dc6f7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603417:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5f80/0x6d188eabd8dc6f7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603425:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4480/0x6d188eabd8dc6f83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603429:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4480/0x6d188eabd8dc6f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603433:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4480/0x6d188eabd8dc6f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603474:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf46c0/0x6d188eabd8dc6f8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603479:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf46c0/0x6d188eabd8dc6f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603483:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf46c0/0x6d188eabd8dc6f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.603504:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6fd:0x0]: returning size 11776 00000004:00200000:1.0:1716999789.603506:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.603512:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf46c0/0x6d188eabd8dc6f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603518:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5f80/0x6d188eabd8dc6f7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603522:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5f80/0x6d188eabd8dc6f7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603526:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5f80/0x6d188eabd8dc6f7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603530:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88012bbf5f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.603532:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5f80/0x6d188eabd8dc6f7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603536:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5f80/0x6d188eabd8dc6f7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603542:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999789.603543:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.603545:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5f80/0x6d188eabd8dc6f7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603549:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5f80/0x6d188eabd8dc6f7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603555:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4480/0x6d188eabd8dc6f83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603560:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4480/0x6d188eabd8dc6f83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603564:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4480/0x6d188eabd8dc6f83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603567:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88012bbf4480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.603569:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4480/0x6d188eabd8dc6f83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603576:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4480/0x6d188eabd8dc6f83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603580:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x4d50 (ffff8800900d1e00) 00010000:00010000:1.0:1716999789.603582:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.603584:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4480/0x6d188eabd8dc6f83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603588:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4480/0x6d188eabd8dc6f83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603602:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4fc0/0x6d188eabd8dc6f75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66188 expref: 602 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.603610:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf46c0/0x6d188eabd8dc6f8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66188 expref: 601 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.603614:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x0 (ffff8800910ceb00) 00010000:00010000:1.0:1716999789.603616:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.603617:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbf46c0, rc 0) 00010000:00010000:1.0:1716999789.603620:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.603625:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4b40/0x6d188eabd8dc6f91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6618f expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.603640:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5b00/0x6d188eabd8dc6f98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603645:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5b00/0x6d188eabd8dc6f98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603650:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5b00/0x6d188eabd8dc6f98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603657:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6ac0/0x6d188eabd8dc6f9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603662:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6ac0/0x6d188eabd8dc6f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603666:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6ac0/0x6d188eabd8dc6f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603703:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4240/0x6d188eabd8dc6fa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603709:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4240/0x6d188eabd8dc6fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603713:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4240/0x6d188eabd8dc6fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.603738:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6c2:0x0]: returning size 11776 00000004:00200000:1.0:1716999789.603740:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 5 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.603747:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4240/0x6d188eabd8dc6fa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603752:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5b00/0x6d188eabd8dc6f98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603756:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5b00/0x6d188eabd8dc6f98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603761:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5b00/0x6d188eabd8dc6f98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603764:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88012bbf5b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.603767:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5b00/0x6d188eabd8dc6f98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603771:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5b00/0x6d188eabd8dc6f98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603777:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999789.603779:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.603781:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5b00/0x6d188eabd8dc6f98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603785:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5b00/0x6d188eabd8dc6f98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603792:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6ac0/0x6d188eabd8dc6f9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603809:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6ac0/0x6d188eabd8dc6f9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603814:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6ac0/0x6d188eabd8dc6f9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603817:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88012bbf6ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.603819:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6ac0/0x6d188eabd8dc6f9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603823:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6ac0/0x6d188eabd8dc6f9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603828:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x44524f57 (ffff8800900d1300) 00010000:00010000:1.0:1716999789.603830:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.603832:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6ac0/0x6d188eabd8dc6f9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603836:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6ac0/0x6d188eabd8dc6f9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00000100:00100000:2.0:1716999789.603851:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480734208 00010000:00010000:1.0:1716999789.603851:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4b40/0x6d188eabd8dc6f91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6618f expref: 603 pid: 4523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999789.603856:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480734208 00010000:00010000:1.0:1716999789.603858:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4240/0x6d188eabd8dc6fa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6618f expref: 603 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.603863:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999789.603864:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.603865:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbf4240, rc 0) 00010000:00010000:1.0:1716999789.603868:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.603873:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5d40/0x6d188eabd8dc6fad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66196 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999789.603877:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45762 00000100:00100000:2.0:1716999789.603899:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+604:11419:x1800404480734208:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999789.603902:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5680/0x6d188eabd8dc6fb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999789.603907:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.603907:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5680/0x6d188eabd8dc6fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999789.603912:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6fbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661ab expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.603912:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5680/0x6d188eabd8dc6fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603919:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7180/0x6d188eabd8dc6fc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603923:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7180/0x6d188eabd8dc6fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603928:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7180/0x6d188eabd8dc6fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999789.603932:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6fc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.603938:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.603943:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:2.0:1716999789.603968:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6d0:0x0]: returning size 11776 00000004:00200000:2.0:1716999789.603970:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 1 00010000:00010000:1.0:1716999789.603970:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf73c0/0x6d188eabd8dc6fd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.603976:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf73c0/0x6d188eabd8dc6fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00000004:00010000:2.0:1716999789.603977:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6fc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.603981:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf73c0/0x6d188eabd8dc6fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999789.603988:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc6fbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ab expref: 606 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.604001:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6fc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ab expref: 605 pid: 7785 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1716999789.604001:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6dc:0x0]: returning size 12800 00000004:00200000:1.0:1716999789.604003:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 11 stripe count 1 MDT count 1 00010000:00010000:2.0:1716999789.604006:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999789.604008:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00000004:00010000:1.0:1716999789.604008:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf73c0/0x6d188eabd8dc6fd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999789.604010:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918321c0, rc 0) 00010000:00010000:1.0:1716999789.604013:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5680/0x6d188eabd8dc6fb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604016:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5680/0x6d188eabd8dc6fb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604020:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5680/0x6d188eabd8dc6fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604023:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88012bbf5680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.604025:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5680/0x6d188eabd8dc6fb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604029:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5680/0x6d188eabd8dc6fb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604034:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999789.604035:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.604037:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5680/0x6d188eabd8dc6fb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604042:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5680/0x6d188eabd8dc6fb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00000100:00100000:2.0:1716999789.604043:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+605:11419:x1800404480734208:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 145us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.604048:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45762 00010000:00010000:1.0:1716999789.604049:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7180/0x6d188eabd8dc6fc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604053:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7180/0x6d188eabd8dc6fc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604057:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7180/0x6d188eabd8dc6fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604061:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88012bbf7180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.604062:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7180/0x6d188eabd8dc6fc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604066:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7180/0x6d188eabd8dc6fc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604070:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x45524f8f (ffff8800900d1b00) 00010000:00010000:1.0:1716999789.604072:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.604073:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7180/0x6d188eabd8dc6fc2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604077:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7180/0x6d188eabd8dc6fc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604090:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5d40/0x6d188eabd8dc6fad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66196 expref: 605 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.604097:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf73c0/0x6d188eabd8dc6fd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66196 expref: 604 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.604105:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:1.0:1716999789.604106:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.604108:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012bbf73c0, rc 0) 00010000:00010000:1.0:1716999789.604111:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.604117:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc6fd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6619d expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.604130:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc6fde lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604135:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc6fde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604140:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc6fde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999789.604384:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6f28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.604390:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6f28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.604395:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6f28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.604398:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.604400:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6f28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.604404:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6f28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.604410:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x582e84a0 (ffff880088977300) 00010000:00010000:0.0:1716999789.604412:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.604414:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6f28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6fc:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.604418:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc6f28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6fc:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.604766:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc6fe5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604772:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc6fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604777:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc6fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604833:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc6fec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604838:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc6fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604843:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc6fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.604867:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6f4:0x0]: returning size 11776 00000004:00200000:1.0:1716999789.604868:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.604875:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc6fec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604989:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc6fde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604994:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc6fde lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.604997:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc6fde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605001:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.605003:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc6fde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605007:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc6fde lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605013:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999789.605015:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.605017:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc6fde lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605075:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc6fde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605095:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc6fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605100:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc6fe5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605105:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc6fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605108:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.605110:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc6fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605113:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc6fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605119:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x44a1a1a7 (ffff8800900d1d00) 00010000:00010000:1.0:1716999789.605121:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.605123:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc6fe5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605127:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc6fe5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605144:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc6fd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6619d expref: 605 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.605153:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc6fec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6619d expref: 604 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.605158:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0x0 (ffff8800908c6c00) 00010000:00010000:1.0:1716999789.605160:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.605161:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132e6b840, rc 0) 00010000:00010000:1.0:1716999789.605165:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.605170:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc6ff3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661a4 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.605188:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc6ffa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605193:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc6ffa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605197:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc6ffa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605205:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc7001 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605210:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc7001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605215:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc7001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605255:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68480/0x6d188eabd8dc7008 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605261:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68480/0x6d188eabd8dc7008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605266:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68480/0x6d188eabd8dc7008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.605288:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x72e:0x0]: returning size 11776 00000004:00200000:1.0:1716999789.605290:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.605296:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68480/0x6d188eabd8dc7008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605302:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc6ffa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605307:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc6ffa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605310:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc6ffa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605314:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e686c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.605316:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc6ffa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605320:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc6ffa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605325:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999789.605326:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.605328:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc6ffa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605331:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc6ffa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605344:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc7001 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605348:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc7001 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605352:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc7001 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605355:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6aac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.605357:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc7001 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605365:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc7001 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605370:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x45439694 (ffff8800900d1a00) 00010000:00010000:1.0:1716999789.605372:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.605373:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc7001 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605377:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc7001 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.605400:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc6ff3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661a4 expref: 606 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.605408:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68480/0x6d188eabd8dc7008 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661a4 expref: 605 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.605413:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72e:0x0].0x0 (ffff8800939bad00) 00010000:00010000:1.0:1716999789.605414:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999789.605416:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132e68480, rc 0) 00000100:00100000:1.0:1716999789.608795:0:4523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+605:1958:x1800404480734144:12345-192.168.203.3@tcp:63:ll_sa.0 Request processed in 6095us (6359us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.608815:0:4523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 10 00000100:00100000:1.0:1716999789.608863:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480734080 00000100:00100000:1.0:1716999789.608870:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480734080 00000100:00100000:1.0:1716999789.608924:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9149 00000100:00100000:1.0:1716999789.608929:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480734080:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999789.609294:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11524, 168 off2060832 00000001:00080000:1.0:1716999789.609300:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986146 00000100:00100000:3.0:1716999789.609551:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.609800:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480734272 00000100:00100000:0.0:1716999789.609812:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480734272 00000100:00100000:0.0:1716999789.609835:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9150 00000100:00100000:0.0:1716999789.609839:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+608:11419:x1800404480734272:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999789.611412:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+609:11420:x1800404480734080:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2477us (8960us total) trans 4294986147 rc 0/0 00000100:00100000:1.0:1716999789.611421:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9149 00000020:00080000:1.0:1716999789.611426:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.613750:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480734272:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3903us (4192us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.613759:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9150 00000100:00100000:0.0:1716999789.614348:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.614500:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480734400 00000100:00100000:1.0:1716999789.614506:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480734400 00000100:00100000:1.0:1716999789.615830:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9151 00000100:00100000:1.0:1716999789.615838:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480734400:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.616015:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+608:11420:x1800404480734400:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 178us (1667us total) trans 4294986148 rc 0/0 00000100:00100000:1.0:1716999789.616022:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9151 00000100:00100000:0.0:1716999789.618679:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.618733:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480734528 00000100:00100000:2.0:1716999789.618739:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480734528 00000100:00100000:2.0:1716999789.618765:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45763 00000100:00100000:2.0:1716999789.618771:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+608:11420:x1800404480734528:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.618815:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.618833:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963e1c0/0x6d188eabd8d850eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x702:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52339 expref: 608 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.618847:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8d7e9ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x702:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50238 expref: 607 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.618855:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8d7e9ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x702:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5022a expref: 606 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.618864:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091187840/0x6d188eabd8d71829 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x702:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcd2 expref: 605 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.618874:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x702:0x0].0x0 (ffff88012ca38f00) 00010000:00010000:2.0:1716999789.618897:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.618915:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc700f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.618925:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc700f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.618931:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc700f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.618940:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7016 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6fc:0x0].0x396e6a5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.618944:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.618948:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619025:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc701d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x702:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619031:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc701d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x702:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619036:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc701d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x702:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:2.0:1716999789.619372:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1492, 64 off103744 00000040:00080000:2.0:1716999789.619390:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11525, 184 off2061016 00010000:00010000:2.0:1716999789.619434:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7024 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x702:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619441:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x702:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619446:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7024 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x702:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619451:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7024 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x702:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619455:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7024 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x702:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619459:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7024 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x702:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619463:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7024 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x702:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619468:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999789.619470:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7024 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x702:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619475:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7024 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x702:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619480:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x702:0x0].0x0 (ffff880088977e00) 00010000:00010000:2.0:1716999789.619482:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999789.619484:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7024 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x702:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619488:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7024 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x702:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619501:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc701d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x702:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619505:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc701d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x702:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619509:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc701d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x702:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619512:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.619514:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc701d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x702:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619518:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc701d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x702:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619522:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x702:0x0].0x0 (ffff880088977e00) 00010000:00010000:2.0:1716999789.619523:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.619525:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc701d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x702:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619528:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc701d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x702:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619556:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc700f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619559:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc700f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619563:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc700f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619566:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.619567:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc700f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619574:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc700f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619578:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x0 (ffff88012ca38d00) 00010000:00010000:2.0:1716999789.619580:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.619581:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc700f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.619585:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc700f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999789.619590:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008c707b80 reply state ffff880134a77000 transno 4294986149 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999789.619594:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.619646:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+606:11420:x1800404480734528:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 874us (971us total) trans 4294986149 rc 0/0 00000100:00100000:2.0:1716999789.619652:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45763 00000100:00100000:3.0:1716999789.621462:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.621479:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480734656 00000100:00100000:3.0:1716999789.621485:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480734656 00000100:00100000:3.0:1716999789.621522:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9152 00000100:00100000:3.0:1716999789.621529:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+606:11419:x1800404480734656:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999789.621848:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11526, 168 off2061184 00000001:00080000:3.0:1716999789.621853:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986150 00010000:00010000:0.0:1716999789.623384:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7016 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.623393:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7016 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.623399:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7016 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.623404:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.623407:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7016 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.623413:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7016 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.623424:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x396e6a5e (ffff880088977100) 00010000:00010000:0.0:1716999789.623427:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.623430:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7016 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6fc:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.623438:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7016 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6fc:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.623567:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480734656:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2034us (2105us total) trans 4294986151 rc 0/0 00000100:00100000:3.0:1716999789.623575:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9152 00000020:00080000:3.0:1716999789.623579:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.623809:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.623848:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.623852:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480734720 00000100:00100000:2.0:1716999789.623858:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480734720 00000100:00100000:2.0:1716999789.623892:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45764 00000100:00100000:2.0:1716999789.623897:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+607:11541:x1800404480734720:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:2.0:1716999789.623908:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.623918:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc702b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661b2 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.623938:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc702b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b2 expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.623947:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc702b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b2 expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.623953:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999789.623954:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.623956:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918318c0, rc 0) 00000100:00100000:2.0:1716999789.623981:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+608:11541:x1800404480734720:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 83us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.623986:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45764 00000100:00100000:3.0:1716999789.624025:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480734848 00000100:00100000:3.0:1716999789.624029:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480734848 00000100:00100000:3.0:1716999789.624053:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9153 00000100:00100000:3.0:1716999789.624058:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+608:11420:x1800404480734848:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999789.624409:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11527, 168 off2061352 00000001:00080000:3.0:1716999789.624414:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986152 00000100:00100000:3.0:1716999789.624468:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+610:11420:x1800404480734848:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 409us (619us total) trans 4294986153 rc 0/0 00000100:00100000:3.0:1716999789.624474:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9153 00000020:00080000:3.0:1716999789.624477:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999789.625747:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.625782:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480734976 00000100:00100000:0.0:1716999789.625788:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480734976 00000100:00100000:0.0:1716999789.625822:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45765 00000100:00100000:0.0:1716999789.625827:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+610:11419:x1800404480734976:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.625857:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.625873:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddf80/0x6d188eabd8dc30d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc1c:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64dc3 expref: 610 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.625971:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c958c0/0x6d188eabd8dc3028 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc1c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64da0 expref: 609 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.625983:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c946c0/0x6d188eabd8dc2fb8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc1c:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d76 expref: 608 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.625990:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1c:0x0].0x0 (ffff8800990eac00) 00010000:00010000:0.0:1716999789.626001:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc6fc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ab expref: 607 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.626007:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999789.626010:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.626027:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.626037:0:7785:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc702b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b2 expref: 606 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.626043:0:7785:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.626066:0:7785:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc702b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b2 expref: 606 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.626075:0:7785:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc702b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b2 expref: 606 pid: 7785 timeout: 408 lvb_type: 0 00000100:00100000:0.0:1716999789.626084:0:7785:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c705880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:7785:1800404483016832:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999789.626129:0:7785:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009c4ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1716999789.628123:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.628768:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.628923:0:7785:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008c705880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:7785:1800404483016832:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999789.628940:0:7785:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999789.629084:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480735104 00000100:00100000:3.0:1716999789.629090:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480735104 00000100:00100000:3.0:1716999789.629114:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480735168 00000100:00100000:3.0:1716999789.629115:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480735168 00000100:00100000:3.0:1716999789.629127:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9154 00000100:00100000:3.0:1716999789.629131:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+608:11420:x1800404480735104:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.629395:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9155 00000100:00100000:1.0:1716999789.629401:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+609:11541:x1800404480735168:12345-192.168.203.3@tcp:37:ll_sa.0 00000100:00100000:3.0:1716999789.630386:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+610:11420:x1800404480735104:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1251us (2266us total) trans 4294986154 rc 0/0 00000100:00100000:3.0:1716999789.630393:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9154 00000100:00100000:2.0:1716999789.632393:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.632447:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480735296 00000100:00100000:3.0:1716999789.632453:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480735296 00000100:00100000:3.0:1716999789.632485:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45766 00000100:00100000:3.0:1716999789.632491:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+609:11420:x1800404480735296:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999789.632525:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999789.632544:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009353b840/0x6d188eabd8d84e36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x700:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52252 expref: 609 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.632559:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3180/0x6d188eabd8d7e926 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x700:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50200 expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.632569:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7edd40/0x6d188eabd8d7e903 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x700:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f501f2 expref: 607 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.632579:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f24fc0/0x6d188eabd8d7178f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x700:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc8c expref: 606 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999789.632868:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+605:11541:x1800404480735168:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 3465us (4100us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.632875:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9155 00010000:00010000:3.0:1716999789.634119:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x700:0x0].0x0 (ffff88009a33c800) 00010000:00010000:3.0:1716999789.634133:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.634158:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7039 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634170:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7039 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634179:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7039 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634191:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7040 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6fc:0x0].0x261139b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634195:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7040 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634200:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7040 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634291:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7047 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x700:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634296:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7047 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x700:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634301:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7047 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x700:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:3.0:1716999789.634652:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1493, 64 off103808 00000040:00080000:3.0:1716999789.634670:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11528, 184 off2061536 00010000:00010000:3.0:1716999789.634721:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc704e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x700:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634727:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc704e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x700:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634732:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc704e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x700:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634738:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc704e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x700:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634743:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc704e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x700:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634746:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc704e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x700:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634751:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc704e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x700:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634755:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999789.634757:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc704e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x700:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634762:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc704e lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x700:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634768:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x700:0x0].0x0 (ffff8800a5c6e200) 00010000:00010000:3.0:1716999789.634770:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999789.634772:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc704e lrc: 3/0,0 mode: --/PW res: [0x200000401:0x700:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634775:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc704e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x700:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634791:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7047 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x700:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634794:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7047 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x700:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634798:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7047 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x700:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634812:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.634815:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7047 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x700:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634819:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7047 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x700:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634824:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x700:0x0].0x0 (ffff8800a5c6e200) 00010000:00010000:3.0:1716999789.634826:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.634827:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7047 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x700:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634831:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7047 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x700:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634864:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7039 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634868:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7039 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634872:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7039 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634875:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.634876:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7039 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634895:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7039 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634900:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x0 (ffff88012ca38d00) 00010000:00010000:3.0:1716999789.634901:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.634904:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7039 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.634907:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7039 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6fc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:3.0:1716999789.634912:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bca680 reply state ffff8800941da000 transno 4294986155 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7040 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.634917:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.634971:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+606:11420:x1800404480735296:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2478us (2580us total) trans 4294986155 rc 0/0 00000100:00100000:3.0:1716999789.634978:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45766 00000100:00100000:2.0:1716999789.640157:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.640268:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.640317:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480735360 00000100:00100000:0.0:1716999789.640325:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480735360 00010000:00010000:0.0:1716999789.640350:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc702b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b2 expref: 606 pid: 7785 timeout: 408 lvb_type: 0 00000100:00100000:0.0:1716999789.640374:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4573 00000100:00100000:0.0:1716999789.640379:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+606:1958:x1800404480735360:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999789.640389:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999789.640395:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc702b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b2 expref: 606 pid: 7785 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.640404:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc702b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b2 expref: 606 pid: 7785 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.640420:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc702b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b2 expref: 606 pid: 7785 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.640431:0:15839:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999789.640436:0:15839:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.640442:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.640447:0:15839:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.640463:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999789.640507:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+605:1958:x1800404480735360:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 127us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.640514:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4573 00010000:00010000:0.0:1716999789.640533:0:7785:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.640539:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.640554:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7055 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0xa4b2186b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.640561:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.640567:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.640665:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc705c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc1c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.640671:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc705c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.640677:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc705c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999789.641136:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1489, 64 off103552 00000040:00080000:0.0:1716999789.641154:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11529, 184 off2061720 00010000:00010000:0.0:1716999789.641206:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7063 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641212:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7063 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641218:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7063 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641223:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7063 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641228:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7063 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641233:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7063 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641237:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7063 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641244:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999789.641246:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7063 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641252:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7063 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641258:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1c:0x0].0x0 (ffff880094791100) 00010000:00010000:0.0:1716999789.641260:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999789.641262:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7063 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641265:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7063 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc1c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641285:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc705c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641289:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc705c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641293:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc705c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641296:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.641298:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc705c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641302:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc705c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641308:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1c:0x0].0x0 (ffff880094791100) 00010000:00010000:0.0:1716999789.641310:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.641312:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc705c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641316:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc705c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc1c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641363:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641367:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641372:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.641375:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.641377:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.641378:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7040 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.641381:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.641384:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7040 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.641387:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999789.641388:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7040 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.641389:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.641391:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.641392:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.641395:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7040 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.641395:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7032 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.641400:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7040 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6fc:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00000004:00010000:0.0:1716999789.641401:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bcb480 reply state ffff88009c231000 transno 4294986156 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.641406:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x261139b2 (ffff8800a5c6e700) 00000100:00100000:0.0:1716999789.641406:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1716999789.641408:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.641409:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7040 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6fc:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.641413:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7040 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6fc:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.641437:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+605:11419:x1800404480734976:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 15609us (15692us total) trans 4294986156 rc 0/0 00000100:00100000:1.0:1716999789.641438:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480735424 00000100:00100000:1.0:1716999789.641442:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480735424 00000100:00100000:0.0:1716999789.641444:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45765 00000100:00100000:1.0:1716999789.641457:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9156 00000100:00100000:1.0:1716999789.641461:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480735424:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999789.645634:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999789.646171:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.646180:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7055 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.646186:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7055 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.646190:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.646193:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7055 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.646198:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7055 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.646210:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xa4b2186b (ffff880094791d00) 00010000:00010000:0.0:1716999789.646213:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.646216:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7055 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.646220:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7055 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999789.646467:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480735552 00000100:00100000:3.0:1716999789.646474:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480735552 00000100:00100000:3.0:1716999789.646505:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9157 00000100:00100000:3.0:1716999789.646510:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11419:x1800404480735552:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.647435:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+606:11420:x1800404480735424:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5968us (7163us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.647444:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9156 00000040:00080000:3.0:1716999789.647714:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11530, 168 off2061888 00000001:00080000:3.0:1716999789.647721:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986157 00000100:00100000:3.0:1716999789.648465:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+606:11419:x1800404480735552:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1951us (2835us total) trans 4294986158 rc 0/0 00000100:00100000:3.0:1716999789.648472:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9157 00000020:00080000:3.0:1716999789.648476:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999789.650916:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.651066:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480735680 00000100:00100000:3.0:1716999789.651073:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480735680 00000100:00100000:3.0:1716999789.651112:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9158 00000100:00100000:3.0:1716999789.651118:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+606:11419:x1800404480735680:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999789.651292:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+607:11419:x1800404480735680:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 174us (380us total) trans 4294986159 rc 0/0 00000100:00100000:3.0:1716999789.651300:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9158 00000100:00100000:1.0:1716999789.651538:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.652202:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480735808 00000100:00100000:0.0:1716999789.652207:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480735808 00000100:00100000:0.0:1716999789.652226:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9159 00000100:00100000:0.0:1716999789.652231:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+607:11420:x1800404480735808:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999789.652415:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11531, 168 off2062056 00000100:00100000:0.0:1716999789.652467:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+608:11420:x1800404480735808:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 235us (930us total) trans 4294986160 rc 0/0 00000100:00100000:0.0:1716999789.652473:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9159 00000100:00100000:2.0:1716999789.652539:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.653137:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480735872 00000100:00100000:0.0:1716999789.653141:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480735872 00000100:00100000:0.0:1716999789.653172:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45767 00000100:00100000:0.0:1716999789.653177:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+608:11543:x1800404480735872:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:0.0:1716999789.653186:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.653199:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc706a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661b9 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.653220:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc706a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b9 expref: 609 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.653229:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc706a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b9 expref: 609 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.653235:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0x0 (ffff8800910ce400) 00010000:00010000:0.0:1716999789.653237:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.653240:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133600, rc 0) 00000100:00100000:0.0:1716999789.654074:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+609:11543:x1800404480735872:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 893us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.654081:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45767 00000100:00100000:2.0:1716999789.655480:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.655547:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480736000 00000100:00100000:3.0:1716999789.655553:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480736000 00000100:00100000:3.0:1716999789.655601:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9160 00000100:00100000:3.0:1716999789.655607:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+609:11420:x1800404480736000:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999789.656064:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+610:11420:x1800404480736000:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 455us (584us total) trans 4294986161 rc 0/0 00000100:00100000:3.0:1716999789.656070:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9160 00000100:00100000:1.0:1716999789.656420:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.656469:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.656607:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480736128 00000100:00100000:0.0:1716999789.656612:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480736128 00000100:00100000:0.0:1716999789.656631:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45768 00000100:00100000:0.0:1716999789.656635:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+610:11419:x1800404480736128:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.656660:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.656677:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8d86026 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5251c expref: 610 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.656691:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695ed00/0x6d188eabd8d7c466 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d4:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f5c0 expref: 609 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.656700:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695ef40/0x6d188eabd8d7c3b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f581 expref: 608 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.656708:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c574000/0x6d188eabd8d70903 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b67a expref: 607 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.656715:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d4:0x0].0x0 (ffff880099d1b000) 00010000:00010000:0.0:1716999789.656722:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.656740:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7071 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.656748:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7071 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.656755:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7071 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.656765:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7078 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0xba72bac9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.656769:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7078 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.656773:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7078 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.656854:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc707f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.656860:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc707f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.656865:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc707f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999789.657053:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480736192 00000100:00100000:3.0:1716999789.657057:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480736192 00000100:00100000:3.0:1716999789.657078:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9161 00000100:00100000:3.0:1716999789.657082:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+607:11543:x1800404480736192:12345-192.168.203.3@tcp:37:ll_sa.0 00000040:00080000:0.0:1716999789.658647:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1494, 64 off103872 00000040:00080000:0.0:1716999789.658667:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11532, 176 off2062232 00010000:00010000:0.0:1716999789.658724:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7086 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658733:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658740:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7086 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658746:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7086 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658750:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7086 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658754:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7086 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658759:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7086 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658764:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999789.658766:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7086 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658772:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7086 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6d4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658780:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d4:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999789.658782:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999789.658785:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7086 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6d4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658789:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7086 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658826:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc707f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658831:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc707f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6d4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658835:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc707f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658839:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.658842:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc707f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658846:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc707f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6d4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658852:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d4:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999789.658854:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.658856:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc707f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6d4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.658860:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc707f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6d4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.659007:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7071 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.659013:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7071 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.659018:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7071 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.659021:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.659024:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7071 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.659028:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7071 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999789.659034:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999789.659035:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999789.659037:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.659040:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7071 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.659044:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7071 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999789.659051:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009155a300 reply state ffff8800a6ada000 transno 4294986162 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7078 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.659057:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.659085:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480736320 00000100:00100000:3.0:1716999789.659091:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480736320 00000100:00100000:0.0:1716999789.659114:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+611:11419:x1800404480736128:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2472us (2689us total) trans 4294986162 rc 0/0 00000100:00100000:0.0:1716999789.659120:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45768 00000100:00100000:3.0:1716999789.659126:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45769 00000100:00100000:3.0:1716999789.659131:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+610:11420:x1800404480736320:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999789.659331:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1716999789.659345:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8d8d52e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f54988 expref: 610 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.659620:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963f180/0x6d188eabd8d7e3b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6f7:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50040 expref: 609 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.659632:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8d7e329 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5000f expref: 608 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.659647:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f25680/0x6d188eabd8d7145c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb43 expref: 607 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.659654:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f7:0x0].0x0 (ffff88009a33c200) 00010000:00010000:3.0:1716999789.659665:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364fc0/0x6d188eabd8dc6e33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66142 expref: 606 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.659673:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0x0 (ffff8800910ce400) 00010000:00010000:3.0:1716999789.659675:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.659690:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.659698:0:11055:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc706a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b9 expref: 605 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.659704:0:11055:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.659727:0:11055:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc706a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b9 expref: 605 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.659737:0:11055:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc706a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b9 expref: 605 pid: 7785 timeout: 408 lvb_type: 0 00000100:00100000:3.0:1716999789.659748:0:11055:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11055:1800404483016896:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999789.661173:0:11055:0:(client.c:2542:ptlrpc_set_wait()) set ffff880131c0a240 going to sleep for 11 seconds 00000100:00100000:3.0:1716999789.661667:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+604:11543:x1800404480736192:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 4581us (5195us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999789.661679:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9161 00010000:00010000:0.0:1716999789.661759:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7078 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.661767:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7078 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.661773:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7078 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.661777:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.661780:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7078 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.661786:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7078 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.661797:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xba72bac9 (ffff88008a83f100) 00010000:00010000:0.0:1716999789.661799:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.661812:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7078 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.661816:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7078 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999789.664469:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.664612:0:11055:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009c2c7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11055:1800404483016896:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999789.664629:0:11055:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.664718:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480736448 00000100:00100000:3.0:1716999789.664723:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480736448 00000100:00100000:3.0:1716999789.664753:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9162 00000100:00100000:3.0:1716999789.664758:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480736448:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999789.665360:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+604:11419:x1800404480736448:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 599us (894us total) trans 4294986163 rc 0/0 00000100:00100000:3.0:1716999789.665367:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9162 00000100:00100000:2.0:1716999789.667532:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.667599:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.667658:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480736512 00000100:00100000:0.0:1716999789.667665:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480736512 00000100:00100000:3.0:1716999789.667671:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480736640 00000100:00100000:3.0:1716999789.667675:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480736640 00010000:00010000:0.0:1716999789.667688:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc706a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b9 expref: 605 pid: 7785 timeout: 408 lvb_type: 0 00000100:00100000:3.0:1716999789.667706:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9163 00000100:00100000:0.0:1716999789.667708:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4574 00000100:00100000:3.0:1716999789.667711:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11419:x1800404480736640:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999789.667713:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+605:1959:x1800404480736512:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999789.667721:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999789.667727:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc706a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b9 expref: 605 pid: 7785 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.667737:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc706a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b9 expref: 605 pid: 7785 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.667752:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc706a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661b9 expref: 605 pid: 7785 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.667763:0:16642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0x0 (ffff8800910ce400) 00010000:00010000:0.0:1716999789.667767:0:16642:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.667775:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.667780:0:16642:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.667813:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.667827:0:11055:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.667833:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.667840:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+604:1959:x1800404480736512:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 127us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.667846:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4574 00010000:00010000:1.0:1716999789.667848:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc7094 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f5:0x0].0xb61ad33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.667855:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc7094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.667860:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc7094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.667957:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc709b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6f7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.667965:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc709b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.667970:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc709b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:3.0:1716999789.668182:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11533, 168 off2062400 00000100:00100000:3.0:1716999789.668250:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+604:11419:x1800404480736640:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 537us (649us total) trans 4294986164 rc 0/0 00000100:00100000:3.0:1716999789.668256:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9163 00000040:00080000:1.0:1716999789.668354:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1490, 64 off103616 00000040:00080000:1.0:1716999789.668368:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11534, 184 off2062584 00010000:00010000:1.0:1716999789.668408:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc70a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668415:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc70a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668421:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc70a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668426:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc70a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668430:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc70a2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668434:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc70a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668442:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc70a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668447:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e686c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999789.668449:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc70a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668454:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc70a2 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668460:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f7:0x0].0x0 (ffff8800900d1c00) 00010000:00010000:1.0:1716999789.668462:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999789.668465:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc70a2 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668469:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc70a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668491:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc709b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668495:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc709b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668499:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc709b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668502:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6aac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.668504:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc709b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668509:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc709b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668517:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f7:0x0].0x0 (ffff8800900d1c00) 00010000:00010000:1.0:1716999789.668518:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.668520:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc709b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668523:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6aac0/0x6d188eabd8dc709b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6f7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668562:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668566:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668569:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668573:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.668574:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668578:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668582:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0x0 (ffff8800910ce400) 00010000:00010000:1.0:1716999789.668584:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.668585:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.668589:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc708d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999789.668594:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009155b100 reply state ffff8800941db000 transno 4294986165 ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc7094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.668599:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.668623:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480736320:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 9491us (9590us total) trans 4294986165 rc 0/0 00000100:00100000:1.0:1716999789.668628:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45769 00000100:00100000:1.0:1716999789.672308:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.672396:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.672418:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480736896 00000100:00100000:1.0:1716999789.672424:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480736896 00000100:00100000:1.0:1716999789.672456:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45770 00000100:00100000:1.0:1716999789.672461:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+605:11419:x1800404480736896:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999789.672501:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999789.672519:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d5b00/0x6d188eabd8d7c8db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6da:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f756 expref: 605 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.672535:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091332f40/0x6d188eabd8d74237 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6da:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4cbc0 expref: 604 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.672547:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8d7c872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6da:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f72c expref: 603 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.672555:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef2d00/0x6d188eabd8d70ad1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6da:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b74c expref: 602 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.672562:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6da:0x0].0x0 (ffff880092624300) 00010000:00010000:1.0:1716999789.672569:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.672591:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc70a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.672604:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc70a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.672611:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc70a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.672620:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc70b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0x7d62b0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.672624:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc70b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.672628:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc70b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.672704:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480736768 00010000:00010000:1.0:1716999789.672707:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc70b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6da:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.672708:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480736768 00010000:00010000:1.0:1716999789.672713:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc70b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.672718:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc70b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.672728:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9164 00000100:00100000:3.0:1716999789.672732:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480736768:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999789.672955:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11535, 168 off2062752 00000100:00100000:3.0:1716999789.673036:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480736768:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 303us (734us total) trans 4294986166 rc 0/0 00000100:00100000:3.0:1716999789.673042:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9164 00000040:00080000:1.0:1716999789.673089:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1495, 64 off103936 00000040:00080000:1.0:1716999789.673102:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11536, 184 off2062936 00010000:00010000:1.0:1716999789.673143:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc70be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6da:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673149:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc70be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673155:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc70be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673162:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc70be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673167:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc70be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673171:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc70be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673176:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc70be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673181:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e68d80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999789.673183:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc70be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673189:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc70be lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673195:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6da:0x0].0x0 (ffff8800900d1100) 00010000:00010000:1.0:1716999789.673197:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999789.673199:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc70be lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673203:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc70be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6da:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673221:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc70b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673225:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc70b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673230:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc70b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673234:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.673237:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc70b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673241:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc70b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673246:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6da:0x0].0x0 (ffff8800900d1100) 00010000:00010000:1.0:1716999789.673248:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.673250:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc70b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673253:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc70b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6da:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673291:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc70a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673295:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc70a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673298:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc70a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673302:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e698c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.673304:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc70a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673307:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc70a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673312:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999789.673314:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.673317:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc70a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.673320:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc70a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999789.673327:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009155bb80 reply state ffff88008e48f000 transno 4294986167 ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc70b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.673331:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.673354:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+604:11419:x1800404480736896:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 893us (958us total) trans 4294986167 rc 0/0 00000100:00100000:1.0:1716999789.673359:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45770 00010000:00010000:0.0:1716999789.673624:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc7094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.673630:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc7094 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.673634:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc7094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.673638:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.673640:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc7094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.673645:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc7094 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.673651:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0xb61ad33 (ffff8800900d1700) 00010000:00010000:0.0:1716999789.673653:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.673655:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc7094 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6f5:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.673659:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69440/0x6d188eabd8dc7094 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f5:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.675746:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc70b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.675755:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc70b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.675760:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc70b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.675763:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.675766:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc70b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.675770:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc70b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.675778:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x7d62b0d (ffff8800900d1200) 00010000:00010000:0.0:1716999789.675780:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.675782:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc70b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.675789:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc70b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.677502:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.677573:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480737024 00000100:00100000:2.0:1716999789.677581:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480737024 00000100:00100000:2.0:1716999789.677620:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9165 00000100:00100000:2.0:1716999789.677626:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480737024:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999789.677799:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480737024:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 172us (301us total) trans 4294986168 rc 0/0 00000100:00100000:2.0:1716999789.677814:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9165 00000100:00100000:2.0:1716999789.678258:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.678306:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480737152 00000100:00100000:0.0:1716999789.678310:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480737152 00000100:00100000:0.0:1716999789.678337:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9166 00000100:00100000:0.0:1716999789.678342:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480737152:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999789.678626:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11537, 168 off2063104 00000001:00080000:0.0:1716999789.678631:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986169 00000100:00100000:0.0:1716999789.678676:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+605:11419:x1800404480737152:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 333us (418us total) trans 4294986170 rc 0/0 00000100:00100000:0.0:1716999789.678681:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9166 00000020:00080000:0.0:1716999789.678684:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999789.680214:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.680255:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.680275:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480737344 00000100:00100000:1.0:1716999789.680280:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480737344 00000100:00100000:1.0:1716999789.680317:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480737408 00000100:00100000:1.0:1716999789.680320:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480737408 00000100:00100000:1.0:1716999789.680333:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45771 00000100:00100000:1.0:1716999789.680339:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+606:11419:x1800404480737344:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999789.680371:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1716999789.680390:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc3bf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc28:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650f6 expref: 606 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.680407:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc3b8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc28:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650e1 expref: 605 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.680417:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdf180/0x6d188eabd8dc3b0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc28:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650b0 expref: 604 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.680425:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff88009ab4a200) 00010000:00010000:1.0:1716999789.680434:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.680454:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc70c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.680464:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc70c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999789.680509:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45772 00000100:00100000:2.0:1716999789.680514:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480737408:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.680528:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.680538:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009477b180/0x6d188eabd8d8d9b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f54aed expref: 603 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.680549:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8d7e472 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6f9:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50078 expref: 602 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.680559:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1440/0x6d188eabd8d7e464 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50071 expref: 601 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.680568:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091185b00/0x6d188eabd8d714f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb89 expref: 600 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.680574:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f9:0x0].0x0 (ffff88009cfbd000) 00010000:00010000:2.0:1716999789.680579:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.680590:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc70cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.680597:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc70cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.680771:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc70cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.680782:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc70d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f5:0x0].0xa12eb2e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.680787:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc70d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.680796:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc70d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.680919:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc70da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6f9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.680926:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc70da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.680931:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc70da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.680986:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc70c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.680998:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc70e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681003:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc70e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681007:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc70e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681057:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc70e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681063:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc70e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681068:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc70e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:1.0:1716999789.681446:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1491, 64 off103680 00000040:00080000:1.0:1716999789.681465:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11538, 184 off2063288 00010000:00010000:1.0:1716999789.681516:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc70ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681523:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc70ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681532:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc70ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681538:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc70ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681542:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc70ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681547:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc70ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681552:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc70ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681556:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999789.681560:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc70ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681565:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc70ef lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681571:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff8800900d1300) 00010000:00010000:1.0:1716999789.681574:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999789.681576:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc70ef lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681581:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc70ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681598:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc70e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681603:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc70e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681608:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc70e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681611:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.681613:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc70e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681618:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc70e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681623:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc28:0x0].0x0 (ffff8800900d1300) 00010000:00010000:1.0:1716999789.681625:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.681627:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc70e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681631:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc70e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681663:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc70c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681668:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc70c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681672:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc70c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681676:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e68fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.681678:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc70c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681682:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc70c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681691:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:1.0:1716999789.681692:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.681694:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc70c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.681698:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc70c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:1.0:1716999789.681713:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009c2c4e00 reply state ffff88008e48a000 transno 4294986171 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc70e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999789.681718:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.681778:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480737344:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1437us (1567us total) trans 4294986171 rc 0/0 00000100:00100000:1.0:1716999789.681784:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45771 00000040:00080000:2.0:1716999789.682630:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1492, 64 off103744 00000040:00080000:2.0:1716999789.682644:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11539, 184 off2063472 00010000:00010000:2.0:1716999789.682686:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc70f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682693:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc70f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682699:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc70f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682704:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc70f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682707:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc70f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682711:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc70f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682716:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc70f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682723:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999789.682725:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc70f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682730:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc70f6 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682736:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f9:0x0].0x0 (ffff880088977e00) 00010000:00010000:2.0:1716999789.682738:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999789.682740:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc70f6 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682744:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc70f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682758:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc70da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682762:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc70da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682767:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc70da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682770:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.682773:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc70da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682777:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc70da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682783:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f9:0x0].0x0 (ffff880088977e00) 00010000:00010000:2.0:1716999789.682785:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.682787:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc70da lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682791:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc70da lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6f9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682834:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc70cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682840:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc70cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682844:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc70cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682847:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918321c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.682849:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc70cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682853:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc70cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682860:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0x0 (ffff8800910ce400) 00010000:00010000:2.0:1716999789.682861:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.682864:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc70cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.682868:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc70cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999789.682874:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009c2c7100 reply state ffff880134a72000 transno 4294986172 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc70d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999789.682901:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.684337:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480737408:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3817us (4076us total) trans 4294986172 rc 0/0 00000100:00100000:2.0:1716999789.684346:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45772 00000100:00100000:1.0:1716999789.684533:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999789.684536:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc70e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.684544:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc70e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.684548:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc70e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.684553:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.684556:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc70e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.684560:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc70e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.684569:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x985392a1 (ffff8800900d1600) 00010000:00010000:0.0:1716999789.684572:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.684574:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc70e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.684578:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc70e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999789.684600:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480737536 00000100:00100000:0.0:1716999789.684607:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480737536 00000100:00100000:0.0:1716999789.684631:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9167 00000100:00100000:0.0:1716999789.684636:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480737536:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999789.685303:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480737536:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 664us (769us total) trans 4294986173 rc 0/0 00000100:00100000:0.0:1716999789.685310:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9167 00010000:00010000:0.0:1716999789.685846:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc70d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.685853:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc70d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.685858:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc70d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.685862:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.685865:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc70d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.685869:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc70d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f5:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.685899:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0xa12eb2e9 (ffff880088977100) 00010000:00010000:0.0:1716999789.685902:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.685906:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc70d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6f5:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.685910:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc70d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f5:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999789.686832:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.687140:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480737664 00000100:00100000:0.0:1716999789.687145:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480737664 00000100:00100000:0.0:1716999789.687165:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9168 00000100:00100000:0.0:1716999789.687170:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480737664:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999789.687377:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11540, 168 off2063640 00000100:00100000:0.0:1716999789.687444:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480737664:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 273us (613us total) trans 4294986174 rc 0/0 00000100:00100000:0.0:1716999789.687449:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9168 00000100:00100000:1.0:1716999789.688838:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.688905:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480737792 00000100:00100000:2.0:1716999789.688910:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480737792 00000100:00100000:1.0:1716999789.688924:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.688936:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45773 00000100:00100000:2.0:1716999789.688941:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480737792:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.688971:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.688987:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5440/0x6d188eabd8dc223d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64ac8 expref: 602 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.689007:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8d7c21a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d2:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f4fc expref: 601 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.689016:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c2d00/0x6d188eabd8d72a89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c4a4 expref: 600 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.689026:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c2880/0x6d188eabd8d72a43 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d2:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c488 expref: 599 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.689032:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d2:0x0].0x0 (ffff8800a660c600) 00010000:00010000:2.0:1716999789.689040:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.689058:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc70fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689067:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc70fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689072:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc70fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689085:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7104 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0x7b2f0bbe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689089:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7104 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689094:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7104 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689166:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc710b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689172:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc710b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689177:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc710b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999789.689462:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480737920 00000100:00100000:3.0:1716999789.689467:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480737920 00000100:00100000:3.0:1716999789.689494:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9169 00000100:00100000:3.0:1716999789.689499:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+599:11420:x1800404480737920:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999789.689528:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1496, 64 off104000 00000040:00080000:2.0:1716999789.689545:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11541, 184 off2063824 00010000:00010000:2.0:1716999789.689590:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7112 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689597:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7112 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689603:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7112 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689608:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7112 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689613:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7112 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689620:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7112 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689625:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7112 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689630:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831200 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999789.689633:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7112 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689638:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7112 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689644:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d2:0x0].0x0 (ffff880088977300) 00010000:00010000:2.0:1716999789.689646:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999789.689648:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7112 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689653:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7112 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689669:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc710b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689673:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc710b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689677:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc710b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689680:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.689682:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc710b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689689:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc710b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689696:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d2:0x0].0x0 (ffff880088977300) 00010000:00010000:2.0:1716999789.689697:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.689699:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc710b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689703:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc710b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6d2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689736:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc70fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689740:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc70fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689744:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc70fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689747:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918306c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.689748:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc70fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689752:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc70fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689757:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:2.0:1716999789.689759:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.689761:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc70fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.689765:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc70fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000040:00080000:3.0:1716999789.689771:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11542, 168 off2063992 00000004:00010000:2.0:1716999789.689772:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880091559500 reply state ffff880134a75000 transno 4294986175 ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7104 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000001:00080000:3.0:1716999789.689776:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986176 00000100:00100000:2.0:1716999789.689777:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.689833:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480737920:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 333us (909us total) trans 4294986177 rc 0/0 00000100:00100000:2.0:1716999789.689836:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480737792:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 892us (997us total) trans 4294986175 rc 0/0 00000100:00100000:3.0:1716999789.689839:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9169 00000020:00080000:3.0:1716999789.689842:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999789.689842:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45773 00010000:00010000:0.0:1716999789.691723:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7104 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.691733:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7104 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.691738:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7104 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.691742:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.691744:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7104 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.691749:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7104 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.691759:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x7b2f0bbe (ffff880088977900) 00010000:00010000:0.0:1716999789.691761:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.691764:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7104 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.691769:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7104 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999789.695056:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.695145:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480738048 00000100:00100000:3.0:1716999789.695152:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480738048 00000100:00100000:3.0:1716999789.695319:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9170 00000100:00100000:3.0:1716999789.695326:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+601:11420:x1800404480738048:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999789.695513:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480738048:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 186us (463us total) trans 4294986178 rc 0/0 00000100:00100000:3.0:1716999789.695520:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9170 00000100:00100000:3.0:1716999789.696464:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.697036:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480738176 00000100:00100000:0.0:1716999789.697041:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480738176 00000100:00100000:0.0:1716999789.697075:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9171 00000100:00100000:0.0:1716999789.697081:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480738176:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999789.697404:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11543, 168 off2064160 00000001:00080000:0.0:1716999789.697409:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986179 00000100:00100000:0.0:1716999789.697475:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+604:11419:x1800404480738176:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 394us (1011us total) trans 4294986180 rc 0/0 00000100:00100000:0.0:1716999789.697481:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9171 00000020:00080000:0.0:1716999789.697484:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999789.704220:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.704422:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.704517:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480738304 00000100:00100000:3.0:1716999789.704525:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480738304 00000100:00100000:3.0:1716999789.704569:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9172 00000100:00100000:3.0:1716999789.704576:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+604:11419:x1800404480738304:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999789.704749:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+605:11419:x1800404480738304:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 172us (539us total) trans 4294986181 rc 0/0 00000100:00100000:3.0:1716999789.704756:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9172 00000100:00100000:0.0:1716999789.704910:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480738432 00000100:00100000:0.0:1716999789.704915:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480738432 00000100:00100000:0.0:1716999789.704935:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45774 00000100:00100000:0.0:1716999789.704939:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+605:11420:x1800404480738432:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.704962:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.704980:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215cd80/0x6d188eabd8d8e0db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6fb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f54d78 expref: 605 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.704996:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009186f3c0/0x6d188eabd8d7e5b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6fb:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f500da expref: 604 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.705006:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8d7e52f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f500a2 expref: 603 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.705019:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69b00/0x6d188eabd8d71590 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbc8 expref: 602 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.705037:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fb:0x0].0x0 (ffff8800908c6100) 00010000:00010000:0.0:1716999789.705044:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.705526:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7119 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.705538:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7119 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.705546:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7119 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.705558:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7120 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f5:0x0].0x8e1e1fc5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.705563:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f5:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.705567:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f5:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.705634:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7127 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6fb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.705639:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7127 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.705643:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7127 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999789.707835:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1493, 64 off103808 00000040:00080000:0.0:1716999789.707857:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11544, 184 off2064344 00010000:00010000:0.0:1716999789.707954:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc712e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6fb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.707964:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc712e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.707972:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc712e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.707977:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc712e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.707981:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc712e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.707985:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc712e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.707991:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc712e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.707995:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999789.707997:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc712e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708002:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc712e lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708010:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fb:0x0].0x0 (ffff88008a83f100) 00010000:00010000:0.0:1716999789.708012:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999789.708015:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc712e lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708019:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc712e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6fb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708041:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7127 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708045:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7127 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708048:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7127 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708051:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.708053:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7127 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708057:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7127 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708063:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fb:0x0].0x0 (ffff88008a83f100) 00010000:00010000:0.0:1716999789.708065:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.708067:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7127 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708070:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7127 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6fb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708637:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7119 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708643:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7119 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708647:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7119 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708651:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.708653:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7119 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708657:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7119 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708664:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0x0 (ffff8800910ce400) 00010000:00010000:0.0:1716999789.708667:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.708669:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7119 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.708673:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7119 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999789.708681:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bc9880 reply state ffff8800a6add000 transno 4294986182 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f5:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.708688:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.710133:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480738432:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 5158us (5676us total) trans 4294986182 rc 0/0 00000100:00100000:1.0:1716999789.710201:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.710325:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480738560 00000100:00100000:3.0:1716999789.710332:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480738560 00000100:00100000:3.0:1716999789.710364:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45775 00000100:00100000:3.0:1716999789.710370:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+604:11419:x1800404480738560:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999789.710406:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999789.710422:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf518c0/0x6d188eabd8d8655f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52650 expref: 604 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.710437:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb98b40/0x6d188eabd8d7c5b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d6:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f629 expref: 603 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.710446:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215f600/0x6d188eabd8d7c593 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f61b expref: 602 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.710456:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c575b00/0x6d188eabd8d7099d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6c0 expref: 601 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.710462:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d6:0x0].0x0 (ffff8800b431da00) 00010000:00010000:3.0:1716999789.710469:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.710489:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7135 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.710498:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7135 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.710504:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7135 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.710516:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc713c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0xc734d1c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.710520:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc713c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.710524:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc713c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.710612:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7143 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.710618:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7143 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.710622:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7143 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999789.711030:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1497, 64 off104064 00000040:00080000:3.0:1716999789.711082:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11546, 184 off2064568 00010000:00010000:3.0:1716999789.711134:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc714a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711140:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc714a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711145:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc714a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711150:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc714a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711154:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc714a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711163:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc714a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711167:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc714a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711171:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999789.711174:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc714a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711178:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc714a lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711183:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d6:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999789.711185:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999789.711187:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc714a lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711191:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc714a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711205:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7143 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711209:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7143 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711213:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7143 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711216:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.711218:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7143 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711225:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7143 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711230:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d6:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999789.711232:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.711233:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7143 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711237:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7143 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6d6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711267:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7135 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711270:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7135 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711274:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7135 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711277:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.711279:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7135 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711282:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7135 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711286:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999789.711288:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.711290:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7135 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.711293:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7135 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999789.711299:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009155ad80 reply state ffff8800941df000 transno 4294986183 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc713c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999789.711304:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.711343:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480738560:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 972us (1141us total) trans 4294986183 rc 0/0 00000100:00100000:3.0:1716999789.711348:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45775 00000100:00100000:0.0:1716999789.711648:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45774 00010000:00010000:0.0:1716999789.713205:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7120 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f5:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.713213:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7120 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6f5:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.713218:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7120 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f5:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.713222:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.713226:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7120 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f5:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.713234:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7120 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f5:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.713245:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0x8e1e1fc5 (ffff88008a83f300) 00010000:00010000:0.0:1716999789.713247:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.713250:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7120 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6f5:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.713254:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7120 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f5:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999789.714435:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.715063:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480738624 00000100:00100000:1.0:1716999789.715070:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480738624 00000100:00100000:1.0:1716999789.715100:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9173 00000100:00100000:1.0:1716999789.715106:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+600:11420:x1800404480738624:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:0.0:1716999789.716327:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc713c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.716336:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc713c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.716341:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc713c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.716345:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.716348:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc713c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.716353:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc713c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.716363:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xc734d1c8 (ffff8800a5c6ef00) 00010000:00010000:0.0:1716999789.716365:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.716368:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc713c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.716372:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc713c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999789.717190:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.717499:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480738752 00000100:00100000:3.0:1716999789.717506:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480738752 00000100:00100000:3.0:1716999789.717541:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9174 00000100:00100000:3.0:1716999789.717547:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480738752:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999789.717754:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480738752:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 206us (567us total) trans 4294986184 rc 0/0 00000100:00100000:3.0:1716999789.717760:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9174 00000100:00100000:1.0:1716999789.719673:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+600:11420:x1800404480738624:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4560us (5235us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.719682:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9173 00000100:00100000:3.0:1716999789.721192:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.721382:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480738880 00000100:00100000:1.0:1716999789.721388:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480738880 00000100:00100000:1.0:1716999789.721674:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9175 00000100:00100000:1.0:1716999789.721680:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+600:11419:x1800404480738880:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999789.721946:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11547, 168 off2064736 00000100:00100000:3.0:1716999789.722291:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.722412:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480738944 00000100:00100000:0.0:1716999789.722416:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480738944 00000100:00100000:0.0:1716999789.722437:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45776 00000100:00100000:0.0:1716999789.722441:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480738944:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:0.0:1716999789.722450:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.722464:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7151 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661c0 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.722500:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7158 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722511:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7158 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722519:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7158 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722530:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc715f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722535:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc715f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722540:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc715f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722610:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6cd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722617:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722626:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:0.0:1716999789.722645:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6cd:0x0]: returning size 260096 00000004:00200000:0.0:1716999789.722648:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999789.722658:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cd:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722664:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722669:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7158 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722673:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7158 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722678:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7158 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722682:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.722685:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7158 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722690:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7158 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722697:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x0 (ffff8800a660c800) 00010000:00010000:0.0:1716999789.722699:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.722702:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7158 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722706:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7158 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722715:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc715f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722720:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc715f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722724:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc715f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722728:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.722730:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc715f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722733:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc715f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722737:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0xec7107a9 (ffff88008a83f200) 00010000:00010000:0.0:1716999789.722739:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.722740:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc715f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722743:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc715f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.722762:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7151 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661c0 expref: 604 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.722770:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661c0 expref: 603 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.722775:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cd:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:0.0:1716999789.722777:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1716999789.722779:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130fc0, rc 0) 00000100:00100000:0.0:1716999789.722825:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480738944:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 383us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.722831:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45776 00000100:00100000:1.0:1716999789.722917:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480738880:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1236us (1728us total) trans 4294986185 rc 0/0 00000100:00100000:1.0:1716999789.722924:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9175 00000100:00100000:3.0:1716999789.725267:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.725925:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480739072 00000100:00100000:0.0:1716999789.725933:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480739072 00000100:00100000:0.0:1716999789.725974:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45777 00000100:00100000:0.0:1716999789.725979:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+602:11419:x1800404480739072:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.726018:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.726035:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9d40/0x6d188eabd8dc323c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64e17 expref: 602 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.726049:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8d7c6ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d8:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f684 expref: 601 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.726060:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e52880/0x6d188eabd8d73858 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c8be expref: 600 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.726069:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215f3c0/0x6d188eabd8d73804 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d8:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c8a2 expref: 599 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.726077:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d8:0x0].0x0 (ffff8800b431d100) 00010000:00010000:0.0:1716999789.726085:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.726104:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc716d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726113:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc716d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726123:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc716d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726137:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7174 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d0:0x0].0xe4a56594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726141:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726146:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726222:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc717b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726227:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc717b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726232:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc717b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999789.726570:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1498, 64 off104128 00000040:00080000:0.0:1716999789.726586:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11548, 176 off2064912 00010000:00010000:0.0:1716999789.726628:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7182 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726634:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7182 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726639:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7182 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726643:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7182 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726651:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7182 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726655:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7182 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726660:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7182 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726664:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999789.726666:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7182 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726671:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7182 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726676:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d8:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999789.726677:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999789.726680:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7182 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726683:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7182 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726698:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc717b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726702:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc717b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726706:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc717b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726709:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.726712:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc717b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726715:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc717b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726720:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d8:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999789.726721:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.726723:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc717b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726726:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc717b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6d8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726757:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc716d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726761:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc716d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726764:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc716d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726767:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.726769:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc716d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726773:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc716d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726777:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:0.0:1716999789.726779:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.726781:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc716d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.726787:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc716d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999789.726792:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a691f80 reply state ffff8800a6ad8000 transno 4294986186 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.726798:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.726866:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+600:11419:x1800404480739072:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 885us (1602us total) trans 4294986186 rc 0/0 00000100:00100000:0.0:1716999789.726872:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45777 00000100:00100000:3.0:1716999789.729183:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.729227:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.729236:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480739200 00000100:00100000:1.0:1716999789.729242:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480739200 00000100:00100000:1.0:1716999789.729275:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9176 00000100:00100000:1.0:1716999789.729280:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+600:11420:x1800404480739200:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999789.729575:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11549, 168 off2065080 00000001:00080000:1.0:1716999789.729580:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986187 00000100:00100000:1.0:1716999789.729638:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480739200:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 358us (461us total) trans 4294986188 rc 0/0 00000100:00100000:1.0:1716999789.729644:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9176 00000020:00080000:1.0:1716999789.729647:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999789.730365:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480739264 00000100:00100000:2.0:1716999789.730370:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480739264 00000100:00100000:2.0:1716999789.730397:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45778 00000100:00100000:2.0:1716999789.730402:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+602:11545:x1800404480739264:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:2.0:1716999789.730411:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999789.730423:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7189 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661c7 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.730444:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661c7 expref: 603 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.730454:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661c7 expref: 603 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.730461:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x0 (ffff8800a660c800) 00010000:00010000:2.0:1716999789.730463:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.730466:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091831d40, rc 0) 00000100:00100000:2.0:1716999789.730496:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11545:x1800404480739264:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 93us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.730500:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45778 00010000:00010000:0.0:1716999789.730630:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7174 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.730637:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7174 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.730642:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7174 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.730647:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.730650:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7174 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.730656:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7174 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d0:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.730665:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0xe4a56594 (ffff88008a83f700) 00010000:00010000:0.0:1716999789.730667:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.730670:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7174 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999789.730674:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7174 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d0:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999789.734107:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.734265:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.734331:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.734356:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.734378:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480739520 00000100:00100000:2.0:1716999789.734385:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480739520 00000100:00100000:2.0:1716999789.734418:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480739584 00000100:00100000:2.0:1716999789.734420:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480739584 00000100:00100000:2.0:1716999789.734434:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45779 00000100:00100000:2.0:1716999789.734440:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+603:11419:x1800404480739520:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:1.0:1716999789.734446:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45780 00000100:00100000:1.0:1716999789.734452:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+603:11547:x1800404480739584:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:1.0:1716999789.734472:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.734486:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7190 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661ce expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.734489:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999789.734507:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ce expref: 604 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.734509:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc6c5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc55:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660a1 expref: 604 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.734516:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ce expref: 604 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.734523:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.734525:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.734529:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b3cc0, rc 0) 00010000:00010000:2.0:1716999789.734534:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9f80/0x6d188eabd8dc6c0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66085 expref: 603 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.734543:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc55:0x0].0x0 (ffff8800923b8700) 00010000:00010000:2.0:1716999789.734553:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646a1c0/0x6d188eabd8dc6f52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6617a expref: 602 pid: 4523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999789.734563:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+601:11547:x1800404480739584:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 112us (231us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999789.734564:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc6ded lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66134 expref: 601 pid: 11055 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999789.734568:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45780 00010000:00010000:2.0:1716999789.734569:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.734572:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.734591:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.734602:0:11055:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7190 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ce expref: 599 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.734609:0:11055:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.734632:0:11055:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ce expref: 599 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.734642:0:11055:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7190 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ce expref: 599 pid: 7785 timeout: 408 lvb_type: 0 00000100:00100000:2.0:1716999789.734652:0:11055:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099bcb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11055:1800404483016960:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999789.734700:0:11055:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009c108c00 going to sleep for 11 seconds 00000100:00100000:0.0:1716999789.734904:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480739392 00000100:00100000:0.0:1716999789.734918:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480739392 00000100:00100000:0.0:1716999789.734942:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480739648 00000100:00100000:0.0:1716999789.734944:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480739648 00000100:00100000:0.0:1716999789.734956:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9177 00000100:00100000:0.0:1716999789.734960:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+601:11420:x1800404480739392:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999789.735086:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+602:11420:x1800404480739392:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 124us (985us total) trans 4294986189 rc 0/0 00000100:00100000:0.0:1716999789.735092:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9177 00000100:00100000:0.0:1716999789.735104:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9178 00000100:00100000:0.0:1716999789.735107:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+601:11545:x1800404480739648:12345-192.168.203.3@tcp:37:ll_sa.0 00000100:00100000:3.0:1716999789.742400:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.742551:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480739712 00000100:00100000:1.0:1716999789.742559:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480739712 00000100:00100000:1.0:1716999789.742593:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9179 00000100:00100000:1.0:1716999789.742600:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+602:11547:x1800404480739712:12345-192.168.203.3@tcp:37:ll_sa.0 00000100:00100000:0.0:1716999789.742899:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+602:11545:x1800404480739648:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 7788us (8539us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.742906:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9178 00000100:00100000:2.0:1716999789.743029:0:11055:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099bcb100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11055:1800404483016960:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999789.743055:0:11055:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.745461:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.745497:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.745632:0:4523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480739904 00000100:00100000:1.0:1716999789.745638:0:4523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480739904 00000100:00100000:1.0:1716999789.745664:0:4523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:1.0:1716999789.745670:0:4523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+603:1959:x1800404480739904:12345-192.168.203.3@tcp:63:ll_sa.0 00010000:00010000:1.0:1716999789.745697:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999789.745710:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc719e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661d5 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.745742:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc71a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745754:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc71a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745762:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc71a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745771:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc71ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745777:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc71ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745781:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc71ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745870:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc71b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6cf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745907:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc71b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cf:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745914:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc71b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cf:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999789.745937:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6cf:0x0]: returning size 260096 00000004:00200000:1.0:1716999789.745940:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999789.745951:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc71b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cf:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745958:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc71b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745963:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc71a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745968:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc71a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745973:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc71a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745977:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.745980:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc71a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745985:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc71a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.745993:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x0 (ffff8800a660c800) 00010000:00010000:1.0:1716999789.745995:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.745998:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc71a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.746002:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc71a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.746013:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc71ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.746017:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc71ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.746020:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc71ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.746024:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.746026:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc71ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.746030:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc71ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.746034:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x1ec7ed2b (ffff8800900d1600) 00010000:00010000:1.0:1716999789.746036:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.746038:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc71ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.746042:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc71ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999789.746060:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc719e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661d5 expref: 604 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.746068:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc71b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661d5 expref: 603 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.746073:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cf:0x0].0x0 (ffff880091b4d700) 00010000:00010000:1.0:1716999789.746075:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1716999789.746076:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b33c0, rc 0) 00000100:00100000:1.0:1716999789.746109:0:4523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+603:1959:x1800404480739904:12345-192.168.203.3@tcp:63:ll_sa.0 Request processed in 439us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.746116:0:4523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 11 00000100:00100000:2.0:1716999789.746193:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480739840 00000100:00100000:2.0:1716999789.746197:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480739840 00000100:00100000:2.0:1716999789.746214:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45781 00000100:00100000:2.0:1716999789.746217:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+603:11420:x1800404480739840:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.746236:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1716999789.746246:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6cd:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661c0 expref: 603 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.746257:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c0900/0x6d188eabd8d79cab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6cd:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4e92c expref: 602 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.746267:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091186f40/0x6d188eabd8d7bd35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6cd:0x0].0x0 bits 0xc/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f35f expref: 601 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.746275:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ecfc0/0x6d188eabd8d79a58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6cd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4e884 expref: 600 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.746281:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cd:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:2.0:1716999789.746294:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367600/0x6d188eabd8dc6e4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66149 expref: 599 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.746300:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x0 (ffff8800a660c800) 00010000:00010000:2.0:1716999789.746302:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.746312:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.746318:0:6823:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7189 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661c7 expref: 598 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.746324:0:6823:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999789.746457:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+598:11547:x1800404480739712:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 3856us (4062us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.746463:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9179 00010000:00010000:2.0:1716999789.747101:0:6823:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661c7 expref: 598 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.747114:0:6823:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661c7 expref: 597 pid: 11055 timeout: 408 lvb_type: 0 00000100:00100000:2.0:1716999789.747124:0:6823:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099bcb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6823:1800404483017024:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999789.747161:0:6823:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009c108c00 going to sleep for 11 seconds 00000100:00100000:3.0:1716999789.749551:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.749595:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480739968 00000100:00100000:0.0:1716999789.749601:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480739968 00010000:00010000:0.0:1716999789.749626:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7190 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ce expref: 598 pid: 7785 timeout: 408 lvb_type: 0 00000100:00100000:0.0:1716999789.749662:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4575 00000100:00100000:0.0:1716999789.749667:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:1956:x1800404480739968:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999789.749678:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999789.749684:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7190 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ce expref: 598 pid: 7785 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.749691:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ce expref: 598 pid: 7785 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.749706:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7190 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ce expref: 598 pid: 7785 timeout: 408 lvb_type: 0 00010000:00010000:0.0:1716999789.749730:0:15839:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999789.749734:0:15839:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.749740:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.749745:0:15839:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.749768:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.749789:0:11055:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.749796:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.749811:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:1956:x1800404480739968:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 143us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.749817:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4575 00010000:00010000:2.0:1716999789.749821:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc71c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.749829:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc71c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.749835:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc71c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.749951:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc71c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.749957:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc71c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.749963:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc71c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.750605:0:6823:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099bcb100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6823:1800404483017024:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999789.750613:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999789.750618:0:6823:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999789.750659:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480740032 00000100:00100000:1.0:1716999789.750663:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480740032 00010000:00010000:1.0:1716999789.750674:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661c7 expref: 597 pid: 11055 timeout: 408 lvb_type: 0 00000100:00100000:1.0:1716999789.750690:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4576 00000100:00100000:1.0:1716999789.750695:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:1958:x1800404480740032:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999789.750702:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999789.750706:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661c7 expref: 597 pid: 11055 timeout: 408 lvb_type: 0 00010000:00010000:1.0:1716999789.750713:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661c7 expref: 597 pid: 11055 timeout: 408 lvb_type: 0 00010000:00010000:1.0:1716999789.750725:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7189 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661c7 expref: 597 pid: 11055 timeout: 408 lvb_type: 0 00010000:00010000:1.0:1716999789.750733:0:15839:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x0 (ffff8800a660c800) 00010000:00010000:1.0:1716999789.750736:0:15839:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.750743:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.750748:0:15839:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.750759:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.750769:0:6823:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.750775:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999789.750778:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+596:1958:x1800404480740032:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 82us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.750784:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4576 00010000:00010000:3.0:1716999789.750788:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc71cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.750793:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc71cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.750799:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc71cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.750865:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc71d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6cd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.750870:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc71d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6cd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.750876:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc71d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6cd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:3.0:1716999789.751232:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1494, 64 off103872 00000040:00080000:3.0:1716999789.751251:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11550, 184 off2065264 00010000:00010000:3.0:1716999789.751300:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc71dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6cd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751307:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc71dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751314:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc71dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751319:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc71dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751322:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc71dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751326:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc71dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751332:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc71dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751336:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51200 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999789.751339:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc71dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751345:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc71dd lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751351:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cd:0x0].0x0 (ffff8800a5c6ec00) 00010000:00010000:3.0:1716999789.751353:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999789.751356:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc71dd lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751360:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc71dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6cd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751397:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc71d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6cd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751402:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc71d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6cd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751407:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc71d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6cd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751410:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.751413:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc71d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6cd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751417:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc71d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6cd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751422:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cd:0x0].0x0 (ffff8800a5c6ec00) 00010000:00010000:3.0:1716999789.751424:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.751426:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc71d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6cd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751429:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc71d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6cd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751463:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751472:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751476:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751480:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.751481:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751485:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751494:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x0 (ffff8800a660c800) 00010000:00010000:3.0:1716999789.751496:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.751498:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.751501:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc71ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:3.0:1716999789.751506:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca8a80 reply state ffff880134a76000 transno 4294986190 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc71cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999789.751511:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.751544:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+597:11420:x1800404480739840:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 5324us (6087us total) trans 4294986190 rc 0/0 00000100:00100000:3.0:1716999789.751550:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45781 00000004:00080000:2.0:1716999789.752935:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0xc55:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.752982:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11551, 184 off2065448 00010000:00010000:2.0:1716999789.753049:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc71c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753056:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc71c8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753060:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc71c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753065:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.753067:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc71c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753072:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc71c8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753080:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc55:0x0].0x0 (ffff880088977600) 00010000:00010000:2.0:1716999789.753082:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.753084:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc71c8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753087:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc71c8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753099:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753103:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753107:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753110:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.753112:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753115:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753120:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.753121:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.753123:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.753127:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7197 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999789.753133:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a690e00 reply state ffff880134a71000 transno 4294986191 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc71c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999789.753137:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.753191:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480739520:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 18749us (18924us total) trans 4294986191 rc 0/0 00000100:00100000:2.0:1716999789.753196:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45779 00010000:00010000:2.0:1716999789.753241:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc71cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.753246:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc71cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.753250:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc71cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.753253:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.753255:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc71cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.753258:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc71cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.753263:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0xec7107a9 (ffff8800a5c6e200) 00010000:00010000:2.0:1716999789.753265:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.753267:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc71cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.753274:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc71cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6cb:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999789.754598:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.754696:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480740160 00000100:00100000:0.0:1716999789.754703:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480740160 00000100:00100000:0.0:1716999789.754734:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9180 00000100:00100000:0.0:1716999789.754739:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+597:11420:x1800404480740160:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:1.0:1716999789.754780:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc71c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.754787:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc71c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.754792:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc71c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.754796:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.754799:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc71c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.754816:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc71c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.754825:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6cad4e9d (ffff880088977f00) 00010000:00010000:1.0:1716999789.754828:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.754830:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc71c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.754835:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc71c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000040:00080000:0.0:1716999789.755381:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11552, 168 off2065616 00000001:00080000:0.0:1716999789.755386:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986192 00000100:00100000:0.0:1716999789.755444:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+598:11420:x1800404480740160:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 703us (849us total) trans 4294986193 rc 0/0 00000100:00100000:1.0:1716999789.755509:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.755547:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480740288 00000100:00100000:3.0:1716999789.755551:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480740288 00000100:00100000:3.0:1716999789.755568:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9181 00000100:00100000:3.0:1716999789.755572:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+599:11419:x1800404480740288:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:3.0:1716999789.755756:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986194 00000100:00100000:3.0:1716999789.755817:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480740288:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 243us (308us total) trans 4294986195 rc 0/0 00000100:00100000:3.0:1716999789.755822:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9181 00000020:00080000:3.0:1716999789.755826:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.755978:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9180 00000020:00080000:0.0:1716999789.755980:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999789.756938:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.756974:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480740480 00000100:00100000:0.0:1716999789.756979:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480740480 00000100:00100000:0.0:1716999789.757010:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9182 00000100:00100000:0.0:1716999789.757014:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+600:11420:x1800404480740480:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999789.757118:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+601:11420:x1800404480740480:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 102us (182us total) trans 4294986196 rc 0/0 00000100:00100000:0.0:1716999789.757123:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9182 00000100:00100000:2.0:1716999789.759172:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.759272:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480740544 00000100:00100000:0.0:1716999789.759278:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480740544 00000100:00100000:0.0:1716999789.759311:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45782 00000100:00100000:0.0:1716999789.759317:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480740544:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:1.0:1716999789.759338:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999789.759348:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.759364:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091330480/0x6d188eabd8d7ee19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x70a:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f503b9 expref: 601 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999789.759366:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480740672 00000100:00100000:3.0:1716999789.759370:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480740672 00010000:00010000:0.0:1716999789.759382:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913333c0/0x6d188eabd8d76705 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x70a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4d751 expref: 601 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999789.759396:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45783 00010000:00010000:0.0:1716999789.759400:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091332880/0x6d188eabd8d7ee0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f503b2 expref: 600 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999789.759401:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+600:11420:x1800404480740672:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.759410:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fb180/0x6d188eabd8d71af3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdea expref: 599 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.759418:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.759421:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70a:0x0].0x0 (ffff88012ca38000) 00010000:00010000:3.0:1716999789.759428:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc71b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6cf:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661d5 expref: 598 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.759429:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.759440:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ef3c0/0x6d188eabd8d7b9e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6cf:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f25c expref: 597 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.759447:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc71e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.759450:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb9b180/0x6d188eabd8d7bfc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6cf:0x0].0x0 bits 0xc/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f423 expref: 596 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.759456:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc71e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.759459:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf51b00/0x6d188eabd8d7b6e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6cf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f160 expref: 595 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.759462:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc71e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.759465:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cf:0x0].0x0 (ffff880091b4d700) 00010000:00010000:3.0:1716999789.759470:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.759471:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc71eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x862169a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.759475:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc71eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.759480:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc71f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.759480:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc71eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.759486:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc71f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.759491:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc71f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.759498:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc71f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.759503:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc71f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.759507:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc71f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.759561:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7200 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6cf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.759566:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.759570:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.759571:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7207 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x70a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.759577:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7207 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.759582:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7207 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:3.0:1716999789.759980:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1495, 64 off103936 00000040:00080000:3.0:1716999789.759996:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11553, 184 off2065800 00010000:00010000:3.0:1716999789.760041:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc720e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6cf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760047:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc720e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760053:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc720e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760058:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc720e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760062:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc720e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760067:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc720e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760071:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc720e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760075:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999789.760078:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc720e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760083:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc720e lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760088:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cf:0x0].0x0 (ffff8800a5c6e100) 00010000:00010000:3.0:1716999789.760090:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999789.760092:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc720e lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760096:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc720e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6cf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760110:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760113:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7200 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760117:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7200 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760120:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.760122:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7200 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760126:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7200 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760130:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cf:0x0].0x0 (ffff8800a5c6e100) 00010000:00010000:3.0:1716999789.760132:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.760133:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7200 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00080000:0.0:1716999789.760135:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x70a:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1716999789.760137:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7200 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6cf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000040:00080000:0.0:1716999789.760164:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11554, 184 off2065984 00010000:00010000:3.0:1716999789.760165:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc71f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760170:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc71f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760173:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc71f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760176:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.760178:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc71f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760182:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc71f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760186:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x0 (ffff8800a660c800) 00010000:00010000:3.0:1716999789.760187:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.760189:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc71f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.760193:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc71f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6cb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:3.0:1716999789.760199:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880091558000 reply state ffff8800941dd000 transno 4294986197 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc71f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999789.760204:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1716999789.760209:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7207 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.760215:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7207 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x70a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.760219:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7207 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.760224:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.760226:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7207 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.760231:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7207 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x70a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.760237:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70a:0x0].0x0 (ffff88008a83f500) 00000100:00100000:3.0:1716999789.760239:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+597:11420:x1800404480740672:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 838us (902us total) trans 4294986197 rc 0/0 00010000:00010000:0.0:1716999789.760239:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.760241:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7207 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x70a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.760244:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45783 00010000:00010000:0.0:1716999789.760245:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7207 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x70a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.760255:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc71e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.760259:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc71e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.760263:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc71e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.760267:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.760268:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc71e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.760275:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc71e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.760280:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999789.760282:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.760284:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc71e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.760287:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc71e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:0.0:1716999789.760792:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bca300 reply state ffff8800a6ad9000 transno 4294986198 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc71eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.760798:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.760833:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:11419:x1800404480740544:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1515us (1664us total) trans 4294986198 rc 0/0 00000100:00100000:0.0:1716999789.760839:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45782 00010000:00010000:0.0:1716999789.761592:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc71f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.761598:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc71f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.761603:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc71f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.761607:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.761613:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc71f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.761617:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc71f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.761625:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x1ec7ed2b (ffff8800a5c6ea00) 00010000:00010000:0.0:1716999789.761627:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.761630:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc71f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.761634:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc71f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6cb:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.763320:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc71eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.763327:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999789.763329:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc71eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.763334:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc71eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.763338:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.763341:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc71eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.763434:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480740800 00000100:00100000:0.0:1716999789.763440:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480740800 00000100:00100000:0.0:1716999789.763466:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9183 00000100:00100000:0.0:1716999789.763471:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+596:11419:x1800404480740800:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:2.0:1716999789.763701:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc71eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.763710:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x862169a0 (ffff88008a83ff00) 00010000:00010000:2.0:1716999789.763712:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.763715:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc71eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.763719:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc71eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.763780:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+596:11419:x1800404480740800:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 308us (456us total) trans 4294986199 rc 0/0 00000100:00100000:0.0:1716999789.763787:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9183 00000100:00100000:2.0:1716999789.764190:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.764320:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480740864 00000100:00100000:0.0:1716999789.764324:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480740864 00000100:00100000:0.0:1716999789.764352:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9184 00000100:00100000:0.0:1716999789.764356:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+596:11420:x1800404480740864:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:2.0:1716999789.766853:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.768265:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480740992 00000100:00100000:0.0:1716999789.768273:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480740992 00000100:00100000:0.0:1716999789.768320:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45784 00000100:00100000:0.0:1716999789.768326:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+598:11419:x1800404480740992:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.768364:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.768384:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367cc0/0x6d188eabd8d80224 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x720:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50a50 expref: 598 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.768404:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646a880/0x6d188eabd8d77f5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x720:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4df7e expref: 597 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.768416:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6400/0x6d188eabd8d801fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x720:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50a3b expref: 596 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.768426:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9680/0x6d188eabd8d72175 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x720:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0de expref: 595 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.768434:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x720:0x0].0x0 (ffff88009c21f200) 00010000:00010000:0.0:1716999789.768441:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.768462:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7215 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.768472:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.768479:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.768489:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc721c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x9b856f73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.768494:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc721c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.768499:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc721c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.768573:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7223 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x720:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.768583:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7223 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x720:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.768588:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7223 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x720:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:0.0:1716999789.768985:0:6822:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x720:0x0] is inserted into orphan list, open count = 1 00000040:00080000:0.0:1716999789.769023:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11555, 184 off2066168 00000100:00100000:1.0:1716999789.769920:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+594:11420:x1800404480740864:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5558us (5726us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.769928:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9184 00010000:00010000:0.0:1716999789.770283:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7223 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x720:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770290:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7223 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x720:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770296:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7223 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x720:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770300:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.770303:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7223 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x720:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770308:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7223 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x720:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770318:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x720:0x0].0x0 (ffff88008a83fa00) 00010000:00010000:0.0:1716999789.770320:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.770323:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7223 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x720:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770327:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7223 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x720:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770340:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7215 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770344:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7215 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770348:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7215 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770352:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.770354:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7215 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770358:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7215 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770363:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999789.770365:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.770367:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7215 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.770371:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7215 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999789.770378:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bcb100 reply state ffff88009ee1a000 transno 4294986200 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc721c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999789.770384:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.772195:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480740992:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3863us (5341us total) trans 4294986200 rc 0/0 00000100:00100000:0.0:1716999789.772204:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45784 00000100:00100000:2.0:1716999789.773634:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.773675:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.773816:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480741120 00000100:00100000:1.0:1716999789.773822:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480741120 00000100:00100000:1.0:1716999789.773855:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9185 00000100:00100000:1.0:1716999789.773860:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+594:11420:x1800404480741120:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999789.774237:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11556, 168 off2066336 00000001:00080000:1.0:1716999789.774242:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986201 00000100:00100000:1.0:1716999789.774322:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+596:11420:x1800404480741120:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 461us (690us total) trans 4294986202 rc 0/0 00000100:00100000:1.0:1716999789.774329:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9185 00000020:00080000:1.0:1716999789.774332:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.774463:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480741184 00000100:00100000:0.0:1716999789.774467:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480741184 00000100:00100000:0.0:1716999789.774484:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45785 00000100:00100000:0.0:1716999789.774488:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+596:11549:x1800404480741184:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:0.0:1716999789.774496:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999789.774507:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc722a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x730:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661dc expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.774596:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc722a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661dc expref: 597 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.774608:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc722a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661dc expref: 597 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.774614:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x730:0x0].0x0 (ffff880131c40500) 00010000:00010000:0.0:1716999789.774617:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.774619:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133600, rc 0) 00000100:00100000:3.0:1716999789.774640:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.774684:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+597:11549:x1800404480741184:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 195us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999789.774689:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45785 00010000:00010000:0.0:1716999789.774705:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc721c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.774710:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc721c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.774716:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc721c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.774720:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.774723:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc721c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.774728:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc721c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.774736:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x9b856f73 (ffff88008a83f100) 00010000:00010000:0.0:1716999789.774738:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.774740:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc721c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.774744:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc721c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999789.775972:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480741312 00000100:00100000:1.0:1716999789.775978:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480741312 00000100:00100000:1.0:1716999789.776007:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9186 00000100:00100000:1.0:1716999789.776012:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+596:11419:x1800404480741312:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999789.776179:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11557, 168 off2066504 00000100:00100000:1.0:1716999789.776253:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+597:11419:x1800404480741312:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 239us (1614us total) trans 4294986203 rc 0/0 00000100:00100000:1.0:1716999789.776259:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9186 00000100:00100000:3.0:1716999789.776637:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.776666:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.776688:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480741440 00000100:00100000:1.0:1716999789.776696:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480741440 00000100:00100000:1.0:1716999789.776709:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480741504 00000100:00100000:1.0:1716999789.776711:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480741504 00000100:00100000:1.0:1716999789.776721:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9187 00000100:00100000:1.0:1716999789.776724:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+598:11420:x1800404480741440:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999789.776860:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9188 00000100:00100000:2.0:1716999789.776864:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+599:11549:x1800404480741504:12345-192.168.203.3@tcp:37:ll_sa.0 00000100:00100000:1.0:1716999789.777487:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+600:11420:x1800404480741440:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 760us (849us total) trans 4294986204 rc 0/0 00000100:00100000:1.0:1716999789.777493:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9187 00000100:00100000:0.0:1716999789.778385:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.778553:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480741632 00000100:00100000:1.0:1716999789.778559:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480741632 00000100:00100000:1.0:1716999789.778577:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9189 00000100:00100000:1.0:1716999789.778581:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+600:11419:x1800404480741632:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.778691:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+601:11419:x1800404480741632:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 108us (306us total) trans 4294986205 rc 0/0 00000100:00100000:1.0:1716999789.778696:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9189 00000100:00100000:0.0:1716999789.780303:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.780360:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480741760 00000100:00100000:1.0:1716999789.780365:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480741760 00000100:00100000:1.0:1716999789.780389:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45786 00000100:00100000:1.0:1716999789.780394:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+601:11420:x1800404480741760:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999789.780425:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1716999789.780444:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091332400/0x6d188eabd8d8ee17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x732:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f551c3 expref: 601 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.780464:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094779440/0x6d188eabd8d8159c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x732:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5107e expref: 600 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.780475:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133142640/0x6d188eabd8d814f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x732:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5104d expref: 599 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.780484:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c0480/0x6d188eabd8d7273a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x732:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c346 expref: 598 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.780493:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x732:0x0].0x0 (ffff8800939ba000) 00010000:00010000:1.0:1716999789.780505:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e33c0/0x6d188eabd8dc6e6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x730:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66150 expref: 597 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.780512:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x730:0x0].0x0 (ffff880131c40500) 00010000:00010000:1.0:1716999789.780514:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.780531:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x730:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.780540:0:11055:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc722a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661dc expref: 596 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.780545:0:11055:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.780568:0:11055:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc722a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661dc expref: 596 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.780578:0:11055:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc722a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661dc expref: 596 pid: 6822 timeout: 408 lvb_type: 0 00000100:00100000:1.0:1716999789.780588:0:11055:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880091559f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11055:1800404483017088:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999789.780619:0:11055:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099f1a900 going to sleep for 11 seconds 00000100:00100000:2.0:1716999789.781269:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+595:11549:x1800404480741504:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 4401us (4599us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.781277:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9188 00000100:00100000:3.0:1716999789.782208:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.782257:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480741888 00000100:00100000:0.0:1716999789.782263:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480741888 00000100:00100000:0.0:1716999789.782295:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45787 00000100:00100000:0.0:1716999789.782301:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+595:11419:x1800404480741888:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.782328:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.782343:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8d8aaa2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x72c:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f53c22 expref: 595 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.782400:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094779200/0x6d188eabd8d80efe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72c:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50e7f expref: 594 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.782415:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094778900/0x6d188eabd8d80e6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50e5c expref: 593 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.782423:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a89018c0/0x6d188eabd8d7250a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c27b expref: 592 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.782430:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72c:0x0].0x0 (ffff880131c40000) 00010000:00010000:0.0:1716999789.782437:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.782454:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7238 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.782463:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7238 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.782470:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7238 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.782479:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc723f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x86398c8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.782484:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc723f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.782488:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc723f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.782565:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7246 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x72c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.782570:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7246 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.782574:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7246 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:0.0:1716999789.783017:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1499, 64 off104192 00000040:00080000:0.0:1716999789.783035:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11558, 184 off2066688 00010000:00010000:0.0:1716999789.783083:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc724d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x72c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783090:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc724d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783099:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc724d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783104:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc724d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x72c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783108:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc724d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x72c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783112:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc724d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x72c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783117:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc724d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x72c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783122:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999789.783126:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc724d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x72c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783131:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc724d lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x72c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783138:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72c:0x0].0x0 (ffff88008a83f200) 00010000:00010000:0.0:1716999789.783140:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999789.783143:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc724d lrc: 3/0,0 mode: --/PW res: [0x200000401:0x72c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783147:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc724d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x72c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783165:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7246 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783169:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7246 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x72c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783173:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7246 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783177:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.783179:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7246 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783183:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7246 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x72c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783188:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72c:0x0].0x0 (ffff88008a83f200) 00010000:00010000:0.0:1716999789.783190:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.783192:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7246 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x72c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.783195:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7246 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x72c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.784387:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7238 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.784394:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7238 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.784398:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7238 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.784402:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.784404:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7238 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.784408:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7238 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.784419:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999789.784421:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.784423:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7238 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999789.784427:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7238 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999789.784434:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca8e00 reply state ffff88009ee1b000 transno 4294986206 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc723f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999789.784440:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.786203:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480741888:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3895us (3990us total) trans 4294986206 rc 0/0 00000100:00100000:0.0:1716999789.786212:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45787 00000100:00100000:3.0:1716999789.786546:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.786598:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480741952 00000100:00100000:1.0:1716999789.786604:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480741952 00010000:00010000:1.0:1716999789.786624:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc722a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661dc expref: 593 pid: 6822 timeout: 408 lvb_type: 0 00000100:00100000:1.0:1716999789.786640:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4577 00000100:00100000:1.0:1716999789.786644:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+593:1959:x1800404480741952:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999789.786653:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999789.786657:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc722a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661dc expref: 593 pid: 6822 timeout: 408 lvb_type: 0 00010000:00010000:1.0:1716999789.786665:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc722a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661dc expref: 593 pid: 6822 timeout: 408 lvb_type: 0 00010000:00010000:1.0:1716999789.786678:0:15839:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x730:0x0].0x0 (ffff880131c40500) 00010000:00010000:1.0:1716999789.786682:0:15839:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.786688:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.786693:0:15839:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.786705:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999789.786738:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+593:1959:x1800404480741952:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 93us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999789.786743:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4577 00010000:00010000:0.0:1716999789.786797:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc722a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661dc expref: 592 pid: 6822 timeout: 408 lvb_type: 0 00000100:00100000:0.0:1716999789.786817:0:11055:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880091559f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:11055:1800404483017088:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999789.786828:0:11055:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.786834:0:11055:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.786838:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.786851:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7254 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x730:0x0].0x1da15914 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.786859:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x730:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.786864:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x730:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.786961:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc725b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x732:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.786966:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc725b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x732:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.786971:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc725b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x732:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:0.0:1716999789.787430:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1496, 64 off104000 00000040:00080000:0.0:1716999789.787446:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11559, 184 off2066872 00010000:00010000:0.0:1716999789.787490:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7262 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x732:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787496:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x732:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787501:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x732:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787506:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7262 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x732:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787510:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7262 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x732:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787514:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7262 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x732:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787522:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7262 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x732:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787526:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999789.787529:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7262 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x732:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787533:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7262 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x732:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787539:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x732:0x0].0x0 (ffff88008a83f500) 00010000:00010000:0.0:1716999789.787540:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999789.787542:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7262 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x732:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787546:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7262 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x732:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787561:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc725b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x732:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787565:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc725b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x732:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787569:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc725b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x732:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787572:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.787574:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc725b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x732:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787577:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc725b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x732:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787585:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x732:0x0].0x0 (ffff88008a83f500) 00010000:00010000:0.0:1716999789.787587:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.787588:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc725b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x732:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787592:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc725b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x732:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787618:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787622:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787625:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787629:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b33c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.787631:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787635:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787639:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x730:0x0].0x0 (ffff880131c40500) 00010000:00010000:0.0:1716999789.787640:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.787642:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.787645:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7231 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x730:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:0.0:1716999789.787650:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a691180 reply state ffff88008e48e000 transno 4294986207 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x730:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.787655:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.787681:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+593:11420:x1800404480741760:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 7287us (7381us total) trans 4294986207 rc 0/0 00000100:00100000:0.0:1716999789.787686:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45786 00010000:00010000:2.0:1716999789.787789:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc723f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.787794:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc723f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.787798:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc723f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.787813:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.787815:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc723f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.787819:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc723f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.787824:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x86398c8e (ffff88008a83ff00) 00010000:00010000:2.0:1716999789.787826:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.787828:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc723f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.787832:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc723f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999789.791544:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.791729:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.791753:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480742016 00000100:00100000:3.0:1716999789.791758:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480742016 00010000:00010000:0.0:1716999789.792062:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7254 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x730:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.792071:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7254 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x730:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.792077:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7254 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x730:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.792081:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.792084:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7254 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x730:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.792088:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7254 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x730:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.792099:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x730:0x0].0x1da15914 (ffff88008a83f600) 00010000:00010000:0.0:1716999789.792101:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.792104:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7254 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x730:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.792108:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7254 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x730:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.792159:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480742144 00000100:00100000:3.0:1716999789.792162:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480742144 00000100:00100000:2.0:1716999789.792232:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9190 00000100:00100000:2.0:1716999789.792238:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480742016:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999789.792955:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9191 00000100:00100000:3.0:1716999789.792961:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480742144:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999789.793255:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+594:11419:x1800404480742144:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 293us (1525us total) trans 4294986208 rc 0/0 00000100:00100000:3.0:1716999789.793262:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9191 00000100:00100000:2.0:1716999789.795641:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+592:11420:x1800404480742016:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3395us (4095us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999789.795651:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9190 00000100:00100000:0.0:1716999789.796133:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.796192:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480742272 00000100:00100000:2.0:1716999789.796198:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480742272 00000100:00100000:2.0:1716999789.796248:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45788 00000100:00100000:2.0:1716999789.796252:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+592:11419:x1800404480742272:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.796326:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.796346:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8d7fd5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x71a:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f508a5 expref: 592 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.796362:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646af40/0x6d188eabd8d78065 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x71a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4dfd2 expref: 591 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.796373:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331433c0/0x6d188eabd8d7fd3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5089e expref: 590 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.796383:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419c480/0x6d188eabd8d71fc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c01a expref: 589 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.796390:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71a:0x0].0x0 (ffff880094025000) 00010000:00010000:2.0:1716999789.796397:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.796416:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7269 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.796426:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7269 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.796432:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7269 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.796442:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7270 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0xa1380d88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.796447:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.796451:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.796528:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7277 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x71a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.796534:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7277 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.796539:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7277 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:2.0:1716999789.796969:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x71a:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.797010:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11560, 184 off2067056 00010000:00010000:2.0:1716999789.797225:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7277 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797372:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7277 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x71a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797378:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7277 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797382:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.797385:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7277 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797394:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7277 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x71a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797402:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71a:0x0].0x0 (ffff880088977d00) 00010000:00010000:2.0:1716999789.797404:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.797407:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7277 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x71a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797411:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7277 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x71a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797423:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7269 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797427:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7269 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797432:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7269 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797435:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.797436:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7269 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797441:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7269 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797445:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.797447:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.797449:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7269 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.797453:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7269 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999789.797459:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a693b80 reply state ffff880134a73000 transno 4294986209 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999789.797465:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.797518:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+590:11419:x1800404480742272:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1263us (1384us total) trans 4294986209 rc 0/0 00000100:00100000:2.0:1716999789.797524:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45788 00010000:00010000:2.0:1716999789.798909:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7270 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.798917:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7270 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.798922:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7270 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.798926:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.798929:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7270 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.798934:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7270 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.798944:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xa1380d88 (ffff880088977400) 00010000:00010000:2.0:1716999789.798946:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.798949:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7270 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.798953:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7270 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.799106:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.799160:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480742400 00000100:00100000:2.0:1716999789.799167:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480742400 00000100:00100000:2.0:1716999789.799199:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9192 00000100:00100000:2.0:1716999789.799205:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+589:11419:x1800404480742400:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:2.0:1716999789.799506:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986210 00000100:00100000:2.0:1716999789.799579:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480742400:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 373us (474us total) trans 4294986211 rc 0/0 00000100:00100000:2.0:1716999789.799586:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9192 00000020:00080000:2.0:1716999789.799589:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999789.800248:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.800308:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480742528 00000100:00100000:0.0:1716999789.800313:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480742528 00000100:00100000:0.0:1716999789.800343:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9193 00000100:00100000:0.0:1716999789.800348:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480742528:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:0.0:1716999789.800547:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986212 00000100:00100000:0.0:1716999789.800599:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+593:11420:x1800404480742528:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 250us (352us total) trans 4294986213 rc 0/0 00000100:00100000:0.0:1716999789.800605:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9193 00000020:00080000:0.0:1716999789.800608:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999789.801855:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.801982:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480742656 00000100:00100000:2.0:1716999789.801987:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480742656 00000100:00100000:2.0:1716999789.802021:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45789 00000100:00100000:2.0:1716999789.802027:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+593:11419:x1800404480742656:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.802055:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.802072:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c3600/0x6d188eabd8d7efee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x70c:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5044c expref: 593 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.802088:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216db00/0x6d188eabd8d7671a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x70c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4d758 expref: 592 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.802098:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133140480/0x6d188eabd8d7efcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5043e expref: 591 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.802107:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e50b40/0x6d188eabd8d71ba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be30 expref: 590 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.802115:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70c:0x0].0x0 (ffff88012de9cf00) 00010000:00010000:2.0:1716999789.802121:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.802139:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc727e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802149:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc727e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802156:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc727e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802166:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7285 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x862169a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802170:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802175:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802243:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc728c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x70c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802248:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc728c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802253:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc728c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:2.0:1716999789.802573:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x70c:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.802611:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11561, 184 off2067240 00010000:00010000:2.0:1716999789.802666:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc728c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802672:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc728c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x70c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802677:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc728c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802682:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.802685:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc728c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802690:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc728c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x70c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802697:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70c:0x0].0x0 (ffff880088977200) 00010000:00010000:2.0:1716999789.802700:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.802702:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc728c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x70c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802706:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc728c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x70c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802717:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc727e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802721:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc727e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802725:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc727e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802728:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.802730:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc727e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802734:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc727e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802740:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.802741:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.802744:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc727e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.802748:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc727e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999789.802754:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131cab800 reply state ffff8800933d1000 transno 4294986214 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999789.802759:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.803710:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+591:11419:x1800404480742656:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1679us (1854us total) trans 4294986214 rc 0/0 00000100:00100000:2.0:1716999789.803716:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45789 00000100:00100000:2.0:1716999789.804057:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.804094:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480742784 00000100:00100000:0.0:1716999789.804099:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480742784 00000100:00100000:0.0:1716999789.804119:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45790 00000100:00100000:0.0:1716999789.804125:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+591:11420:x1800404480742784:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.804151:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1716999789.804163:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963c900/0x6d188eabd8d7eab5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x706:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50285 expref: 591 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.804175:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215d8c0/0x6d188eabd8d762f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x706:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4d5d0 expref: 590 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.804183:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963d680/0x6d188eabd8d7eaa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x706:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5027e expref: 589 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.804193:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e52f40/0x6d188eabd8d719bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x706:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd5e expref: 588 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.804207:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x706:0x0].0x0 (ffff88012de9c900) 00010000:00010000:0.0:1716999789.804218:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2ac0/0x6d188eabd8dc6e87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66157 expref: 587 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.804230:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.804232:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.804245:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7293 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.804253:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7293 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.804259:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7293 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.804269:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc729a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x85ed7b8c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.804273:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc729a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.804278:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc729a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.804437:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc72a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x706:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.804444:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc72a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x706:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.804449:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc72a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x706:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:0.0:1716999789.804774:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x706:0x0] is inserted into orphan list, open count = 1 00000040:00080000:0.0:1716999789.804828:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11562, 184 off2067424 00010000:00010000:0.0:1716999789.805611:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc72a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x706:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805619:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc72a1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x706:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805623:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc72a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x706:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805628:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.805630:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc72a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x706:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805635:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc72a1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x706:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805643:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x706:0x0].0x0 (ffff88008a83f100) 00010000:00010000:0.0:1716999789.805645:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.805647:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc72a1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x706:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805651:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc72a1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x706:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805664:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7293 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805668:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7293 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805673:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7293 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805676:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.805677:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7293 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805684:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7293 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805689:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.805691:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.805692:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7293 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805696:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7293 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:0.0:1716999789.805702:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bc8700 reply state ffff88009ee19000 transno 4294986215 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc729a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.805707:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.805720:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.805747:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+588:11420:x1800404480742784:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1621us (1690us total) trans 4294986215 rc 0/0 00000100:00100000:0.0:1716999789.805753:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45790 00000100:00100000:0.0:1716999789.805771:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480742912 00000100:00100000:0.0:1716999789.805775:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480742912 00010000:00010000:1.0:1716999789.805788:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7285 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.805790:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45791 00010000:00010000:1.0:1716999789.805794:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7285 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.805794:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+588:11419:x1800404480742912:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999789.805798:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7285 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.805811:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.805813:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7285 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.805817:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7285 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.805823:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x862169a1 (ffff880088977000) 00010000:00010000:1.0:1716999789.805825:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.805825:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999789.805827:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7285 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.805831:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7285 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805834:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7cc0/0x6d188eabd8dc65e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc4f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e71 expref: 588 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.805843:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4240/0x6d188eabd8dc6588 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e4e expref: 586 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.805852:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4f:0x0].0x0 (ffff880091b4d100) 00010000:00010000:0.0:1716999789.805857:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.805867:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc72a8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805874:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc72a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805905:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc72a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805914:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc72af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805919:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc72af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805924:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc72af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805976:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc72b6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805981:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc72b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.805986:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc72b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:0.0:1716999789.806327:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0xc4f:0x0] is inserted into orphan list, open count = 1 00000040:00080000:0.0:1716999789.806356:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11563, 184 off2067608 00010000:00010000:0.0:1716999789.806403:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc72b6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806408:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc72b6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806413:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc72b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806417:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.806419:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc72b6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806424:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc72b6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806430:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4f:0x0].0x0 (ffff88008a83f200) 00010000:00010000:0.0:1716999789.806432:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.806434:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc72b6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806438:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc72b6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806447:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc72a8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806451:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc72a8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806455:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc72a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806459:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.806461:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc72a8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806468:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc72a8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806473:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999789.806474:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.806476:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc72a8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.806480:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc72a8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:0.0:1716999789.806487:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131cabb80 reply state ffff88009ee1f000 transno 4294986216 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc72af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.806491:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.806516:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+587:11419:x1800404480742912:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 720us (797us total) trans 4294986216 rc 0/0 00000100:00100000:0.0:1716999789.806522:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45791 00000100:00100000:3.0:1716999789.808659:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999789.808790:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc729a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.808798:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc729a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.808814:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc729a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.808818:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.808821:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc729a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.808827:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc729a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.808837:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x85ed7b8c (ffff88008a83f300) 00010000:00010000:2.0:1716999789.808839:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.808842:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc729a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.808847:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc729a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.808983:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480743040 00000100:00100000:0.0:1716999789.808990:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480743040 00000100:00100000:0.0:1716999789.809017:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45792 00000100:00100000:0.0:1716999789.809022:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+586:11420:x1800404480743040:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.809057:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999789.809071:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eaac0/0x6d188eabd8dc5693 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc41:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6593f expref: 586 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.809085:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9f80/0x6d188eabd8dc5662 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65923 expref: 585 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.809096:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc41:0x0].0x0 (ffff8800990eae00) 00010000:00010000:0.0:1716999789.809102:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.809120:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc72bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.809129:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc72bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.809135:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc72bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.809144:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc72c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.809150:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc72c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.809154:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc72c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.809237:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc72cb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.809243:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc72cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.809248:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc72cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.809441:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999789.809577:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc72af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.809583:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc72af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.809591:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc72af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.809596:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.809598:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc72af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.809606:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc72af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.809613:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x778ea4fb (ffff88008a83f500) 00010000:00010000:1.0:1716999789.809615:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.809617:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc72af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.809621:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc72af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.809767:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480743168 00000100:00100000:0.0:1716999789.809771:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480743168 00000004:00080000:1.0:1716999789.810672:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0xc41:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1716999789.810709:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11564, 184 off2067792 00010000:00010000:1.0:1716999789.810773:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc72cb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810779:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc72cb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810783:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc72cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810786:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.810788:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc72cb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810792:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc72cb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810814:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc41:0x0].0x0 (ffff88008a83fa00) 00010000:00010000:1.0:1716999789.810816:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.810819:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc72cb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810822:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc72cb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810835:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc72bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810839:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc72bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810843:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc72bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810846:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.810848:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc72bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810852:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc72bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810857:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.810858:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.810860:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc72bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.810863:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc72bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999789.810871:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca8000 reply state ffff88009ee1d000 transno 4294986217 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc72c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.810876:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.810936:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+586:11420:x1800404480743040:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1911us (2280us total) trans 4294986217 rc 0/0 00000100:00100000:1.0:1716999789.810942:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45792 00000100:00100000:2.0:1716999789.811162:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9194 00000100:00100000:2.0:1716999789.811168:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+585:11419:x1800404480743168:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:2.0:1716999789.811366:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986218 00000100:00100000:2.0:1716999789.811411:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+587:11419:x1800404480743168:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 243us (1971us total) trans 4294986219 rc 0/0 00000100:00100000:2.0:1716999789.811417:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9194 00000020:00080000:2.0:1716999789.811420:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1716999789.812993:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc72c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.813008:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc72c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.813012:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc72c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.813017:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.813021:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc72c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.813026:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc72c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.813035:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x86397a9e (ffff88008a83ff00) 00010000:00010000:0.0:1716999789.813038:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.813040:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc72c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.813045:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc72c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.814095:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.814346:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480743296 00000100:00100000:1.0:1716999789.814353:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480743296 00000100:00100000:1.0:1716999789.814558:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45793 00000100:00100000:1.0:1716999789.814564:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+586:11419:x1800404480743296:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999789.814599:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999789.814614:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d4480/0x6d188eabd8d7f3bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x710:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f505a3 expref: 586 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.814630:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb99f80/0x6d188eabd8d77fe7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x710:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4dfa8 expref: 585 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.814640:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468900/0x6d188eabd8d7f3ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x710:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5059c expref: 584 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.814651:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e53180/0x6d188eabd8d71cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x710:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bebc expref: 583 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.814659:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x710:0x0].0x0 (ffff88012de9c300) 00010000:00010000:1.0:1716999789.814665:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.814685:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc72d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.814694:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc72d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.814702:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc72d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.814710:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc72d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x554f0788 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.814715:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc72d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.814720:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc72d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.814799:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc72e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x710:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.814816:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc72e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x710:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.814821:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc72e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x710:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.815264:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000004:00080000:1.0:1716999789.815984:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x710:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1716999789.816023:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11565, 184 off2067976 00010000:00010000:1.0:1716999789.816090:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc72e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x710:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816096:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc72e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x710:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816100:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc72e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x710:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816104:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.816108:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc72e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x710:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816112:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc72e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x710:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816120:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x710:0x0].0x0 (ffff8800900d1200) 00010000:00010000:1.0:1716999789.816122:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.816124:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc72e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x710:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816128:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc72e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x710:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816140:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc72d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816144:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc72d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816148:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc72d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816152:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.816153:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc72d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816157:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc72d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816162:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.816163:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.816165:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc72d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.816171:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc72d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999789.816177:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca8700 reply state ffff88008e488000 transno 4294986220 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc72d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.816182:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.816242:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+584:11419:x1800404480743296:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1677us (2150us total) trans 4294986220 rc 0/0 00000100:00100000:1.0:1716999789.816249:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45793 00000100:00100000:2.0:1716999789.816562:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480743424 00000100:00100000:2.0:1716999789.816569:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480743424 00000100:00100000:2.0:1716999789.816599:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9195 00000100:00100000:2.0:1716999789.816605:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+584:11420:x1800404480743424:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999789.816840:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+585:11420:x1800404480743424:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 234us (1576us total) trans 4294986221 rc 0/0 00000100:00100000:2.0:1716999789.816846:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9195 00010000:00010000:1.0:1716999789.818874:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc72d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.818906:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc72d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.819252:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc72d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.819256:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.819260:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc72d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.819265:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc72d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.819277:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x554f0788 (ffff8800900d1a00) 00010000:00010000:1.0:1716999789.819279:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.819282:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc72d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.819286:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc72d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.821352:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.821392:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.821393:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480743552 00000100:00100000:0.0:1716999789.821403:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480743552 00000100:00100000:1.0:1716999789.821434:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480743680 00000100:00100000:1.0:1716999789.821437:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480743680 00000100:00100000:1.0:1716999789.821480:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45794 00000100:00100000:1.0:1716999789.821486:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+584:11420:x1800404480743680:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:0.0:1716999789.821571:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9196 00000100:00100000:0.0:1716999789.821575:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a25450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+585:11419:x1800404480743552:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:1.0:1716999789.821702:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999789.821720:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367180/0x6d188eabd8d808d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x727:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50c79 expref: 585 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.821736:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135418d80/0x6d188eabd8d780f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x727:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4e003 expref: 584 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.821746:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365680/0x6d188eabd8d808b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x727:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50c64 expref: 583 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.821757:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fb600/0x6d188eabd8d723a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x727:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1d3 expref: 582 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.821764:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x727:0x0].0x0 (ffff88012ecfaf00) 00010000:00010000:1.0:1716999789.821771:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.821869:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc72e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.821897:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc72e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.821906:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc72e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:0.0:1716999789.822283:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11566, 168 off2068144 00000001:00080000:0.0:1716999789.822288:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986222 00000100:00100000:0.0:1716999789.822372:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a25450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+583:11419:x1800404480743552:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 795us (1024us total) trans 4294986223 rc 0/0 00000100:00100000:0.0:1716999789.822382:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9196 00000020:00080000:0.0:1716999789.822386:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1716999789.822448:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc72ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0xd185bb5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822459:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc72ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822465:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc72ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822528:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc72f5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x727:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822534:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc72f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x727:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822538:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc72f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x727:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:1.0:1716999789.822820:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x727:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1716999789.822845:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11567, 184 off2068328 00010000:00010000:1.0:1716999789.822917:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc72f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x727:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822923:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc72f5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x727:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822928:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc72f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x727:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822933:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.822935:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc72f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x727:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822940:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc72f5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x727:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822948:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x727:0x0].0x0 (ffff8800900d1d00) 00010000:00010000:1.0:1716999789.822950:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.822953:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc72f5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x727:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822956:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc72f5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x727:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822967:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc72e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822971:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc72e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822975:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc72e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822978:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.822980:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc72e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822984:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc72e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822990:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.822992:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.822994:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc72e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.822998:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc72e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999789.823004:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131caa300 reply state ffff88009ceb9000 transno 4294986224 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc72ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.823009:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.823037:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+584:11420:x1800404480743680:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1551us (1644us total) trans 4294986224 rc 0/0 00000100:00100000:1.0:1716999789.823043:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45794 00000100:00100000:0.0:1716999789.825594:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.825639:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480743808 00000100:00100000:1.0:1716999789.825646:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480743808 00010000:00010000:2.0:1716999789.825677:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc72ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.825686:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc72ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.825687:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45795 00010000:00010000:2.0:1716999789.825691:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc72ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.825693:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+584:11419:x1800404480743808:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.825696:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b33c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.825699:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc72ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.825705:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc72ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.825715:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xd185bb5c (ffff8800900d1100) 00010000:00010000:2.0:1716999789.825717:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.825720:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc72ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.825725:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc72ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.825730:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999789.825742:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903cc0/0x6d188eabd8dc5a75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc44:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a65 expref: 583 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.825754:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901d40/0x6d188eabd8dc5a59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a57 expref: 582 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.826197:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc44:0x0].0x0 (ffff880135ac4400) 00010000:00010000:1.0:1716999789.826646:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.826665:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc72fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.826675:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc72fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.826682:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc72fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.826691:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7303 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.826695:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.826700:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.826775:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc730a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.826780:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc730a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.826785:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc730a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:1.0:1716999789.827189:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1497, 64 off104064 00000040:00080000:1.0:1716999789.827207:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11568, 184 off2068512 00010000:00010000:1.0:1716999789.827256:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7311 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827263:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7311 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827269:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7311 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827274:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7311 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827278:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7311 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827281:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7311 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827286:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7311 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827290:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3840 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999789.827293:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7311 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827298:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7311 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827305:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc44:0x0].0x0 (ffff8800900d1700) 00010000:00010000:1.0:1716999789.827307:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999789.827309:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7311 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827313:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7311 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827330:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc730a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827335:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc730a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827339:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc730a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827343:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.827346:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc730a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827351:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc730a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827356:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc44:0x0].0x0 (ffff8800900d1700) 00010000:00010000:1.0:1716999789.827357:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.827359:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc730a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827362:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc730a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827395:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc72fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827400:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc72fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827404:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc72fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827408:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.827410:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc72fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827414:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc72fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827419:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.827421:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.827422:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc72fc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.827426:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc72fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999789.827432:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b3b80 reply state ffff88009ceba000 transno 4294986225 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.827437:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.827500:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+583:11419:x1800404480743808:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1804us (1910us total) trans 4294986225 rc 0/0 00000100:00100000:1.0:1716999789.827507:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45795 00000100:00100000:3.0:1716999789.829321:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.830015:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480743936 00000100:00100000:0.0:1716999789.830022:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480743936 00000100:00100000:0.0:1716999789.830063:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9197 00000100:00100000:0.0:1716999789.830069:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+583:11420:x1800404480743936:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999789.830384:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+584:11420:x1800404480743936:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 314us (1065us total) trans 4294986226 rc 0/0 00000100:00100000:0.0:1716999789.830390:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9197 00010000:00010000:1.0:1716999789.830928:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.830936:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7303 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.830942:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.830946:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.830949:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.830955:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7303 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.830966:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x60b23c20 (ffff8800900d1600) 00010000:00010000:1.0:1716999789.830969:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.830972:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7303 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.830976:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7303 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.831316:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.832840:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480744064 00000100:00100000:2.0:1716999789.832846:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480744064 00000100:00100000:2.0:1716999789.833097:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9198 00000100:00100000:2.0:1716999789.833104:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+583:11419:x1800404480744064:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999789.834029:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+584:11419:x1800404480744064:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 923us (2711us total) trans 4294986227 rc 0/0 00000100:00100000:2.0:1716999789.834036:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9198 00000100:00100000:2.0:1716999789.834716:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.834977:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480744192 00000100:00100000:0.0:1716999789.834984:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480744192 00000100:00100000:0.0:1716999789.835312:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45796 00000100:00100000:0.0:1716999789.835317:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+584:11420:x1800404480744192:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.835348:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.835365:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133141440/0x6d188eabd8d7f6af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x712:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50683 expref: 584 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.835956:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d680/0x6d188eabd8d77def lrc: 0/0,0 mode: --/CW res: [0x200000401:0x712:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4df1c expref: 583 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.835968:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8d7f63f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x712:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50660 expref: 582 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.835977:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fb3c0/0x6d188eabd8d71d7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x712:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf02 expref: 581 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.835985:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x712:0x0].0x0 (ffff8800a6ad7200) 00010000:00010000:0.0:1716999789.835991:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.836013:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7318 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836022:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7318 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836028:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7318 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836037:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc731f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x853e0f88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836041:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc731f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836045:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc731f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836113:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7326 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x712:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836117:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x712:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836122:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x712:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:0.0:1716999789.836416:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x712:0x0] is inserted into orphan list, open count = 1 00000040:00080000:0.0:1716999789.836450:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11569, 184 off2068696 00010000:00010000:0.0:1716999789.836503:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7326 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x712:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836508:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7326 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x712:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836513:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7326 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x712:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836517:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.836520:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7326 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x712:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836525:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7326 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x712:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836531:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x712:0x0].0x0 (ffff88008a83f700) 00010000:00010000:0.0:1716999789.836533:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.836534:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7326 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x712:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836538:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7326 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x712:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836549:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7318 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836553:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7318 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836557:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7318 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836560:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.836562:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7318 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836569:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7318 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836573:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.836575:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.836576:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7318 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.836580:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7318 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:0.0:1716999789.836586:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bc8e00 reply state ffff88009ee1e000 transno 4294986228 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc731f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.836591:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.836648:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+582:11420:x1800404480744192:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1329us (1931us total) trans 4294986228 rc 0/0 00000100:00100000:0.0:1716999789.836653:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45796 00000100:00100000:0.0:1716999789.837094:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.837161:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480744320 00000100:00100000:2.0:1716999789.837165:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480744320 00000100:00100000:2.0:1716999789.837193:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45797 00000100:00100000:2.0:1716999789.837198:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+582:11419:x1800404480744320:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.837219:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.837229:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d5200/0x6d188eabd8d7fb63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x718:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f507f6 expref: 582 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.837240:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091332d00/0x6d188eabd8d78011 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x718:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4dfb6 expref: 581 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.837251:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133141680/0x6d188eabd8d7fb0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x718:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f507e8 expref: 580 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.837259:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419c240/0x6d188eabd8d71f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x718:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfd4 expref: 579 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.837265:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x718:0x0].0x0 (ffff8800908c6200) 00010000:00010000:2.0:1716999789.837269:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.837279:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc732d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837286:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc732d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837291:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc732d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837297:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7334 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x863e1088 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837301:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837305:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837349:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc733b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x718:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837354:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc733b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x718:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837362:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc733b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x718:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:2.0:1716999789.837627:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x718:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.837653:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11570, 184 off2068880 00010000:00010000:2.0:1716999789.837699:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc733b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x718:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837704:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc733b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x718:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837708:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc733b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x718:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837712:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.837714:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc733b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x718:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837718:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc733b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x718:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837725:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x718:0x0].0x0 (ffff880088977300) 00010000:00010000:2.0:1716999789.837726:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.837729:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc733b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x718:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837732:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc733b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x718:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837741:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc732d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837745:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc732d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837749:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc732d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837752:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.837753:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc732d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837757:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc732d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837762:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.837764:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.837766:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc732d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.837769:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc732d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999789.837775:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b0000 reply state ffff8800933d4000 transno 4294986229 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999789.837779:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.840239:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+580:11419:x1800404480744320:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3032us (3137us total) trans 4294986229 rc 0/0 00000100:00100000:2.0:1716999789.840248:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45797 00010000:00010000:2.0:1716999789.841088:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc731f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.841096:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc731f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.841101:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc731f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.841106:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.841109:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc731f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.841114:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc731f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.841125:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x853e0f88 (ffff88008a83f400) 00010000:00010000:2.0:1716999789.841127:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.841129:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc731f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.841133:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc731f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.841222:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.841263:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480744448 00000100:00100000:3.0:1716999789.841269:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480744448 00000100:00100000:3.0:1716999789.841293:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9199 00000100:00100000:3.0:1716999789.841308:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480744448:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999789.841543:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11571, 168 off2069048 00000100:00100000:3.0:1716999789.841635:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+580:11420:x1800404480744448:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 326us (412us total) trans 4294986230 rc 0/0 00000100:00100000:3.0:1716999789.841641:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9199 00000100:00100000:0.0:1716999789.845422:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.845449:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999789.845643:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.845653:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7334 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.845659:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7334 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.845664:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.845667:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7334 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.845672:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7334 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.845684:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x863e1088 (ffff880088977100) 00010000:00010000:2.0:1716999789.845688:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.845691:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7334 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.845695:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7334 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.846169:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480744704 00000100:00100000:3.0:1716999789.846176:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480744704 00000100:00100000:0.0:1716999789.846182:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480744576 00000100:00100000:0.0:1716999789.846184:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480744576 00000100:00100000:3.0:1716999789.846212:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45798 00000100:00100000:0.0:1716999789.846212:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9200 00000100:00100000:3.0:1716999789.846218:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+580:11419:x1800404480744704:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:0.0:1716999789.846218:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+580:11420:x1800404480744576:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:3.0:1716999789.846252:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1716999789.846265:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364b40/0x6d188eabd8dc5527 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc3f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658c1 expref: 580 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.846278:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c95440/0x6d188eabd8dc54ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658a5 expref: 579 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.846285:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3f:0x0].0x0 (ffff8800939ba700) 00010000:00010000:3.0:1716999789.846290:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.846305:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7342 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846315:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7342 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846321:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7342 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846329:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7349 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846333:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846338:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.846383:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480744576:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 164us (965us total) trans 4294986231 rc 0/0 00000100:00100000:0.0:1716999789.846389:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9200 00010000:00010000:3.0:1716999789.846407:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7350 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846413:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846417:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:3.0:1716999789.846786:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0xc3f:0x0] is inserted into orphan list, open count = 1 00000040:00080000:3.0:1716999789.846835:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11572, 184 off2069232 00010000:00010000:3.0:1716999789.846909:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7350 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846915:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7350 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846919:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7350 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846923:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.846926:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7350 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846930:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7350 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846937:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3f:0x0].0x0 (ffff8800a5c6e200) 00010000:00010000:3.0:1716999789.846939:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.846942:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7350 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846946:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7350 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846957:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7342 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846961:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7342 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846965:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7342 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846968:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.846970:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7342 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846974:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7342 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846979:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.846980:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.846982:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7342 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.846986:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7342 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:3.0:1716999789.846991:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b2a00 reply state ffff8800941d9000 transno 4294986232 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.846996:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.847037:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+580:11419:x1800404480744704:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 818us (1585us total) trans 4294986232 rc 0/0 00000100:00100000:3.0:1716999789.847042:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45798 00010000:00010000:2.0:1716999789.848162:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7349 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.848169:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7349 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.848174:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7349 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.848177:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.848180:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7349 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.848184:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7349 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.848192:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x86397a9e (ffff8800a5c6e100) 00010000:00010000:2.0:1716999789.848195:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.848197:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7349 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.848201:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7349 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x86397a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.851240:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.851291:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.851369:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480744832 00000100:00100000:2.0:1716999789.851377:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480744832 00000100:00100000:2.0:1716999789.851422:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9201 00000100:00100000:2.0:1716999789.851428:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+579:11419:x1800404480744832:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:2.0:1716999789.852112:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986233 00000100:00100000:2.0:1716999789.852190:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+581:11419:x1800404480744832:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 761us (955us total) trans 4294986234 rc 0/0 00000100:00100000:2.0:1716999789.852197:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9201 00000020:00080000:2.0:1716999789.852201:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999789.852352:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480744960 00000100:00100000:3.0:1716999789.852357:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480744960 00000100:00100000:3.0:1716999789.852376:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45799 00000100:00100000:3.0:1716999789.852381:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+581:11420:x1800404480744960:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999789.852404:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999789.852420:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8d8aada lrc: 0/0,0 mode: --/CW res: [0x200000401:0x72d:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f53c37 expref: 581 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.852435:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905d9f80/0x6d188eabd8d8102b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72d:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50ed3 expref: 580 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.852451:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8d80f98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50ea9 expref: 579 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.852459:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c3840/0x6d188eabd8d72588 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c2b3 expref: 578 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.852467:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72d:0x0].0x0 (ffff8800939baf00) 00010000:00010000:3.0:1716999789.852474:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.852490:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7357 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.852498:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7357 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.852505:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7357 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.852516:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc735e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x86398c8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.852520:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc735e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.852525:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc735e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.852589:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7365 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x72d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.852595:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7365 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.852600:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7365 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:3.0:1716999789.852956:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1498, 64 off104128 00000040:00080000:3.0:1716999789.852973:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11573, 184 off2069416 00010000:00010000:3.0:1716999789.853014:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc736c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x72d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853021:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc736c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853027:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc736c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853033:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc736c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x72d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853038:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc736c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x72d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853046:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc736c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x72d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853051:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc736c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x72d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853055:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999789.853058:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc736c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x72d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853063:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc736c lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x72d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853068:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72d:0x0].0x0 (ffff8800a5c6ec00) 00010000:00010000:3.0:1716999789.853070:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999789.853073:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc736c lrc: 3/0,0 mode: --/PW res: [0x200000401:0x72d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853077:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc736c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x72d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853089:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7365 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853094:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7365 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x72d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853098:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7365 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853102:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.853104:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7365 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853111:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7365 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x72d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853116:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72d:0x0].0x0 (ffff8800a5c6ec00) 00010000:00010000:3.0:1716999789.853117:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.853119:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7365 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x72d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853123:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7365 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x72d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853155:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7357 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853160:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7357 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853164:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7357 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853168:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.853170:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7357 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853173:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7357 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853178:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.853180:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.853182:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7357 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.853186:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7357 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:3.0:1716999789.853191:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b2680 reply state ffff88009a7be000 transno 4294986235 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc735e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.853196:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.855184:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480744960:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2796us (3886us total) trans 4294986235 rc 0/0 00000100:00100000:3.0:1716999789.855192:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45799 00000100:00100000:1.0:1716999789.855221:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.855235:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480745088 00000100:00100000:3.0:1716999789.855240:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480745088 00000100:00100000:3.0:1716999789.855267:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45800 00000100:00100000:3.0:1716999789.855272:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+579:11419:x1800404480745088:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999789.855308:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999789.855326:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963e880/0x6d188eabd8d7ed8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x709:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50373 expref: 579 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.855340:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091331680/0x6d188eabd8d766f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x709:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4d74a expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.855356:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8d7ed1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x709:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50350 expref: 577 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.855371:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8d440/0x6d188eabd8d71a7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x709:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdab expref: 576 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.855378:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x709:0x0].0x0 (ffff88012bacd300) 00010000:00010000:3.0:1716999789.855384:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.855402:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7373 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.855411:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7373 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.855418:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7373 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.855427:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc737a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x85ed9198 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.855432:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc737a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.855437:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc737a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.855507:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7381 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x709:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.855519:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7381 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x709:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.855524:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7381 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x709:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:3.0:1716999789.856490:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x709:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1716999789.856789:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc735e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.856799:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc735e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.856812:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc735e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.856817:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.856820:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc735e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.856825:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc735e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.856835:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x86398c8e (ffff8800a5c6e700) 00010000:00010000:2.0:1716999789.856837:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.856840:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc735e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.856844:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc735e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x86398c8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000040:00080000:3.0:1716999789.856852:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11574, 184 off2069600 00010000:00010000:3.0:1716999789.856931:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7381 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x709:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.856942:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7381 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x709:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.856947:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7381 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x709:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.856951:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.856953:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7381 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x709:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.856958:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7381 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x709:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.856965:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x709:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999789.856967:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.856969:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7381 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x709:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.856973:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7381 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x709:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.856983:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7373 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.856987:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7373 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.856991:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7373 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.856995:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.856997:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7373 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.857001:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7373 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.857007:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.857009:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.857011:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7373 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.857014:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7373 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:3.0:1716999789.857020:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009155b800 reply state ffff88009a7ba000 transno 4294986236 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc737a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.857026:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.857078:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480745088:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1803us (1855us total) trans 4294986236 rc 0/0 00000100:00100000:3.0:1716999789.857268:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45800 00000100:00100000:2.0:1716999789.859600:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.859641:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999789.859698:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc737a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.859710:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc737a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.859716:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc737a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.859720:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.859724:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc737a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.859730:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc737a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.859740:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x85ed9198 (ffff8800a5c6ea00) 00010000:00010000:0.0:1716999789.859742:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.859745:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc737a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.859749:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc737a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.859825:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480745216 00000100:00100000:1.0:1716999789.859832:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480745216 00000100:00100000:1.0:1716999789.859854:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480745344 00000100:00100000:1.0:1716999789.859856:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480745344 00000100:00100000:1.0:1716999789.859868:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9202 00000100:00100000:1.0:1716999789.859874:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a25050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+576:11420:x1800404480745216:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.860204:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a25050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+577:11420:x1800404480745216:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 330us (609us total) trans 4294986237 rc 0/0 00000100:00100000:1.0:1716999789.860213:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9202 00000100:00100000:1.0:1716999789.860245:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9203 00000100:00100000:1.0:1716999789.860254:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480745344:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999789.860443:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11575, 168 off2069768 00000001:00080000:1.0:1716999789.860453:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986238 00000100:00100000:1.0:1716999789.860496:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+578:11419:x1800404480745344:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 240us (855us total) trans 4294986239 rc 0/0 00000100:00100000:1.0:1716999789.860501:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9203 00000020:00080000:1.0:1716999789.860504:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.863352:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.863399:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.863454:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480745600 00000100:00100000:2.0:1716999789.863461:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480745600 00000100:00100000:3.0:1716999789.863479:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480745472 00000100:00100000:3.0:1716999789.863483:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480745472 00000100:00100000:2.0:1716999789.863501:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45801 00000100:00100000:2.0:1716999789.863508:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+579:11420:x1800404480745600:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.863550:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.863568:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5440/0x6d188eabd8d804c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x723:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50b22 expref: 579 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.863593:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb9a880/0x6d188eabd8d780a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x723:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4dfe7 expref: 578 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.863603:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6469200/0x6d188eabd8d8049a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x723:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50b1b expref: 577 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.863613:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e52ac0/0x6d188eabd8d7225c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x723:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c147 expref: 576 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.863622:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x723:0x0].0x0 (ffff8800a6ad7500) 00010000:00010000:2.0:1716999789.863628:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.863646:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7388 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.863656:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7388 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.863662:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7388 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.863671:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc738f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0xe385a24b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.863678:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc738f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.863682:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc738f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999789.863699:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45802 00000100:00100000:3.0:1716999789.863704:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480745472:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999789.863721:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1716999789.863732:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdcb40/0x6d188eabd8dc6534 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e24 expref: 575 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.863756:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7396 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x723:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.863762:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7396 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x723:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.863767:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7396 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x723:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.863999:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb5200/0x6d188eabd8dc640e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc4d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dc9 expref: 574 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.864008:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4d:0x0].0x0 (ffff880135ac4200) 00010000:00010000:3.0:1716999789.864013:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.864024:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc739d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864030:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc739d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864038:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc739d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864045:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc73a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864050:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc73a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864054:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc73a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864103:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc73ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864108:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc73ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864113:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc73ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:3.0:1716999789.864434:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1500, 64 off104256 00000040:00080000:3.0:1716999789.864452:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11576, 184 off2069952 00000004:00080000:2.0:1716999789.864481:0:6823:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x723:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1716999789.864501:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc73b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864508:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc73b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864514:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc73b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864519:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc73b2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864527:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc73b2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864531:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc73b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864536:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc73b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864541:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999789.864543:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc73b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864549:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc73b2 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864555:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4d:0x0].0x0 (ffff8800a5c6eb00) 00010000:00010000:3.0:1716999789.864557:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999789.864559:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc73b2 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864563:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc73b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864579:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc73ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864583:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc73ab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864587:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc73ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864591:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.864593:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc73ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864597:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc73ab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864603:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4d:0x0].0x0 (ffff8800a5c6eb00) 00010000:00010000:3.0:1716999789.864604:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.864606:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc73ab lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864610:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc73ab lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864642:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc739d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864647:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc739d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864652:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc739d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864655:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.864657:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc739d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864662:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc739d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864667:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.864669:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.864671:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc739d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.864678:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc739d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:3.0:1716999789.864683:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b1880 reply state ffff88009a7bb000 transno 4294986240 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc73a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999789.864688:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.864729:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480745472:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1024us (1329us total) trans 4294986240 rc 0/0 00000100:00100000:3.0:1716999789.864736:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45802 00000040:00080000:2.0:1716999789.865114:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11577, 184 off2070136 00010000:00010000:2.0:1716999789.865164:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7396 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x723:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865170:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7396 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x723:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865175:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7396 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x723:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865179:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.865181:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7396 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x723:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865185:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7396 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x723:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865192:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x723:0x0].0x0 (ffff880088977900) 00010000:00010000:2.0:1716999789.865195:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.865197:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7396 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x723:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865201:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7396 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x723:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865211:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7388 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865216:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7388 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865221:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7388 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865225:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.865227:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7388 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865232:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7388 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865237:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.865238:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.865240:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7388 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.865244:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7388 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999789.865250:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b0380 reply state ffff8800933d0000 transno 4294986241 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc738f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.865255:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.865277:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+576:11420:x1800404480745600:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1769us (1931us total) trans 4294986241 rc 0/0 00000100:00100000:2.0:1716999789.865283:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45801 00010000:00010000:3.0:1716999789.867004:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc73a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.867012:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc73a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.867017:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc73a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.867021:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.867024:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc73a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.867029:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc73a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.867037:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc738f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.867038:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xc88ea4fb (ffff8800a5c6e100) 00010000:00010000:3.0:1716999789.867041:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.867043:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc73a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.867044:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc738f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.867048:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc73a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.867054:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc738f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.867058:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.867060:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc738f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.867065:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc738f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.867072:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xe385a24b (ffff880088977700) 00010000:00010000:0.0:1716999789.867074:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.867077:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc738f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.867081:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc738f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.870229:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.870275:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.870335:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480745856 00000100:00100000:0.0:1716999789.870346:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480745856 00000100:00100000:0.0:1716999789.870387:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45803 00000100:00100000:0.0:1716999789.870394:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11420:x1800404480745856:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.870443:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1716999789.870460:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc6c81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc56:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660b6 expref: 574 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.870475:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc6c49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc56:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6609a expref: 573 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.870483:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc56:0x0].0x0 (ffff880088977800) 00010000:00010000:0.0:1716999789.870490:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.870510:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc73b9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.870520:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc73b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.870527:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc73b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.870537:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc73c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.870543:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc73c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.870547:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc73c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.870624:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc73c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.870629:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc73c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.870634:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc73c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999789.870676:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480745792 00000100:00100000:3.0:1716999789.870680:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480745792 00000100:00100000:3.0:1716999789.870709:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9204 00000100:00100000:3.0:1716999789.870714:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+573:11419:x1800404480745792:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999789.871433:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480745792:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 717us (1209us total) trans 4294986242 rc 0/0 00000100:00100000:3.0:1716999789.871439:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9204 00000100:00100000:2.0:1716999789.873286:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.873442:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480745984 00000100:00100000:3.0:1716999789.873447:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480745984 00000100:00100000:3.0:1716999789.873479:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9205 00000100:00100000:3.0:1716999789.873485:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480745984:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999789.873514:0:6823:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0xc56:0x0] is inserted into orphan list, open count = 1 00000040:00080000:0.0:1716999789.873556:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11578, 184 off2070320 00010000:00010000:0.0:1716999789.873618:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc73c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.873625:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc73c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00000040:00080000:3.0:1716999789.873633:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11579, 168 off2070488 00010000:00010000:0.0:1716999789.873634:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc73c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.873639:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.873642:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc73c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.873648:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc73c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.873658:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc56:0x0].0x0 (ffff88008a83f700) 00010000:00010000:0.0:1716999789.873660:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.873663:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc73c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.873667:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc73c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc56:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.873680:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc73b9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.873685:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc73b9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.873689:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc73b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.873692:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.873694:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc73b9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.873697:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc73b9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.873705:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00000100:00100000:3.0:1716999789.873706:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480745984:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 220us (422us total) trans 4294986244 rc 0/0 00010000:00010000:0.0:1716999789.873707:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.873709:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc73b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999789.873712:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9205 00010000:00010000:0.0:1716999789.873713:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc73b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999789.873718:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012b7f5c00 reply state ffff880091865000 transno 4294986243 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc73c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999789.873722:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.873748:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+576:11420:x1800404480745856:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3354us (3472us total) trans 4294986243 rc 0/0 00000100:00100000:0.0:1716999789.873754:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45803 00000100:00100000:0.0:1716999789.876661:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.876680:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480746112 00000100:00100000:0.0:1716999789.876685:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480746112 00000100:00100000:0.0:1716999789.876726:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45804 00000100:00100000:0.0:1716999789.876732:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+576:11419:x1800404480746112:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.876773:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.876797:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905d8d80/0x6d188eabd8d80c42 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72a:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50db4 expref: 576 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.876824:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb98480/0x6d188eabd8d791c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x72a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4e5a5 expref: 575 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.876837:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366d00/0x6d188eabd8d80be0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72a:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50d83 expref: 574 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.876855:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903600/0x6d188eabd8d72477 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c23c expref: 573 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.876863:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72a:0x0].0x0 (ffff880131c40c00) 00010000:00010000:0.0:1716999789.876870:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.876922:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc73ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.876932:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc73ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.876939:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc73ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.876947:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc73d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0xa149fd88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.876951:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc73d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.876955:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc73d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877030:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc73dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x72a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877041:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc73dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877046:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc73dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:0.0:1716999789.877401:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1501, 64 off104320 00000040:00080000:0.0:1716999789.877418:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11580, 184 off2070672 00010000:00010000:0.0:1716999789.877468:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc73e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x72a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877475:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc73e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877481:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc73e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877486:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc73e3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x72a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877491:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc73e3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x72a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877495:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc73e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x72a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877499:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc73e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x72a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877503:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999789.877506:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc73e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x72a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877511:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc73e3 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x72a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877516:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72a:0x0].0x0 (ffff88008a83f600) 00010000:00010000:0.0:1716999789.877518:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999789.877520:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc73e3 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x72a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877524:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc73e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x72a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877541:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc73dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877545:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc73dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x72a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877550:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc73dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877553:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.877555:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc73dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877559:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc73dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x72a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877564:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72a:0x0].0x0 (ffff88008a83f600) 00010000:00010000:0.0:1716999789.877565:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.877568:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc73dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x72a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877572:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc73dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x72a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877606:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc73ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877610:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc73ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877614:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc73ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877618:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.877620:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc73ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877624:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc73ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877630:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:0.0:1716999789.877631:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.877633:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc73ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999789.877637:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc73ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999789.877643:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b1c00 reply state ffff880091867000 transno 4294986245 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc73d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999789.877649:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.877708:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+574:11419:x1800404480746112:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 975us (1052us total) trans 4294986245 rc 0/0 00000100:00100000:0.0:1716999789.877714:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45804 00000100:00100000:0.0:1716999789.878571:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999789.878701:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc73c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.878707:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc73c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.878712:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc73c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.878716:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.878719:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc73c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.878726:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc73c0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.878734:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6c9b575e (ffff88008a83f400) 00010000:00010000:3.0:1716999789.878736:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.878738:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc73c0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.878742:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc73c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.878845:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480746240 00000100:00100000:2.0:1716999789.878851:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480746240 00000100:00100000:2.0:1716999789.878897:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9206 00000100:00100000:2.0:1716999789.878903:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+573:11420:x1800404480746240:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:2.0:1716999789.879151:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986246 00000100:00100000:2.0:1716999789.879211:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+575:11420:x1800404480746240:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 308us (641us total) trans 4294986247 rc 0/0 00000100:00100000:2.0:1716999789.879217:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9206 00000020:00080000:2.0:1716999789.879220:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.881203:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.881266:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480746368 00000100:00100000:1.0:1716999789.881272:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480746368 00000100:00100000:1.0:1716999789.881304:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9207 00000100:00100000:1.0:1716999789.881309:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480746368:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:2.0:1716999789.881425:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc73d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.881433:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc73d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.881438:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc73d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.881443:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.881447:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc73d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.881452:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc73d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.881465:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xa149fd88 (ffff88008a83f200) 00010000:00010000:2.0:1716999789.881467:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.881470:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc73d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.881474:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc73d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999789.881589:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480746368:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 279us (390us total) trans 4294986248 rc 0/0 00000100:00100000:1.0:1716999789.881595:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9207 00000100:00100000:0.0:1716999789.884241:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.884455:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480746496 00000100:00100000:2.0:1716999789.884461:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480746496 00000100:00100000:2.0:1716999789.884499:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45805 00000100:00100000:2.0:1716999789.884505:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+575:11419:x1800404480746496:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.884544:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.884562:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133143a80/0x6d188eabd8d7f956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x716:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5074e expref: 575 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.884578:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646ad00/0x6d188eabd8d77ffc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x716:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4dfaf expref: 574 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.884590:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8d7f933 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x716:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50740 expref: 573 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.884598:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9200/0x6d188eabd8d71e8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x716:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf8e expref: 572 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.884605:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x716:0x0].0x0 (ffff8800a6ad7600) 00010000:00010000:2.0:1716999789.884611:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.884629:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc73ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.884639:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc73ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.884646:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc73ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.884655:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc73f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x863e0f88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.884659:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc73f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.884664:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc73f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.884735:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc73f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x716:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.884741:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc73f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x716:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.884746:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc73f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x716:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999789.885673:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.885986:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480746624 00000100:00100000:0.0:1716999789.885991:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480746624 00000100:00100000:0.0:1716999789.886015:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45806 00000100:00100000:0.0:1716999789.886020:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+572:11420:x1800404480746624:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999789.886040:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999789.886052:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c574d80/0x6d188eabd8d7ef2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x70b:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50414 expref: 572 pid: 6822 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1716999789.886057:0:6823:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x716:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1716999789.886069:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091330d80/0x6d188eabd8d768c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x70b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4d7dd expref: 571 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.886082:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419cfc0/0x6d188eabd8d7ef0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50406 expref: 570 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999789.886091:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8cb40/0x6d188eabd8d71b16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdf1 expref: 569 pid: 6822 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1716999789.886097:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11581, 184 off2070856 00010000:00010000:0.0:1716999789.886097:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70b:0x0].0x0 (ffff880129eed800) 00010000:00010000:0.0:1716999789.886103:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999789.886115:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc73ff lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886122:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc73ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886128:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc73ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886137:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7406 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x862169a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886147:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7406 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886152:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7406 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.886155:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc73f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x716:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886161:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc73f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x716:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886166:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc73f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x716:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886174:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918306c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.886177:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc73f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x716:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886182:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc73f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x716:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886189:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x716:0x0].0x0 (ffff880088977f00) 00010000:00010000:2.0:1716999789.886191:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.886194:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc73f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x716:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886197:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc73f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x716:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886207:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc73ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886211:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc73ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886215:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc73ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886218:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.886220:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc73ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886224:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc73ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886229:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.886231:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.886233:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc73ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.886237:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc73ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999789.886243:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b2300 reply state ffff880089077000 transno 4294986249 ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc73f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.886248:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.886306:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480746496:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1799us (2070us total) trans 4294986249 rc 0/0 00010000:00010000:0.0:1716999789.886308:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc740d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x70b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999789.886312:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45805 00010000:00010000:0.0:1716999789.886317:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc740d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886323:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc740d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:0.0:1716999789.886685:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x70b:0x0] is inserted into orphan list, open count = 1 00000040:00080000:0.0:1716999789.886709:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11582, 184 off2071040 00010000:00010000:0.0:1716999789.886757:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc740d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886763:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc740d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x70b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886768:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc740d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886772:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.886774:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc740d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886778:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc740d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x70b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886785:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70b:0x0].0x0 (ffff88008a83f100) 00010000:00010000:0.0:1716999789.886787:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999789.886789:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc740d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x70b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886794:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc740d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x70b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886813:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc73ff lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886818:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc73ff lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886822:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc73ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886827:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999789.886828:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc73ff lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886832:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc73ff lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886837:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999789.886839:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999789.886841:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc73ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999789.886845:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc73ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:0.0:1716999789.886852:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880091558a80 reply state ffff880091863000 transno 4294986250 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7406 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999789.886857:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999789.886920:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+571:11420:x1800404480746624:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 890us (1240us total) trans 4294986250 rc 0/0 00000100:00100000:0.0:1716999789.886926:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45806 00010000:00010000:3.0:1716999789.889938:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc73f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.889950:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc73f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.889956:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc73f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.889960:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832880 already unused, calling callback (ffffffffa1389790) 00000100:00100000:0.0:1716999789.889962:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999789.889964:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc73f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.889970:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc73f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.889981:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x863e0f88 (ffff880088977600) 00010000:00010000:3.0:1716999789.889983:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.889986:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc73f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.889990:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc73f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.890017:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7406 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.890112:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7406 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.890118:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7406 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.890122:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.890124:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7406 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.890128:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7406 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.890130:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480746752 00010000:00010000:3.0:1716999789.890134:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x862169a0 (ffff88008a83f300) 00010000:00010000:3.0:1716999789.890136:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1716999789.890137:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480746752 00010000:00010000:3.0:1716999789.890138:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7406 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.890142:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7406 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x862169a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.890162:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9208 00000100:00100000:1.0:1716999789.890168:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480746752:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.890478:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+570:11419:x1800404480746752:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 309us (518us total) trans 4294986251 rc 0/0 00000100:00100000:1.0:1716999789.890485:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9208 00000100:00100000:0.0:1716999789.891420:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.892153:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480746880 00000100:00100000:1.0:1716999789.892159:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480746880 00000100:00100000:1.0:1716999789.892198:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9209 00000100:00100000:1.0:1716999789.892205:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+570:11420:x1800404480746880:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.893912:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+571:11420:x1800404480746880:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1701us (2487us total) trans 4294986252 rc 0/0 00000100:00100000:1.0:1716999789.893921:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9209 00000100:00100000:0.0:1716999789.894411:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.895486:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480747008 00000100:00100000:1.0:1716999789.895494:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480747008 00000100:00100000:1.0:1716999789.895533:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45807 00000100:00100000:1.0:1716999789.895538:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+571:11419:x1800404480747008:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999789.895585:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999789.895604:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091365200/0x6d188eabd8d803f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x722:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50ae3 expref: 571 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.895623:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468480/0x6d188eabd8d77f70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x722:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4df85 expref: 570 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.895634:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6f40/0x6d188eabd8d803c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x722:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50ace expref: 569 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.895644:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419e880/0x6d188eabd8d7220f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x722:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c124 expref: 568 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.895652:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x722:0x0].0x0 (ffff880094025f00) 00010000:00010000:1.0:1716999789.895659:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.895679:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7414 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.895689:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7414 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.895696:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7414 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.895705:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc741b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0xe385a24b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.895710:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc741b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.895715:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc741b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.895789:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7422 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x722:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.895794:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7422 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x722:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.895809:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7422 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x722:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:1.0:1716999789.896984:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x722:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1716999789.897023:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11583, 184 off2071224 00010000:00010000:1.0:1716999789.897086:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7422 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x722:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897092:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7422 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x722:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897098:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7422 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x722:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897102:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.897105:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7422 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x722:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897111:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7422 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x722:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897119:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x722:0x0].0x0 (ffff8800900d1b00) 00010000:00010000:1.0:1716999789.897121:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.897124:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7422 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x722:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897127:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7422 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x722:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897138:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7414 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897142:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7414 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897146:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7414 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897149:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.897151:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7414 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897155:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7414 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897161:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.897162:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.897165:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7414 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.897169:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7414 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999789.897174:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b0700 reply state ffff88008f84e000 transno 4294986253 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc741b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.897179:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.897244:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480747008:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1704us (2832us total) trans 4294986253 rc 0/0 00000100:00100000:1.0:1716999789.897251:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45807 00000100:00100000:0.0:1716999789.899103:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.899553:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480747136 00000100:00100000:1.0:1716999789.899561:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480747136 00000100:00100000:1.0:1716999789.899600:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45808 00000100:00100000:1.0:1716999789.899606:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480747136:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999789.899642:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999789.899659:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331418c0/0x6d188eabd8d80128 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x71f:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f509ee expref: 569 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.899674:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c900/0x6d188eabd8d7764e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x71f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4dc67 expref: 568 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.899826:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc741b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.899834:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc741b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.899839:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc741b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.899846:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.899849:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc741b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.899859:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc741b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.899870:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xe385a24b (ffff8800900d1e00) 00010000:00010000:3.0:1716999789.899872:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.899875:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc741b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.899904:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc741b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xe385a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900105:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133140b40/0x6d188eabd8d80105 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f509e0 expref: 566 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.900116:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419f600/0x6d188eabd8d72128 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0bb expref: 565 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.900130:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71f:0x0].0x0 (ffff880094025b00) 00010000:00010000:1.0:1716999789.900135:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.900155:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7429 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900165:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7429 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900171:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7429 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900181:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7430 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x2f856f5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900185:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7430 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900190:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7430 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900264:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7437 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x71f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900269:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7437 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900274:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7437 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:1.0:1716999789.900588:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x71f:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1716999789.900627:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11584, 184 off2071408 00010000:00010000:1.0:1716999789.900690:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7437 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900696:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7437 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x71f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900700:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7437 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900704:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.900706:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7437 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900710:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7437 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x71f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900716:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71f:0x0].0x0 (ffff8800900d1700) 00010000:00010000:1.0:1716999789.900717:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.900720:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7437 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x71f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900723:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7437 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x71f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900733:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7429 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900737:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7429 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900740:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7429 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900743:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.900745:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7429 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900751:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7429 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900756:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.900757:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.900759:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7429 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.900763:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7429 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999789.900769:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b1500 reply state ffff88008f84b000 transno 4294986254 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7430 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.900774:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.900836:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+566:11420:x1800404480747136:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1230us (1738us total) trans 4294986254 rc 0/0 00000100:00100000:1.0:1716999789.900842:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45808 00000100:00100000:0.0:1716999789.901196:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.901448:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480747264 00000100:00100000:1.0:1716999789.901452:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480747264 00000100:00100000:1.0:1716999789.901480:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9210 00000100:00100000:1.0:1716999789.901485:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+566:11419:x1800404480747264:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999789.901637:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11585, 168 off2071576 00000100:00100000:1.0:1716999789.902076:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+567:11419:x1800404480747264:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 589us (879us total) trans 4294986255 rc 0/0 00000100:00100000:1.0:1716999789.902082:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9210 00000100:00100000:0.0:1716999789.903467:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999789.903520:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7430 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.903529:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7430 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.903535:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7430 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.903540:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.903543:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7430 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.903549:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7430 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.903559:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x2f856f5d (ffff8800900d1d00) 00010000:00010000:3.0:1716999789.903562:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.903564:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7430 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.903568:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7430 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.903681:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480747392 00000100:00100000:1.0:1716999789.903687:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480747392 00000100:00100000:1.0:1716999789.903706:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9211 00000100:00100000:1.0:1716999789.903711:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+566:11419:x1800404480747392:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.903861:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+567:11419:x1800404480747392:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 149us (396us total) trans 4294986256 rc 0/0 00000100:00100000:1.0:1716999789.903867:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9211 00000100:00100000:0.0:1716999789.904478:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.904634:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480747520 00000100:00100000:3.0:1716999789.904638:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480747520 00000100:00100000:3.0:1716999789.904670:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9212 00000100:00100000:3.0:1716999789.904675:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480747520:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:3.0:1716999789.905581:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986257 00000100:00100000:3.0:1716999789.906073:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+569:11420:x1800404480747520:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1393us (1591us total) trans 4294986258 rc 0/0 00000100:00100000:3.0:1716999789.906081:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9212 00000020:00080000:3.0:1716999789.906086:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.907143:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.907723:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480747648 00000100:00100000:1.0:1716999789.907729:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480747648 00000100:00100000:1.0:1716999789.907775:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45809 00000100:00100000:1.0:1716999789.907781:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+569:11419:x1800404480747648:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999789.907829:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999789.907848:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8d8aa0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x728:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f53bf1 expref: 569 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.907865:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009186cd80/0x6d188eabd8d809e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x728:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50ce2 expref: 568 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.907875:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913646c0/0x6d188eabd8d80939 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x728:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50c9c expref: 567 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.907915:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8c240/0x6d188eabd8d723dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x728:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1f6 expref: 566 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.907924:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x728:0x0].0x0 (ffff88008e492500) 00010000:00010000:1.0:1716999789.907933:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.907955:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc743e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.907965:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc743e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.907975:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc743e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.907986:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7445 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x554d0b88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.907990:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.907994:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908076:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc744c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x728:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908082:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc744c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x728:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908087:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc744c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x728:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:1.0:1716999789.908481:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1502, 64 off104384 00000040:00080000:1.0:1716999789.908500:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11586, 184 off2071760 00010000:00010000:1.0:1716999789.908550:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7453 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x728:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908557:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7453 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x728:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908564:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7453 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x728:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908570:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7453 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x728:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908578:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7453 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x728:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908583:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7453 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x728:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908588:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7453 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x728:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908592:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2f40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999789.908595:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7453 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x728:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908601:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7453 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x728:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908607:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x728:0x0].0x0 (ffff8800900d1300) 00010000:00010000:1.0:1716999789.908609:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999789.908612:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7453 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x728:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908616:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7453 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x728:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908634:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc744c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x728:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908638:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc744c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x728:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908642:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc744c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x728:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908645:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.908648:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc744c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x728:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908652:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc744c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x728:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908658:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x728:0x0].0x0 (ffff8800900d1300) 00010000:00010000:1.0:1716999789.908660:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.908662:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc744c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x728:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908666:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc744c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x728:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908704:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc743e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908709:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc743e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908713:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc743e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908717:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.908719:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc743e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908724:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc743e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908730:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.908732:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.908733:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc743e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999789.908741:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc743e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999789.908747:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b0a80 reply state ffff88008f84f000 transno 4294986259 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.908753:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.908818:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+567:11419:x1800404480747648:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1035us (1676us total) trans 4294986259 rc 0/0 00000100:00100000:1.0:1716999789.908826:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45809 00000100:00100000:0.0:1716999789.909539:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.909588:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480747776 00000100:00100000:2.0:1716999789.909593:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480747776 00000100:00100000:2.0:1716999789.909614:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45810 00000100:00100000:2.0:1716999789.909619:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480747776:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.909646:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.909657:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c0000/0x6d188eabd8d7f478 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x711:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f505d4 expref: 567 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.909669:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135418fc0/0x6d188eabd8d77dda lrc: 0/0,0 mode: --/CW res: [0x200000401:0x711:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4df15 expref: 566 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.909678:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963d440/0x6d188eabd8d7f440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x711:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f505bf expref: 565 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.909689:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e52400/0x6d188eabd8d71ce4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x711:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bec3 expref: 564 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.909699:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x711:0x0].0x0 (ffff880129eeda00) 00010000:00010000:2.0:1716999789.909705:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.909717:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc745a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.909725:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc745a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.909730:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc745a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.909738:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7461 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x554f0788 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.909744:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7461 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.909748:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7461 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.909815:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7468 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x711:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.909821:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7468 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x711:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.909827:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7468 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x711:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:2.0:1716999789.910166:0:6823:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x711:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.910201:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11587, 184 off2071944 00010000:00010000:2.0:1716999789.910256:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7468 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x711:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910262:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7468 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x711:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910267:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7468 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x711:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910271:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.910273:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7468 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x711:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910278:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7468 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x711:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910285:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x711:0x0].0x0 (ffff880088977d00) 00010000:00010000:2.0:1716999789.910286:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.910288:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7468 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x711:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910292:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7468 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x711:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910302:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc745a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910307:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc745a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910310:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc745a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910314:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.910316:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc745a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910322:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc745a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910327:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.910328:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.910330:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc745a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.910333:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc745a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999789.910338:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b0e00 reply state ffff880089075000 transno 4294986260 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7461 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.910342:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.910376:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480747776:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 756us (838us total) trans 4294986260 rc 0/0 00000100:00100000:2.0:1716999789.910381:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45810 00010000:00010000:3.0:1716999789.911391:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.911400:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7445 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.911405:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7445 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.911409:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b33c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.911411:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7445 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.911416:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7445 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.911428:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x554d0b88 (ffff8800900d1200) 00010000:00010000:3.0:1716999789.911430:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.911432:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7445 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.911436:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7445 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.912267:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7461 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.912273:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7461 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.912278:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7461 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.912282:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.912284:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7461 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.912289:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7461 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.912297:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x554f0788 (ffff880088977000) 00010000:00010000:3.0:1716999789.912299:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.912301:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7461 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.912305:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7461 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x554f0788 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999789.913092:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.913194:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480747904 00000100:00100000:3.0:1716999789.913200:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480747904 00000100:00100000:3.0:1716999789.913239:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9213 00000100:00100000:3.0:1716999789.913245:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+563:11420:x1800404480747904:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:3.0:1716999789.913550:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986261 00000100:00100000:3.0:1716999789.913632:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480747904:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 387us (542us total) trans 4294986262 rc 0/0 00000100:00100000:3.0:1716999789.913639:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9213 00000020:00080000:3.0:1716999789.913643:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.916391:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.916496:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480748032 00000100:00100000:1.0:1716999789.916504:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480748032 00000100:00100000:1.0:1716999789.916544:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9214 00000100:00100000:1.0:1716999789.916551:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6a24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+565:11419:x1800404480748032:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.916935:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6a24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+566:11419:x1800404480748032:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 383us (549us total) trans 4294986263 rc 0/0 00000100:00100000:1.0:1716999789.916942:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9214 00000100:00100000:0.0:1716999789.918657:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.918694:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.919452:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480748160 00000100:00100000:2.0:1716999789.919459:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480748160 00000100:00100000:2.0:1716999789.919486:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480748288 00000100:00100000:2.0:1716999789.919488:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480748288 00000100:00100000:2.0:1716999789.919499:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45811 00000100:00100000:2.0:1716999789.919505:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+567:11420:x1800404480748160:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.919542:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.919560:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8d7f0ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x70d:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f504a0 expref: 567 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.919577:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091333600/0x6d188eabd8d768da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x70d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4d7e4 expref: 566 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.919592:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c06c0/0x6d188eabd8d7f0b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5048b expref: 565 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.919601:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8b40/0x6d188eabd8d71bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be37 expref: 564 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.919608:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70d:0x0].0x0 (ffff8800a6ad7700) 00010000:00010000:2.0:1716999789.919615:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.919634:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc746f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.919644:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc746f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.919651:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc746f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.919660:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7476 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x862169a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.919665:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7476 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.919670:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7476 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.919743:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc747d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x70d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.919747:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc747d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.919755:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc747d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:2.0:1716999789.920110:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x70d:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.920148:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11588, 184 off2072128 00010000:00010000:2.0:1716999789.920208:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc747d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920214:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc747d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x70d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920220:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc747d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920225:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.920227:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc747d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920232:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc747d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x70d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920239:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70d:0x0].0x0 (ffff880088977d00) 00010000:00010000:2.0:1716999789.920241:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.920244:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc747d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x70d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920248:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc747d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x70d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920258:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc746f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920262:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc746f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920266:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc746f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920270:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.920272:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc746f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920277:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc746f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920282:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.920284:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.920286:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc746f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920290:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc746f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999789.920295:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a690380 reply state ffff880089072000 transno 4294986264 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7476 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999789.920301:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.920345:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+565:11420:x1800404480748160:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 839us (1690us total) trans 4294986264 rc 0/0 00000100:00100000:2.0:1716999789.920351:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45811 00000100:00100000:2.0:1716999789.920364:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45812 00000100:00100000:2.0:1716999789.920368:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+564:11419:x1800404480748288:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.920383:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.920391:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8d8002c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x71e:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f509a8 expref: 564 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.920405:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216df80/0x6d188eabd8d7749c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x71e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4dbd4 expref: 563 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.920414:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8d7ffed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5098c expref: 562 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.920422:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8000/0x6d188eabd8d720f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c098 expref: 561 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.920428:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71e:0x0].0x0 (ffff88009c21f100) 00010000:00010000:2.0:1716999789.920433:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.920441:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7484 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920447:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7484 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920451:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7484 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920458:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc748b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x2f856f5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920462:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc748b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920466:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc748b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920501:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7492 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x71e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920508:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920513:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00080000:2.0:1716999789.920747:0:11055:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x71e:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.920770:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11589, 184 off2072312 00010000:00010000:2.0:1716999789.920821:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7492 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920826:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7492 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x71e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920831:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7492 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920834:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.920836:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7492 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920840:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7492 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x71e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920846:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71e:0x0].0x0 (ffff880088977600) 00010000:00010000:2.0:1716999789.920847:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.920849:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7492 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x71e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920853:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7492 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x71e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920860:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7484 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920865:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7484 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920869:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7484 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920872:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.920873:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7484 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920877:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7484 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920897:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.920898:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.920900:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7484 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.920904:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7484 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999789.920908:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897aea00 reply state ffff880089074000 transno 4294986265 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc748b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999789.920912:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.920932:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+562:11419:x1800404480748288:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 563us (2237us total) trans 4294986265 rc 0/0 00000100:00100000:2.0:1716999789.920937:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45812 00000100:00100000:0.0:1716999789.923458:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.923602:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480748416 00000100:00100000:1.0:1716999789.923609:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480748416 00000100:00100000:1.0:1716999789.923636:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45813 00000100:00100000:1.0:1716999789.923643:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+562:11419:x1800404480748416:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999789.923679:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999789.923697:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c94900/0x6d188eabd8dc6a12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc53:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fd6 expref: 562 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.923712:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c961c0/0x6d188eabd8dc69c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fb3 expref: 561 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.923725:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc53:0x0].0x0 (ffff88012de9cb00) 00010000:00010000:1.0:1716999789.923732:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.923752:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7499 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.923761:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7499 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.923768:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7499 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.923779:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc74a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.923784:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc74a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.923788:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc74a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.923872:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc74a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.923893:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc74a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.923900:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc74a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:1.0:1716999789.924281:0:6822:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0xc53:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1716999789.924321:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11590, 184 off2072496 00010000:00010000:1.0:1716999789.924384:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc74a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924390:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc74a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924395:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc74a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924399:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.924402:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc74a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924408:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc74a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924414:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc53:0x0].0x0 (ffff8800900d1a00) 00010000:00010000:1.0:1716999789.924416:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.924418:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc74a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924422:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc74a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924432:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7499 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924436:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7499 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924440:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7499 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924443:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.924445:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7499 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924453:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7499 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924457:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.924458:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.924460:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7499 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999789.924464:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7499 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:1.0:1716999789.924470:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897ad180 reply state ffff88008f849000 transno 4294986266 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc74a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999789.924475:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1716999789.925201:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7476 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.925208:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7476 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.925212:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7476 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.925215:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918321c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.925218:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7476 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.925223:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7476 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.925231:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x862169a1 (ffff880088977e00) 00010000:00010000:3.0:1716999789.925233:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.925235:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7476 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.925239:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7476 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x862169a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999789.926583:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+562:11419:x1800404480748416:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2935us (3124us total) trans 4294986266 rc 0/0 00000100:00100000:1.0:1716999789.926590:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45813 00000100:00100000:0.0:1716999789.926790:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.927537:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480748544 00000100:00100000:1.0:1716999789.927543:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480748544 00000100:00100000:1.0:1716999789.927570:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9215 00000100:00100000:1.0:1716999789.927574:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+561:11420:x1800404480748544:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.927923:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+562:11420:x1800404480748544:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 347us (1132us total) trans 4294986267 rc 0/0 00000100:00100000:1.0:1716999789.927928:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9215 00010000:00010000:2.0:1716999789.928030:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc748b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.928039:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc748b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.928044:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc748b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.928048:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.928052:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc748b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.928057:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc748b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.928066:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x2f856f5d (ffff880088977400) 00010000:00010000:2.0:1716999789.928069:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.928071:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc748b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999789.928076:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc748b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x2f856f5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999789.929245:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc74a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.929254:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc74a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.929258:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc74a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.929262:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b33c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.929265:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc74a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.929271:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc74a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.929280:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x6c9b575e (ffff8800900d1600) 00010000:00010000:3.0:1716999789.929282:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.929285:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc74a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.929288:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc74a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x6c9b575e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999789.931467:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.931546:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.931612:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480748672 00000100:00100000:2.0:1716999789.931620:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480748672 00000100:00100000:1.0:1716999789.931709:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480748800 00000100:00100000:1.0:1716999789.931713:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480748800 00000100:00100000:1.0:1716999789.931745:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9216 00000100:00100000:1.0:1716999789.931752:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+561:11419:x1800404480748800:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999789.932053:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45814 00000100:00100000:2.0:1716999789.932059:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+561:11420:x1800404480748672:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.932082:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.932103:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c576880/0x6d188eabd8d806e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x725:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50bca expref: 561 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.932120:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013541a880/0x6d188eabd8d780ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x725:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4dff5 expref: 560 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.932130:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364480/0x6d188eabd8d806b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x725:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50bbc expref: 559 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.932142:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a89006c0/0x6d188eabd8d722f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x725:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c18d expref: 558 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.932148:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x725:0x0].0x0 (ffff88012de9ce00) 00010000:00010000:2.0:1716999789.932157:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.932176:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc74ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932186:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc74ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932192:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc74ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932202:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc74b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0xec85a24b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932207:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc74b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932211:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc74b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932279:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc74bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x725:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932285:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc74bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x725:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932290:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc74bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x725:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:2.0:1716999789.932635:0:7785:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x725:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.932701:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11592, 184 off2072760 00010000:00010000:2.0:1716999789.932758:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc74bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x725:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932764:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc74bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x725:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932769:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc74bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x725:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932774:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.932776:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc74bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x725:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932781:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc74bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x725:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932787:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x725:0x0].0x0 (ffff880088977f00) 00010000:00010000:2.0:1716999789.932789:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.932791:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc74bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x725:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932795:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc74bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x725:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932816:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc74ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932820:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc74ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932824:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc74ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932827:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.932830:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc74ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932834:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc74ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932839:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.932840:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.932842:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc74ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.932845:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc74ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999789.932850:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897adf80 reply state ffff880089076000 transno 4294986268 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc74b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999789.932854:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.932920:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+559:11420:x1800404480748672:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 860us (1464us total) trans 4294986268 rc 0/0 00000100:00100000:2.0:1716999789.932926:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45814 00000001:00080000:1.0:1716999789.933244:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986269 00000100:00100000:1.0:1716999789.933302:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+560:11419:x1800404480748800:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1550us (1755us total) trans 4294986270 rc 0/0 00000100:00100000:1.0:1716999789.933309:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9216 00000020:00080000:1.0:1716999789.933312:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.934549:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999789.934717:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc74b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.934724:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc74b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.934729:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc74b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.934733:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918306c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.934736:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc74b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.934744:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc74b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.934754:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xec85a24b (ffff880088977800) 00010000:00010000:2.0:1716999789.934756:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.934759:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc74b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.934762:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc74b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999789.935139:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480748928 00000100:00100000:3.0:1716999789.935146:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480748928 00000100:00100000:3.0:1716999789.935178:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45815 00000100:00100000:3.0:1716999789.935184:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11419:x1800404480748928:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999789.935219:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999789.935233:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6af40/0x6d188eabd8d7f210 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x70e:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50510 expref: 559 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.935266:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135418900/0x6d188eabd8d7703c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x70e:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4da5a expref: 558 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.935276:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb99b00/0x6d188eabd8d7f1b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f504fb expref: 557 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.935285:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419fcc0/0x6d188eabd8d71c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be76 expref: 556 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.935295:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70e:0x0].0x0 (ffff8800a6019100) 00010000:00010000:3.0:1716999789.935302:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.935323:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc74c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935332:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc74c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935339:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc74c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935348:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc74ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x5538fb88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935352:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc74ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935357:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc74ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935428:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc74d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x70e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935437:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc74d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935442:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc74d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:3.0:1716999789.935789:0:6822:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x70e:0x0] is inserted into orphan list, open count = 1 00000040:00080000:3.0:1716999789.935844:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11593, 184 off2072944 00010000:00010000:3.0:1716999789.935936:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc74d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935942:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc74d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x70e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935947:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc74d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935950:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.935953:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc74d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935958:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc74d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x70e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935965:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70e:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999789.935966:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.935969:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc74d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x70e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935973:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc74d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x70e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935984:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc74c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935989:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc74c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935993:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc74c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.935996:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.935998:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc74c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.936002:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc74c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.936007:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.936008:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.936011:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc74c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.936014:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc74c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999789.936020:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897ace00 reply state ffff88009a7bc000 transno 4294986271 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc74ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999789.936025:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.938507:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11419:x1800404480748928:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3314us (3953us total) trans 4294986271 rc 0/0 00000100:00100000:3.0:1716999789.938516:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45815 00000100:00100000:0.0:1716999789.938712:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.939012:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480749056 00000100:00100000:3.0:1716999789.939018:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480749056 00000100:00100000:3.0:1716999789.939286:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45816 00000100:00100000:3.0:1716999789.939292:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11420:x1800404480749056:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999789.939330:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1716999789.939349:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900240/0x6d188eabd8dc6b15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc54:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66031 expref: 557 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.939365:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c480/0x6d188eabd8dc6acf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc54:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66015 expref: 556 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.939372:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc54:0x0].0x0 (ffff88008a83fb00) 00010000:00010000:3.0:1716999789.939380:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.939399:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc74d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.939408:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc74d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.939415:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc74d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.939423:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc74df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.939428:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc74df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.939433:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc74df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.939520:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc74e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.939526:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc74e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.939535:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc74e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:3.0:1716999789.939964:0:6822:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0xc54:0x0] is inserted into orphan list, open count = 1 00000040:00080000:3.0:1716999789.940004:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11594, 184 off2073128 00010000:00010000:3.0:1716999789.940069:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc74e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940075:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc74e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940080:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc74e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940085:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.940087:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc74e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940093:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc74e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940101:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc54:0x0].0x0 (ffff8800a5c6e100) 00010000:00010000:3.0:1716999789.940103:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.940106:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc74e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940110:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc74e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940121:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc74d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940125:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc74d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940130:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc74d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940133:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.940135:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc74d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940139:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc74d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940144:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.940146:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.940148:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc74d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.940151:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc74d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999789.940158:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897adc00 reply state ffff8800abd7e000 transno 4294986272 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc74df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999789.940162:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.940212:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11420:x1800404480749056:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 919us (1501us total) trans 4294986272 rc 0/0 00000100:00100000:3.0:1716999789.940218:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45816 00010000:00010000:2.0:1716999789.942659:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc74df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942670:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc74df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942676:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc74df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942680:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.942683:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc74df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942688:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc74df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942700:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x63bf9fee (ffff8800a5c6e700) 00010000:00010000:2.0:1716999789.942702:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.942704:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc74df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942708:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc74df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942732:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc74ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942737:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc74ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942741:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc74ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942744:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.942745:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc74ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942749:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc74ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942753:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x5538fb88 (ffff8800a5c6e000) 00010000:00010000:2.0:1716999789.942755:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.942756:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc74ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.942760:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc74ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999789.943313:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.944485:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.944922:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480749312 00000100:00100000:1.0:1716999789.944930:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480749312 00000100:00100000:1.0:1716999789.944965:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9217 00000100:00100000:1.0:1716999789.944970:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+555:11420:x1800404480749312:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.945286:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+556:11420:x1800404480749312:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 315us (801us total) trans 4294986273 rc 0/0 00000100:00100000:1.0:1716999789.945292:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9217 00000100:00100000:2.0:1716999789.945462:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480749184 00000100:00100000:2.0:1716999789.945466:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480749184 00000100:00100000:2.0:1716999789.945490:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45817 00000100:00100000:2.0:1716999789.945494:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+556:11419:x1800404480749184:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.945515:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999789.945531:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb6880/0x6d188eabd8dc68e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc52:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f74 expref: 556 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.945548:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8ef40/0x6d188eabd8dc68b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f58 expref: 555 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.945556:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc52:0x0].0x0 (ffff88012e3f8200) 00010000:00010000:2.0:1716999789.945562:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.945579:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc74ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.945589:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc74ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.945595:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc74ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.945603:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc74f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.945607:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc74f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.945611:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc74f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.945669:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc74fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.945674:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc74fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.945678:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc74fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:2.0:1716999789.945988:0:7785:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0xc52:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.946038:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11595, 184 off2073312 00010000:00010000:2.0:1716999789.946089:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc74fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946095:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc74fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946100:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc74fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946104:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.946107:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc74fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946112:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc74fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946119:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc52:0x0].0x0 (ffff880088977300) 00010000:00010000:2.0:1716999789.946122:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.946124:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc74fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946128:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc74fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946140:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc74ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946145:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc74ed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946149:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc74ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946152:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.946154:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc74ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946158:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc74ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946163:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.946165:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.946167:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc74ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.946172:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc74ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999789.946178:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897ae300 reply state ffff880099448000 transno 4294986274 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc74f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999789.946183:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.946217:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+556:11419:x1800404480749184:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 721us (2906us total) trans 4294986274 rc 0/0 00000100:00100000:2.0:1716999789.946222:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45817 00000100:00100000:0.0:1716999789.947904:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.947995:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480749440 00000100:00100000:3.0:1716999789.948002:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480749440 00000100:00100000:3.0:1716999789.948043:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45818 00000100:00100000:3.0:1716999789.948049:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+556:11420:x1800404480749440:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999789.948085:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999789.948105:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8d7f76c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x715:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f506b4 expref: 556 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.948121:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c577a80/0x6d188eabd8d77e04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x715:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4df23 expref: 555 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.948130:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133141f80/0x6d188eabd8d7f718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x715:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f506a6 expref: 554 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.948139:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8d200/0x6d188eabd8d71e0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x715:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf4f expref: 553 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.948146:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x715:0x0].0x0 (ffff88008e492d00) 00010000:00010000:3.0:1716999789.948153:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.948171:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7502 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948181:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7502 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948188:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7502 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948198:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7509 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x853e1088 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948203:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7509 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948207:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7509 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948282:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7510 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x715:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948288:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7510 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x715:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948294:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7510 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x715:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00080000:3.0:1716999789.948667:0:6822:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x715:0x0] is inserted into orphan list, open count = 1 00000040:00080000:3.0:1716999789.948707:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11596, 184 off2073496 00010000:00010000:3.0:1716999789.948773:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7510 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x715:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948779:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7510 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x715:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948784:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7510 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x715:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948787:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c506c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.948790:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7510 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x715:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948795:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7510 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x715:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948814:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x715:0x0].0x0 (ffff8800a5c6eb00) 00010000:00010000:3.0:1716999789.948816:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.948819:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7510 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x715:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948823:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7510 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x715:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948836:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7502 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948840:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7502 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948844:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7502 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948848:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.948849:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7502 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948853:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7502 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948858:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.948860:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.948862:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7502 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.948865:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7502 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999789.948870:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897ad500 reply state ffff880089366000 transno 4294986275 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7509 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999789.948875:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.948949:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11420:x1800404480749440:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 897us (1075us total) trans 4294986275 rc 0/0 00000100:00100000:3.0:1716999789.948955:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45818 00010000:00010000:2.0:1716999789.949411:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc74f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.949418:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc74f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.949422:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc74f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.949426:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.949428:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc74f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.949436:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc74f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.949443:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x63bf9fee (ffff880088977900) 00010000:00010000:2.0:1716999789.949445:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.949447:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc74f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.949451:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc74f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x63bf9fee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.950080:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.950247:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480749568 00000100:00100000:1.0:1716999789.950253:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480749568 00000100:00100000:1.0:1716999789.950275:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9218 00000100:00100000:1.0:1716999789.950280:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+553:11419:x1800404480749568:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.950531:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+554:11419:x1800404480749568:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 249us (451us total) trans 4294986276 rc 0/0 00000100:00100000:1.0:1716999789.950536:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9218 00010000:00010000:2.0:1716999789.950758:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7509 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.950765:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7509 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.950769:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7509 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.950772:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.950775:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7509 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.950780:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7509 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.950787:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x853e1088 (ffff8800a5c6ef00) 00010000:00010000:2.0:1716999789.950789:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.950791:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7509 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999789.950795:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7509 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999789.952179:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.952749:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480749696 00000100:00100000:1.0:1716999789.952755:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480749696 00000100:00100000:1.0:1716999789.953924:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9219 00000100:00100000:1.0:1716999789.953932:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+553:11420:x1800404480749696:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:1.0:1716999789.954286:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986277 00000040:00080000:1.0:1716999789.954415:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11597, 168 off2073664 00000001:00080000:1.0:1716999789.954421:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986278 00000100:00100000:1.0:1716999789.955198:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+556:11420:x1800404480749696:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1264us (3019us total) trans 4294986279 rc 0/0 00000100:00100000:1.0:1716999789.955207:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9219 00000020:00080000:1.0:1716999789.955212:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1716999789.956763:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.957451:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480749824 00000100:00100000:2.0:1716999789.957458:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480749824 00000100:00100000:2.0:1716999789.957500:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45819 00000100:00100000:2.0:1716999789.957506:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+556:11419:x1800404480749824:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.957548:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.957568:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366640/0x6d188eabd8d805ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x724:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50b6f expref: 556 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.957585:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6468b40/0x6d188eabd8d77f85 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x724:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4df8c expref: 555 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.957598:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7cc0/0x6d188eabd8d80557 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x724:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50b4c expref: 554 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.957607:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a89021c0/0x6d188eabd8d722a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x724:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c16a expref: 553 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.957614:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x724:0x0].0x0 (ffff8800a6ad7c00) 00010000:00010000:2.0:1716999789.957621:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.957640:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7517 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.957650:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7517 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.957657:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7517 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.957667:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc751e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0xec85a24b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.957673:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc751e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.957678:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc751e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.957757:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7525 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x724:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.957763:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7525 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x724:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.957768:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7525 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x724:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:2.0:1716999789.958181:0:7785:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x724:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.958221:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11598, 184 off2073848 00010000:00010000:2.0:1716999789.958284:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7525 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x724:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958290:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7525 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x724:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958295:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7525 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x724:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958300:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.958303:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7525 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x724:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958308:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7525 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x724:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958315:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x724:0x0].0x0 (ffff880088977800) 00010000:00010000:2.0:1716999789.958318:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.958321:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7525 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x724:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958324:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7525 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x724:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958336:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7517 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958340:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7517 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958345:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7517 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958348:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.958350:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7517 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958355:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7517 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958360:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.958362:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.958364:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7517 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.958368:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7517 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999789.958376:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897ac000 reply state ffff88009944b000 transno 4294986280 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc751e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999789.958381:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.958439:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11419:x1800404480749824:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 932us (1678us total) trans 4294986280 rc 0/0 00000100:00100000:2.0:1716999789.958446:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45819 00000100:00100000:1.0:1716999789.959622:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.959739:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480749952 00000100:00100000:3.0:1716999789.959749:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480749952 00000100:00100000:3.0:1716999789.959783:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45820 00000100:00100000:3.0:1716999789.959788:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11420:x1800404480749952:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999789.959825:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1716999789.959839:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e86c0/0x6d188eabd8dc5c51 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc46:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b1b expref: 554 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.959851:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e9440/0x6d188eabd8dc5c19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65aff expref: 553 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.959858:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc46:0x0].0x0 (ffff880135ac4f00) 00010000:00010000:3.0:1716999789.959864:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.959896:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc752c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.959905:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc752c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.959911:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc752c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.959919:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7533 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.959924:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.959928:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960000:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc753a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960004:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc753a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960011:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc753a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999789.960327:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1499, 64 off104192 00000040:00080000:3.0:1716999789.960342:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11599, 184 off2074032 00010000:00010000:3.0:1716999789.960388:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7541 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960394:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7541 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960399:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7541 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960404:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7541 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960409:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7541 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960413:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7541 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960418:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7541 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960422:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999789.960425:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7541 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960429:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7541 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960434:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc46:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999789.960437:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999789.960439:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7541 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960443:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7541 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960457:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc753a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960461:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc753a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960464:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc753a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960468:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.960470:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc753a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960473:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc753a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960477:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc46:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999789.960479:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.960480:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc753a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960484:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc753a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960514:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc752c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960517:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc752c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960522:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc752c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960525:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.960527:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc752c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960530:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc752c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960534:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999789.960536:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.960537:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc752c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.960540:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc752c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999789.960545:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880091559f80 reply state ffff880089361000 transno 4294986281 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999789.960549:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.960585:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11420:x1800404480749952:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 796us (965us total) trans 4294986281 rc 0/0 00000100:00100000:3.0:1716999789.960590:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45820 00010000:00010000:2.0:1716999789.961386:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc751e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.961393:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc751e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.961398:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc751e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.961401:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.961403:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc751e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.961408:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc751e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.961416:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xec85a24b (ffff880088977100) 00010000:00010000:2.0:1716999789.961419:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.961420:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc751e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.961424:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc751e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xec85a24b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.962724:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.962797:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480750080 00000100:00100000:1.0:1716999789.962812:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480750080 00000100:00100000:1.0:1716999789.962847:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9220 00000100:00100000:1.0:1716999789.962852:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eeac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+553:11419:x1800404480750080:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:1.0:1716999789.963314:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986282 00000100:00100000:1.0:1716999789.963395:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eeac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+555:11419:x1800404480750080:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 541us (674us total) trans 4294986283 rc 0/0 00000100:00100000:1.0:1716999789.963401:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9220 00000020:00080000:1.0:1716999789.963405:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.964034:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999789.964166:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.964174:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7533 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.964179:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.964183:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.964186:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.964191:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7533 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.964202:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x60b23c20 (ffff8800a5c6e100) 00010000:00010000:3.0:1716999789.964204:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.964207:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7533 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999789.964211:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7533 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x60b23c20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999789.964296:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480750208 00000100:00100000:1.0:1716999789.964300:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480750208 00000100:00100000:1.0:1716999789.964327:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9221 00000100:00100000:1.0:1716999789.964332:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11420:x1800404480750208:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:1.0:1716999789.964515:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986284 00000100:00100000:1.0:1716999789.964564:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+556:11420:x1800404480750208:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 231us (531us total) trans 4294986285 rc 0/0 00000100:00100000:1.0:1716999789.964569:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9221 00000020:00080000:1.0:1716999789.964572:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999789.966093:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.966206:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.966332:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480750464 00000100:00100000:2.0:1716999789.966338:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480750464 00000100:00100000:2.0:1716999789.966361:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480750400 00000100:00100000:2.0:1716999789.966363:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480750400 00000100:00100000:2.0:1716999789.966374:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45821 00000100:00100000:2.0:1716999789.966379:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+557:11420:x1800404480750464:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.966410:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.966425:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef0b40/0x6d188eabd8d7ec83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x708:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50311 expref: 557 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.966438:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf52640/0x6d188eabd8d768b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x708:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4d7d6 expref: 556 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.966447:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009186ef40/0x6d188eabd8d7ec44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x708:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5030a expref: 555 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.966455:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e53cc0/0x6d188eabd8d71a59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x708:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bda4 expref: 554 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.966462:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x708:0x0].0x0 (ffff88012de9c100) 00010000:00010000:2.0:1716999789.966468:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.966486:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7548 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.966497:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7548 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.966504:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7548 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.966513:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc754f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x85ed9198 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.966518:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc754f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.966523:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc754f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.966598:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7556 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x708:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.966603:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x708:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.966608:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x708:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:2.0:1716999789.966989:0:7785:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x708:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.967029:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11600, 184 off2074216 00010000:00010000:2.0:1716999789.967084:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7556 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x708:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967090:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7556 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x708:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967095:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7556 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x708:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967099:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.967102:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7556 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x708:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967107:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7556 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x708:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967114:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x708:0x0].0x0 (ffff880088977e00) 00010000:00010000:2.0:1716999789.967116:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.967119:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7556 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x708:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967123:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7556 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x708:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967134:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7548 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967139:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7548 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967142:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7548 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967146:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.967148:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7548 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967153:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7548 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967159:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.967160:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.967162:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7548 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.967166:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7548 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999789.967172:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897afb80 reply state ffff88009944d000 transno 4294986286 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc754f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999789.967177:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.967227:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+555:11420:x1800404480750464:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 846us (1136us total) trans 4294986286 rc 0/0 00000100:00100000:2.0:1716999789.967234:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45821 00000100:00100000:2.0:1716999789.967247:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45822 00000100:00100000:2.0:1716999789.967257:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11419:x1800404480750400:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.967272:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.967282:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963c6c0/0x6d188eabd8d7eb56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x707:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f502c4 expref: 554 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.969380:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc754f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.969392:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc754f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.969398:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc754f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.969403:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.969406:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc754f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.969411:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc754f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.969422:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x85ed9198 (ffff880088977700) 00010000:00010000:3.0:1716999789.969425:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.969427:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc754f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.969432:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc754f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x85ed9198 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.969605:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999789.969751:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215cb40/0x6d188eabd8d7612b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x707:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4d52f expref: 552 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.969763:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8d7eb1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x707:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f502af expref: 551 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.969771:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9440/0x6d188eabd8d719f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x707:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd73 expref: 550 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.969778:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x707:0x0].0x0 (ffff88012ca38a00) 00010000:00010000:2.0:1716999789.969783:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.969818:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc755d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.969828:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc755d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.969835:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc755d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.969844:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7564 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x85ed7b8c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.969849:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7564 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.969857:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7564 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.969950:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc756b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x707:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.969956:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc756b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x707:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.969961:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc756b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x707:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:2.0:1716999789.970314:0:7785:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x707:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.970355:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11601, 184 off2074400 00010000:00010000:2.0:1716999789.970418:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc756b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x707:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970424:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc756b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x707:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970428:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc756b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x707:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970432:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.970435:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc756b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x707:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970439:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc756b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x707:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970446:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x707:0x0].0x0 (ffff880088977600) 00010000:00010000:2.0:1716999789.970448:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.970451:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc756b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x707:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970456:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc756b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x707:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970465:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc755d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970470:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc755d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970475:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc755d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970478:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.970480:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc755d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970484:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc755d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970489:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999789.970491:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.970493:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc755d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.970496:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc755d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999789.970503:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897af100 reply state ffff88009944f000 transno 4294986287 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7564 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999789.970508:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.970955:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480750592 00000100:00100000:3.0:1716999789.970962:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480750592 00000100:00100000:2.0:1716999789.973975:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+552:11419:x1800404480750400:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 6711us (7758us total) trans 4294986287 rc 0/0 00000100:00100000:2.0:1716999789.973986:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45822 00000100:00100000:3.0:1716999789.974625:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9222 00000100:00100000:3.0:1716999789.974634:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+551:11420:x1800404480750592:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999789.975005:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11602, 168 off2074568 00000001:00080000:3.0:1716999789.975011:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986288 00000100:00100000:3.0:1716999789.975087:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+553:11420:x1800404480750592:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 454us (5484us total) trans 4294986289 rc 0/0 00000100:00100000:3.0:1716999789.975093:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9222 00000020:00080000:3.0:1716999789.975096:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1716999789.977592:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7564 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.977604:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7564 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.977610:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7564 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.977615:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.977619:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7564 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.977625:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7564 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.977639:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x85ed7b8c (ffff880088977200) 00010000:00010000:3.0:1716999789.977641:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.977644:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7564 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.977648:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7564 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x85ed7b8c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.978243:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.978560:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480750720 00000100:00100000:2.0:1716999789.978568:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480750720 00000100:00100000:2.0:1716999789.978610:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45823 00000100:00100000:2.0:1716999789.978616:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+552:11420:x1800404480750720:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.978659:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999789.978672:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216e400/0x6d188eabd8dc672c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc50:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ecc expref: 552 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.978683:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4000/0x6d188eabd8dc65ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc50:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e6a expref: 551 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.978689:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc50:0x0].0x0 (ffff880094791f00) 00010000:00010000:2.0:1716999789.978695:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.978714:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7572 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.978724:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7572 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.978731:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7572 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.978739:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7579 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.978744:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.978749:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.978843:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7580 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.978849:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7580 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.978855:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7580 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:2.0:1716999789.979280:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1500, 64 off104256 00000040:00080000:2.0:1716999789.979298:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11603, 184 off2074752 00010000:00010000:2.0:1716999789.979349:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7587 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979356:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979363:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979368:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7587 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979372:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7587 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979377:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7587 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979381:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7587 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979385:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833a80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999789.979388:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7587 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979394:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7587 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979400:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc50:0x0].0x0 (ffff880088977100) 00010000:00010000:2.0:1716999789.979401:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999789.979404:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7587 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979408:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7587 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc50:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979424:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7580 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979428:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7580 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979432:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7580 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979435:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.979437:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7580 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979440:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7580 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979445:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc50:0x0].0x0 (ffff880088977100) 00010000:00010000:2.0:1716999789.979447:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.979448:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7580 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979452:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7580 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc50:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979488:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7572 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979493:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7572 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979496:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7572 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979499:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.979501:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7572 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.979505:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7572 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.980324:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.980395:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480750848 00000100:00100000:1.0:1716999789.980400:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480750848 00000100:00100000:1.0:1716999789.980435:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9223 00000100:00100000:1.0:1716999789.980441:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+552:11419:x1800404480750848:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999789.980702:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+553:11419:x1800404480750848:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 260us (381us total) trans 4294986291 rc 0/0 00000100:00100000:1.0:1716999789.980708:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9223 00010000:00010000:2.0:1716999789.981341:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.981345:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.981351:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7572 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.981357:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7572 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999789.981367:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897aed80 reply state ffff880134aeb000 transno 4294986290 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999789.981373:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.982345:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+553:11420:x1800404480750720:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3724us (4101us total) trans 4294986290 rc 0/0 00000100:00100000:2.0:1716999789.982352:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45823 00000100:00100000:0.0:1716999789.982546:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.983413:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480750976 00000100:00100000:3.0:1716999789.983420:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480750976 00000100:00100000:3.0:1716999789.983459:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45824 00000100:00100000:3.0:1716999789.983465:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+553:11419:x1800404480750976:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999789.983502:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999789.983522:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8d7f56d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x713:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5060c expref: 553 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.983538:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135419440/0x6d188eabd8d77c7c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x713:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4de97 expref: 552 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.983548:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133140d80/0x6d188eabd8d7f535 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x713:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f505fe expref: 551 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.983558:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8fcc0/0x6d188eabd8d71d70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x713:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf09 expref: 550 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999789.983565:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x713:0x0].0x0 (ffff88012bacda00) 00010000:00010000:3.0:1716999789.983572:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999789.983591:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc758e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.983603:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc758e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.983610:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc758e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.983619:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7595 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x853e0f88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.983624:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.983629:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.983710:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc759c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x713:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.983717:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc759c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x713:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.983722:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc759c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x713:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:3.0:1716999789.984130:0:7785:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x713:0x0] is inserted into orphan list, open count = 1 00000040:00080000:3.0:1716999789.984172:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11604, 184 off2074936 00010000:00010000:3.0:1716999789.984242:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc759c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x713:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984248:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc759c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x713:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984253:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc759c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x713:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984260:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.984263:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc759c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x713:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984268:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc759c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x713:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984274:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x713:0x0].0x0 (ffff8800a5c6ec00) 00010000:00010000:3.0:1716999789.984276:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999789.984279:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc759c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x713:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984282:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc759c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x713:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984295:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc758e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984299:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc758e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984302:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc758e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984305:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.984307:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc758e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984312:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc758e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984317:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999789.984319:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.984322:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc758e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.984326:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc758e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999789.984332:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800897ae680 reply state ffff880089360000 transno 4294986292 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999789.984337:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999789.984384:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+551:11419:x1800404480750976:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 918us (1837us total) trans 4294986292 rc 0/0 00000100:00100000:3.0:1716999789.984390:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45824 00010000:00010000:3.0:1716999789.986190:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.986200:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7579 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.986206:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7579 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.986210:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.986213:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7579 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.986219:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7579 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.986228:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xc88ea4fb (ffff880088977e00) 00010000:00010000:3.0:1716999789.986231:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.986233:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7579 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.986240:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7579 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xc88ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.986294:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7595 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.986301:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7595 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.986305:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7595 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.986308:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.986310:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7595 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.986315:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7595 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.986322:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x853e0f88 (ffff8800a5c6e900) 00010000:00010000:2.0:1716999789.986324:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.986326:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7595 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.986330:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7595 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x853e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.986988:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.987192:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480751104 00000100:00100000:3.0:1716999789.987199:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480751104 00000100:00100000:3.0:1716999789.987237:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9224 00000100:00100000:3.0:1716999789.987242:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+549:11420:x1800404480751104:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999789.987397:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999789.987586:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+550:11420:x1800404480751104:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 342us (600us total) trans 4294986293 rc 0/0 00000100:00100000:3.0:1716999789.987592:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9224 00000100:00100000:3.0:1716999789.988728:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480751232 00000100:00100000:3.0:1716999789.988734:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480751232 00000100:00100000:3.0:1716999789.988877:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9225 00000100:00100000:3.0:1716999789.988897:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+550:11419:x1800404480751232:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999789.989570:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+551:11419:x1800404480751232:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 673us (2171us total) trans 4294986294 rc 0/0 00000100:00100000:3.0:1716999789.989578:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9225 00000100:00100000:0.0:1716999789.990265:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.990284:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480751360 00000100:00100000:2.0:1716999789.990289:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480751360 00000100:00100000:2.0:1716999789.990321:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45825 00000100:00100000:2.0:1716999789.990326:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+551:11420:x1800404480751360:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999789.990355:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999789.990373:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8d7fdbd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x71b:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f508cf expref: 551 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.990389:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a64686c0/0x6d188eabd8d7814c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x71b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4e01f expref: 550 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.990400:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4d80/0x6d188eabd8d7fdaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f508c8 expref: 549 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.990409:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e51f80/0x6d188eabd8d71fed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c028 expref: 548 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999789.990418:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71b:0x0].0x0 (ffff8800941a3000) 00010000:00010000:2.0:1716999789.990425:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999789.990443:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc75a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.990452:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc75a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.990459:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc75a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.990468:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc75aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0xa1380d88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.990473:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc75aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.990478:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc75aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.990545:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc75b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x71b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.990550:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc75b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.990558:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc75b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:2.0:1716999789.990875:0:6823:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x71b:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999789.990943:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11605, 184 off2075120 00010000:00010000:2.0:1716999789.990999:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc75b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991005:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc75b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x71b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991009:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc75b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991014:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.991017:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc75b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991023:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc75b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x71b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991030:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71b:0x0].0x0 (ffff880088977600) 00010000:00010000:2.0:1716999789.991032:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999789.991034:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc75b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x71b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991038:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc75b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x71b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991050:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc75a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991054:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc75a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991059:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc75a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991063:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.991064:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc75a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991068:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc75a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991074:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999789.991076:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.991078:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc75a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999789.991082:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc75a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999789.991088:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e442680 reply state ffff880134aea000 transno 4294986295 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc75aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999789.991093:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999789.991136:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+549:11420:x1800404480751360:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 808us (871us total) trans 4294986295 rc 0/0 00000100:00100000:2.0:1716999789.991142:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45825 00000100:00100000:0.0:1716999789.991516:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.991565:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480751488 00000100:00100000:1.0:1716999789.991570:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480751488 00000100:00100000:1.0:1716999789.991599:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45826 00000100:00100000:1.0:1716999789.991604:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+549:11419:x1800404480751488:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999789.991624:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999789.991699:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8d7fe8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x71c:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50915 expref: 549 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.991996:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091330fc0/0x6d188eabd8d78050 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x71c:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4dfcb expref: 548 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.992011:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133143cc0/0x6d188eabd8d7fe6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71c:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50907 expref: 547 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.992020:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419f840/0x6d188eabd8d7205d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c060 expref: 546 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.992030:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71c:0x0].0x0 (ffff880094025e00) 00010000:00010000:1.0:1716999789.992035:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.992048:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc75b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992055:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc75b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992061:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc75b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992079:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc75bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x55390488 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992084:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc75bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992090:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc75bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.992201:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc75aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.992209:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc75aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.992214:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc75aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.992219:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.992221:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc75aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.992226:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc75aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.992233:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xa1380d88 (ffff880088977700) 00010000:00010000:3.0:1716999789.992236:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.992238:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc75aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999789.992241:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc75aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xa1380d88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999789.992348:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc75c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x71c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992354:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc75c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992360:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc75c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:1.0:1716999789.992655:0:7785:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x71c:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1716999789.992687:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11606, 184 off2075304 00010000:00010000:1.0:1716999789.992827:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc75c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992833:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc75c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x71c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992837:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc75c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992841:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.992843:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc75c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992851:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc75c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x71c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992857:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71c:0x0].0x0 (ffff8800900d1b00) 00010000:00010000:1.0:1716999789.992859:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.992861:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc75c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x71c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992865:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc75c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x71c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992874:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc75b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992899:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc75b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992904:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc75b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992907:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.992909:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc75b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992914:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc75b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992920:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.992921:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.992924:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc75b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.992927:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc75b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999789.992934:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e442a00 reply state ffff88008f84d000 transno 4294986296 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc75bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999789.992939:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.992975:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+546:11419:x1800404480751488:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1369us (1458us total) trans 4294986296 rc 0/0 00000100:00100000:1.0:1716999789.992981:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45826 00000100:00100000:0.0:1716999789.993245:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.993377:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480751616 00000100:00100000:2.0:1716999789.993382:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480751616 00000100:00100000:2.0:1716999789.993409:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9226 00000100:00100000:2.0:1716999789.993415:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eeabc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+546:11420:x1800404480751616:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999789.993625:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eeabc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+547:11420:x1800404480751616:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 209us (380us total) trans 4294986297 rc 0/0 00000100:00100000:2.0:1716999789.993632:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9226 00000100:00100000:3.0:1716999789.995697:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.995725:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480751744 00000100:00100000:3.0:1716999789.995726:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999789.995730:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480751744 00010000:00010000:2.0:1716999789.995980:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc75bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.995988:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc75bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.995994:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc75bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.995998:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999789.996001:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc75bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.996001:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9227 00000100:00100000:0.0:1716999789.996006:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+547:11419:x1800404480751744:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:2.0:1716999789.996007:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc75bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.996017:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x55390488 (ffff8800900d1c00) 00010000:00010000:2.0:1716999789.996020:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999789.996022:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc75bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999789.996026:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc75bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999789.996197:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480751872 00000100:00100000:1.0:1716999789.996201:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480751872 00000100:00100000:1.0:1716999789.996245:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45827 00000100:00100000:1.0:1716999789.996250:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+548:11420:x1800404480751872:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999789.996273:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999789.996285:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7600/0x6d188eabd8d7ff76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x71d:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50962 expref: 548 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.996297:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb99d40/0x6d188eabd8d78122 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x71d:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4e011 expref: 547 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.996305:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133142f40/0x6d188eabd8d7ff4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71d:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50954 expref: 546 pid: 16641 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999789.996312:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+545:11419:x1800404480751744:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 305us (620us total) trans 4294986298 rc 0/0 00010000:00010000:1.0:1716999789.996314:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e518c0/0x6d188eabd8d72087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x71d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c067 expref: 545 pid: 6821 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999789.996318:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9227 00010000:00010000:1.0:1716999789.996321:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71d:0x0].0x0 (ffff8800941a3600) 00010000:00010000:1.0:1716999789.996327:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.996347:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc75cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.996357:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc75cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.996364:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc75cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.996373:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc75d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x55390488 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.996378:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc75d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.996382:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc75d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.996537:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc75db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x71d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.996543:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc75db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.996549:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc75db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:1.0:1716999789.996966:0:7785:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x71d:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1716999789.997006:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11607, 184 off2075488 00010000:00010000:1.0:1716999789.997059:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc75db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x71d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997065:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc75db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x71d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997069:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc75db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997075:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.997077:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc75db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x71d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997082:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc75db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x71d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997090:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71d:0x0].0x0 (ffff8800900d1d00) 00010000:00010000:1.0:1716999789.997092:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.997094:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc75db lrc: 2/0,0 mode: --/EX res: [0x200000401:0x71d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997098:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc75db lrc: 0/0,0 mode: --/EX res: [0x200000401:0x71d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997107:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc75cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997112:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc75cd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997115:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc75cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997119:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.997122:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc75cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997126:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc75cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997130:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999789.997131:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.997134:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc75cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.997137:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc75cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999789.997144:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca9500 reply state ffff8800926fd000 transno 4294986299 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc75d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999789.997149:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.997214:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+545:11420:x1800404480751872:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 961us (1485us total) trans 4294986299 rc 0/0 00000100:00100000:1.0:1716999789.997219:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45827 00000100:00100000:0.0:1716999789.998231:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999789.998276:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480752000 00000100:00100000:1.0:1716999789.998282:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480752000 00000100:00100000:1.0:1716999789.998312:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45828 00000100:00100000:1.0:1716999789.998318:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+545:11419:x1800404480752000:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999789.998343:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999789.998355:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8d80795 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x726:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50c09 expref: 545 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.998367:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216dd40/0x6d188eabd8d77fcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x726:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4df9a expref: 544 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.998375:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367840/0x6d188eabd8d80772 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x726:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50bfb expref: 543 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.998384:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e52d00/0x6d188eabd8d72343 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x726:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1b0 expref: 542 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999789.998396:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x726:0x0].0x0 (ffff88009c872c00) 00010000:00010000:1.0:1716999789.998401:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999789.998414:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc75e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.998423:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc75e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.998429:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc75e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.998437:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc75e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0xd185bb5c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.998442:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc75e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.998447:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc75e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.998508:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc75f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x726:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.998514:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc75f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x726:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.998520:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc75f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x726:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.998614:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc75d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.998620:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc75d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.998625:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc75d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.998629:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999789.998631:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc75d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.998636:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc75d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.998644:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x55390488 (ffff8800900d1e00) 00010000:00010000:3.0:1716999789.998646:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999789.998648:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc75d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999789.998652:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc75d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x55390488 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999789.999026:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999789.999090:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480752128 00000100:00100000:2.0:1716999789.999094:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480752128 00000100:00100000:2.0:1716999789.999120:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9228 00000100:00100000:2.0:1716999789.999125:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+541:11420:x1800404480752128:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:1.0:1716999789.999320:0:7785:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x726:0x0] is inserted into orphan list, open count = 1 00000100:00100000:2.0:1716999789.999345:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+542:11420:x1800404480752128:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 219us (320us total) trans 4294986300 rc 0/0 00000100:00100000:2.0:1716999789.999354:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9228 00000040:00080000:1.0:1716999789.999355:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11608, 184 off2075672 00010000:00010000:1.0:1716999789.999403:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc75f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x726:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999409:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc75f0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x726:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999414:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc75f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x726:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999418:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.999420:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc75f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x726:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999425:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc75f0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x726:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999432:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x726:0x0].0x0 (ffff8800900d1a00) 00010000:00010000:1.0:1716999789.999434:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999789.999436:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc75f0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x726:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999440:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc75f0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x726:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999450:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc75e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999455:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc75e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999459:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc75e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999463:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999789.999465:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc75e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999472:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc75e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999478:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999789.999479:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999789.999481:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc75e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999789.999485:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc75e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999789.999490:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e440700 reply state ffff8800926fe000 transno 4294986301 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc75e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999789.999495:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999789.999530:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+543:11419:x1800404480752000:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1211us (1301us total) trans 4294986301 rc 0/0 00000100:00100000:1.0:1716999789.999535:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45828 00010000:00010000:2.0:1716999790.000319:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc75e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.000326:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc75e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.000331:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc75e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.000335:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.000337:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc75e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.000341:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc75e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.000348:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0xd185bb5c (ffff8800900d1100) 00010000:00010000:2.0:1716999790.000350:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.000352:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc75e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.000356:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc75e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0xd185bb5c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.000614:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.000823:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480752256 00000100:00100000:1.0:1716999790.000828:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480752256 00000100:00100000:1.0:1716999790.000860:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45829 00000100:00100000:1.0:1716999790.000865:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+542:11420:x1800404480752256:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.000909:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.000921:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913658c0/0x6d188eabd8d80304 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x721:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50a96 expref: 542 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.000934:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b180/0x6d188eabd8d7807a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x721:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4dfd9 expref: 541 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.000949:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091366f40/0x6d188eabd8d802a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x721:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50a81 expref: 540 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.000958:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339faf40/0x6d188eabd8d721c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x721:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c101 expref: 539 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.000965:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x721:0x0].0x0 (ffff88009c21fb00) 00010000:00010000:1.0:1716999790.000970:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.000984:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc75f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.000992:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc75f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.000998:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc75f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001007:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc75fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x9b856f73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001011:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc75fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001016:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc75fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001301:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7605 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x721:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001309:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7605 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x721:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001316:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7605 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x721:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:1.0:1716999790.001719:0:7785:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x721:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1716999790.001755:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11609, 184 off2075856 00000100:00100000:0.0:1716999790.001822:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999790.001826:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7605 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x721:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001831:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7605 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x721:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001836:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7605 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x721:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001840:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.001842:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7605 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x721:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001847:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7605 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x721:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001854:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x721:0x0].0x0 (ffff8800900d1300) 00010000:00010000:1.0:1716999790.001856:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.001858:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7605 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x721:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001862:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7605 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x721:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001873:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc75f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001877:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc75f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001897:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc75f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001901:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.001903:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc75f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001906:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc75f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001912:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999790.001914:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.001915:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc75f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.001919:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc75f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.001925:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e442300 reply state ffff8800926f8000 transno 4294986302 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc75fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.001930:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.001966:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+540:11420:x1800404480752256:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1100us (1352us total) trans 4294986302 rc 0/0 00000100:00100000:1.0:1716999790.001972:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45829 00000100:00100000:3.0:1716999790.001976:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480752384 00000100:00100000:3.0:1716999790.001981:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480752384 00000100:00100000:3.0:1716999790.002007:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9229 00000100:00100000:3.0:1716999790.002012:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+540:11419:x1800404480752384:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.002223:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+541:11419:x1800404480752384:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 209us (401us total) trans 4294986303 rc 0/0 00000100:00100000:3.0:1716999790.002229:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9229 00010000:00010000:3.0:1716999790.003167:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc75fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.003175:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc75fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.003180:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc75fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.003184:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.003187:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc75fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.003192:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc75fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.003199:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x9b856f73 (ffff8800900d1200) 00010000:00010000:3.0:1716999790.003201:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.003203:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc75fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.003208:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc75fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x9b856f73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.003595:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.003627:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.003869:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480752512 00000100:00100000:1.0:1716999790.003874:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480752512 00000100:00100000:1.0:1716999790.003920:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45830 00000100:00100000:2.0:1716999790.003921:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480752640 00000100:00100000:2.0:1716999790.003925:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480752640 00000100:00100000:1.0:1716999790.003925:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+540:11420:x1800404480752512:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:2.0:1716999790.003939:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45831 00000100:00100000:2.0:1716999790.003943:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+541:11419:x1800404480752640:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.003952:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1716999790.003955:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.003964:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364d80/0x6d188eabd8dc6dc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc57:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6611f expref: 541 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.003965:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fa1c0/0x6d188eabd8d7f84c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x714:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50708 expref: 541 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.003977:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091184240/0x6d188eabd8d77c91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x714:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4de9e expref: 539 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.003977:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364900/0x6d188eabd8dc6da7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66111 expref: 539 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.003984:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc57:0x0].0x0 (ffff880131c40100) 00010000:00010000:2.0:1716999790.003986:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009186c6c0/0x6d188eabd8d7f814 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x714:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f506f3 expref: 537 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.003989:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.003995:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092e50fc0/0x6d188eabd8d71e18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x714:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf48 expref: 536 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.004001:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x714:0x0].0x0 (ffff8800941a3b00) 00010000:00010000:2.0:1716999790.004005:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.004005:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc760c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.004012:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc760c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.004013:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7613 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004018:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7613 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.004019:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc760c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.004023:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7613 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.004026:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc761a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.004030:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7621 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x705:0x0].0x853e1088 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.004030:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc761a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.004035:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.004035:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc761a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.004039:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004113:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7628 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x714:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.004118:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc762f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.004122:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7628 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x714:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.004122:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc762f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.004128:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7628 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x714:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.004128:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc762f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00080000:2.0:1716999790.004584:0:6823:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x714:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999790.004619:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11610, 184 off2076040 00010000:00010000:2.0:1716999790.004673:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7628 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x714:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004679:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7628 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x714:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004683:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7628 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x714:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004686:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.004688:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7628 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x714:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004693:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7628 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x714:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004700:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x714:0x0].0x0 (ffff880088977d00) 00010000:00010000:2.0:1716999790.004702:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.004704:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7628 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x714:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004708:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7628 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x714:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004718:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7613 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004723:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7613 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004727:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7613 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004731:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.004733:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7613 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004737:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7613 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004743:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:2.0:1716999790.004744:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.004746:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7613 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.004752:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7613 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x705:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999790.004757:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e441f80 reply state ffff880134aef000 transno 4294986304 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999790.004762:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000004:00080000:1.0:1716999790.004914:0:7785:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0xc57:0x0] is inserted into orphan list, open count = 1 00000040:00080000:1.0:1716999790.004931:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11611, 184 off2076224 00010000:00010000:1.0:1716999790.004976:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc762f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.004981:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc762f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.004985:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc762f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.004988:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b33c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.004990:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc762f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.004994:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc762f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.005000:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc57:0x0].0x0 (ffff8800900d1600) 00010000:00010000:1.0:1716999790.005001:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.005003:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc762f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.005006:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc762f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.005015:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc760c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.005019:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc760c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.005023:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc760c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.005027:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b06c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.005029:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc760c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.005033:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc760c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.005037:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999790.005038:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.005040:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc760c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.005043:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc760c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.005048:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e441c00 reply state ffff8800926ff000 transno 4294986305 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc761a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.005052:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.005160:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+539:11419:x1800404480752640:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1216us (1533us total) trans 4294986304 rc 0/0 00000100:00100000:1.0:1716999790.005160:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+539:11420:x1800404480752512:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1233us (1565us total) trans 4294986305 rc 0/0 00000100:00100000:1.0:1716999790.005166:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45830 00000100:00100000:2.0:1716999790.005222:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45831 00010000:00010000:3.0:1716999790.006248:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc761a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.006255:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc761a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.006261:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc761a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.006265:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.006267:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc761a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.006272:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc761a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.006279:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x6cad4e9d (ffff8800900d1700) 00010000:00010000:3.0:1716999790.006281:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.006283:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc761a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.006286:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc761a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x6cad4e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.006341:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.006346:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7621 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.006350:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7621 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.006353:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.006356:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7621 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.006360:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7621 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x705:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.006366:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x853e1088 (ffff880088977100) 00010000:00010000:2.0:1716999790.006368:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.006370:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7621 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.006373:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7621 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x705:0x0].0x853e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.007232:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.007261:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.007306:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480752768 00000100:00100000:3.0:1716999790.007311:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480752768 00000100:00100000:3.0:1716999790.007338:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480752832 00000100:00100000:3.0:1716999790.007340:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480752832 00000100:00100000:3.0:1716999790.007352:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9230 00000100:00100000:3.0:1716999790.007357:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480752768:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.007368:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9231 00000100:00100000:1.0:1716999790.007373:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480752832:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999790.007628:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+538:11420:x1800404480752768:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 269us (397us total) trans 4294986306 rc 0/0 00000100:00100000:3.0:1716999790.007633:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9230 00000100:00100000:0.0:1716999790.009208:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.009368:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480752832:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 1993us (2105us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.009376:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9231 00000100:00100000:2.0:1716999790.009482:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480752960 00000100:00100000:2.0:1716999790.009487:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480752960 00000100:00100000:2.0:1716999790.009570:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45832 00000100:00100000:2.0:1716999790.009576:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480752960:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.009609:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.009627:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013541ad00/0x6d188eabd8d7fc74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x719:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50858 expref: 537 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.009641:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135418b40/0x6d188eabd8d77e2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x719:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4df31 expref: 536 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.009649:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a640/0x6d188eabd8d7fc3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x719:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5083c expref: 535 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.009670:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419d680/0x6d188eabd8d71f53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x719:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfe2 expref: 534 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.009680:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x719:0x0].0x0 (ffff880094025500) 00010000:00010000:2.0:1716999790.009940:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.009960:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7636 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.009970:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7636 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.009977:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7636 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.009987:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc763d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x863e1088 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.009992:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc763d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.009997:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc763d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010070:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7644 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x719:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010075:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x719:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010081:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x719:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:2.0:1716999790.010439:0:6823:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x719:0x0] is inserted into orphan list, open count = 1 00000040:00080000:2.0:1716999790.010476:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11612, 184 off2076408 00010000:00010000:2.0:1716999790.010533:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7644 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x719:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010539:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7644 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x719:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010543:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7644 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x719:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010547:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.010550:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7644 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x719:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010554:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7644 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x719:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010561:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x719:0x0].0x0 (ffff880088977900) 00010000:00010000:2.0:1716999790.010563:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.010565:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7644 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x719:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010568:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7644 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x719:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010578:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7636 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010581:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7636 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010585:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7636 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010588:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.010590:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7636 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010594:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7636 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010598:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999790.010599:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.010601:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7636 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.010604:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7636 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999790.010609:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e440380 reply state ffff880134ae8000 transno 4294986307 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc763d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999790.010613:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.010681:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480752960:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1104us (1474us total) trans 4294986307 rc 0/0 00000100:00100000:2.0:1716999790.010686:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45832 00000100:00100000:0.0:1716999790.012404:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.012457:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480753024 00000100:00100000:2.0:1716999790.012463:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480753024 00000100:00100000:0.0:1716999790.012469:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999790.012600:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc763d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.012608:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc763d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.012613:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc763d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.012617:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.012620:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc763d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.012624:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc763d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.012634:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x863e1088 (ffff880088977400) 00010000:00010000:3.0:1716999790.012636:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1716999790.012655:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45833 00000100:00100000:2.0:1716999790.012661:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480753024:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:2.0:1716999790.012674:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.012685:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc764b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661e3 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.012721:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7652 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.012733:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7652 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.012736:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc763d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.012740:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7652 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.012741:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc763d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x863e1088 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.012749:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7659 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.012753:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.012758:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999790.012789:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480753152 00000100:00100000:1.0:1716999790.012793:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480753152 00000100:00100000:1.0:1716999790.012833:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9232 00000100:00100000:1.0:1716999790.012838:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eeab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480753152:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:2.0:1716999790.013104:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7660 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6cc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013112:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cc:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013118:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cc:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:2.0:1716999790.013135:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6cc:0x0]: returning size 260096 00000004:00200000:2.0:1716999790.013139:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999790.013149:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cc:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013156:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7660 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013161:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7652 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013169:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7652 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013173:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7652 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013177:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.013179:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7652 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013182:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7652 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013187:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x0 (ffff8800a660c200) 00010000:00010000:2.0:1716999790.013189:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.013191:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7652 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013195:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7652 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013201:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013205:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7659 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013209:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013212:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.013214:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013221:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7659 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013226:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0xec7107a9 (ffff880088977f00) 00010000:00010000:2.0:1716999790.013227:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.013229:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7659 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013233:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7659 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.013252:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc764b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661e3 expref: 537 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.013260:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7660 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661e3 expref: 536 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.013266:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cc:0x0].0x0 (ffff88009c45dc00) 00010000:00010000:2.0:1716999790.013268:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999790.013270:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918321c0, rc 0) 00000100:00100000:2.0:1716999790.013305:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480753024:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 644us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.013311:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45833 00000040:00080000:1.0:1716999790.013401:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11613, 168 off2076576 00000100:00100000:1.0:1716999790.013477:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eeab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480753152:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 638us (1006us total) trans 4294986308 rc 0/0 00000100:00100000:1.0:1716999790.013484:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9232 00000100:00100000:0.0:1716999790.015279:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.015310:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.015352:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.015417:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480753280 00000100:00100000:1.0:1716999790.015423:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480753280 00000100:00100000:1.0:1716999790.015490:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480753408 00000100:00100000:1.0:1716999790.015492:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480753408 00000100:00100000:1.0:1716999790.015562:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9233 00000100:00100000:1.0:1716999790.015568:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480753280:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.015608:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9234 00000100:00100000:3.0:1716999790.015612:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480753408:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.015831:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+539:11420:x1800404480753280:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 263us (554us total) trans 4294986309 rc 0/0 00000100:00100000:1.0:1716999790.015837:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9233 00000100:00100000:1.0:1716999790.015853:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480753472 00000100:00100000:1.0:1716999790.015856:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480753472 00000100:00100000:1.0:1716999790.015898:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45834 00000100:00100000:1.0:1716999790.015903:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+539:11554:x1800404480753472:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:1.0:1716999790.015910:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.015922:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7667 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661ea expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.015940:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ea expref: 540 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.015949:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ea expref: 540 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.015955:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x0 (ffff8800a660c200) 00010000:00010000:1.0:1716999790.015958:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.015960:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b3600, rc 0) 00000040:00080000:2.0:1716999790.015976:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11614, 168 off2076744 00000100:00100000:1.0:1716999790.015976:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+540:11554:x1800404480753472:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 73us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.015980:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45834 00000001:00080000:2.0:1716999790.015981:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986310 00000100:00100000:2.0:1716999790.016029:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+540:11419:x1800404480753408:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 415us (718us total) trans 4294986311 rc 0/0 00000100:00100000:2.0:1716999790.016034:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9234 00000020:00080000:2.0:1716999790.016037:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.017023:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.017057:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.017111:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480753600 00000100:00100000:2.0:1716999790.017115:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480753600 00000100:00100000:2.0:1716999790.017141:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9235 00000100:00100000:2.0:1716999790.017145:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+540:11419:x1800404480753600:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.017225:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+541:11419:x1800404480753600:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 78us (203us total) trans 4294986312 rc 0/0 00000100:00100000:2.0:1716999790.017230:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9235 00000100:00100000:3.0:1716999790.017280:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480753728 00000100:00100000:3.0:1716999790.017285:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480753728 00000100:00100000:3.0:1716999790.017302:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45835 00000100:00100000:3.0:1716999790.017306:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+541:11420:x1800404480753728:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.017327:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.017340:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8d8aa39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x729:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f53bff expref: 541 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.017351:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091364000/0x6d188eabd8d80b00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x729:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50d36 expref: 540 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.017361:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8d80aac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x729:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50d0c expref: 539 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.017369:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f8fc0/0x6d188eabd8d7242a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x729:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c219 expref: 538 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.017376:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x729:0x0].0x0 (ffff88012ecfa900) 00010000:00010000:3.0:1716999790.017382:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.017401:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc766e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.017409:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc766e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.017416:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc766e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.017424:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7675 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x554d0b88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.017430:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7675 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.017435:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7675 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.017671:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc767c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x729:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.017678:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc767c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x729:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.017684:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc767c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x729:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:3.0:1716999790.018088:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1501, 64 off104320 00000040:00080000:3.0:1716999790.018106:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11615, 184 off2076928 00010000:00010000:3.0:1716999790.018153:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7683 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x729:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018161:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7683 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018167:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7683 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018172:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7683 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018176:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7683 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018181:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7683 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018186:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7683 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018195:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51b00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.018198:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7683 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018204:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7683 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018210:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x729:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:3.0:1716999790.018212:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.018219:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7683 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018224:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7683 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x729:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018237:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc767c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x729:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018241:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc767c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x729:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018245:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc767c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x729:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018248:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c506c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.018251:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc767c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x729:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018255:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc767c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x729:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018261:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x729:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:3.0:1716999790.018263:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.018265:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc767c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x729:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018269:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc767c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x729:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018300:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc766e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018305:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc766e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018309:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc766e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018313:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.018315:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc766e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018319:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc766e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018325:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:3.0:1716999790.018326:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.018328:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc766e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018333:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc766e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:3.0:1716999790.018338:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e443100 reply state ffff880089363000 transno 4294986313 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7675 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999790.018343:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.018355:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.018368:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+539:11420:x1800404480753728:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1060us (1310us total) trans 4294986313 rc 0/0 00000100:00100000:3.0:1716999790.018373:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45835 00000100:00100000:1.0:1716999790.018430:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.018436:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480753792 00000100:00100000:0.0:1716999790.018440:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480753792 00000100:00100000:3.0:1716999790.018494:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480753920 00000100:00100000:3.0:1716999790.018497:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480753920 00000100:00100000:3.0:1716999790.018511:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45836 00000100:00100000:3.0:1716999790.018515:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+540:11419:x1800404480753920:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.018533:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1716999790.018543:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7660 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6cc:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661e3 expref: 540 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.018554:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ef600/0x6d188eabd8d79c81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6cc:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4e91e expref: 539 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.018565:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8d7bc16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6cc:0x0].0x0 bits 0xc/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f312 expref: 538 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.018573:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c0240/0x6d188eabd8d7991d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6cc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4e814 expref: 537 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.018581:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cc:0x0].0x0 (ffff88009c45dc00) 00010000:00010000:3.0:1716999790.018590:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7a80/0x6d188eabd8dc6f6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66181 expref: 536 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.018596:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x0 (ffff8800a660c200) 00010000:00010000:3.0:1716999790.018598:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.018608:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.018616:0:6823:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7667 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ea expref: 535 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.018621:0:6823:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.018660:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9236 00000100:00100000:0.0:1716999790.018665:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+535:11554:x1800404480753792:12345-192.168.203.3@tcp:37:ll_sa.0 00010000:00010000:3.0:1716999790.019741:0:6823:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ea expref: 536 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.019752:0:6823:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7667 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ea expref: 536 pid: 7785 timeout: 409 lvb_type: 0 00000100:00100000:3.0:1716999790.019763:0:6823:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131caad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6823:1800404483017152:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999790.019778:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7675 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.019783:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7675 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.019788:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7675 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.019792:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.019794:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7675 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.019811:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7675 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.019821:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x554d0b88 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999790.019822:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.019825:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7675 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.019832:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7675 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x554d0b88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999790.019871:0:6823:0:(client.c:2542:ptlrpc_set_wait()) set ffff880131c0a900 going to sleep for 11 seconds 00000100:00100000:0.0:1716999790.020342:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.020818:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480754048 00000100:00100000:2.0:1716999790.020823:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480754048 00000100:00100000:0.0:1716999790.020924:0:6823:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131caad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6823:1800404483017152:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999790.020939:0:6823:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999790.021231:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9237 00000100:00100000:3.0:1716999790.021237:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480754048:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.021822:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+536:11554:x1800404480753792:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 3155us (3465us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.021829:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9236 00000040:00080000:3.0:1716999790.022000:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11616, 168 off2077096 00000001:00080000:3.0:1716999790.022006:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986314 00000100:00100000:3.0:1716999790.022063:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480754048:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 826us (1722us total) trans 4294986315 rc 0/0 00000100:00100000:3.0:1716999790.022069:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9237 00000020:00080000:3.0:1716999790.022073:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.023097:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.023161:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480754176 00000100:00100000:1.0:1716999790.023166:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480754176 00000100:00100000:1.0:1716999790.023196:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45837 00000100:00100000:1.0:1716999790.023202:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480754176:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.023228:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1716999790.023245:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb7600/0x6d188eabd8dc67db lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc51:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f12 expref: 536 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.023257:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdef40/0x6d188eabd8dc6795 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc51:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65ef6 expref: 535 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.023264:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc51:0x0].0x0 (ffff88012e3f8700) 00010000:00010000:1.0:1716999790.023271:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.023287:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7691 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023296:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7691 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023302:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7691 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023311:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7698 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023316:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7698 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023326:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7698 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023397:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc769f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023403:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc769f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023409:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc769f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:1.0:1716999790.023766:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1503, 64 off104448 00000040:00080000:1.0:1716999790.023781:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11617, 184 off2077280 00010000:00010000:1.0:1716999790.023842:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc76a6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023849:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc76a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023854:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc76a6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023863:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc76a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023867:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc76a6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023872:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc76a6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023876:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc76a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023904:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0900 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.023907:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc76a6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023913:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc76a6 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023920:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc51:0x0].0x0 (ffff8801361a8400) 00010000:00010000:1.0:1716999790.023922:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.023925:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc76a6 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023929:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc76a6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023945:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc769f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023950:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc769f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023954:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc769f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023958:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.023960:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc769f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023965:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc769f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023971:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc51:0x0].0x0 (ffff8801361a8400) 00010000:00010000:1.0:1716999790.023973:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.023975:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc769f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.023979:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc769f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.024028:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7691 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.024033:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7691 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.024037:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7691 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.024040:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b06c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.024043:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7691 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.024047:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7691 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.024053:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999790.024056:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.024058:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7691 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.024062:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7691 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.024068:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e442d80 reply state ffff8800935b0000 transno 4294986316 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7698 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.024073:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.024122:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480754176:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 919us (1025us total) trans 4294986316 rc 0/0 00000100:00100000:1.0:1716999790.024128:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45837 00000100:00100000:0.0:1716999790.024287:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.024322:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.024379:0:6826:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480754240 00000100:00100000:3.0:1716999790.024383:0:6826:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480754240 00000100:00100000:2.0:1716999790.024403:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480754304 00000100:00100000:2.0:1716999790.024407:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480754304 00010000:00010000:2.0:1716999790.024420:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7667 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ea expref: 537 pid: 7785 timeout: 409 lvb_type: 0 00000100:00100000:2.0:1716999790.024444:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4578 00000100:00100000:2.0:1716999790.024448:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+537:1956:x1800404480754304:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999790.024456:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999790.024460:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7667 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ea expref: 537 pid: 7785 timeout: 409 lvb_type: 0 00010000:00010000:2.0:1716999790.024468:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7667 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ea expref: 537 pid: 7785 timeout: 409 lvb_type: 0 00010000:00010000:2.0:1716999790.024479:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7667 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ea expref: 537 pid: 7785 timeout: 409 lvb_type: 0 00010000:00010000:2.0:1716999790.024487:0:16642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x0 (ffff8800a660c200) 00010000:00010000:2.0:1716999790.024491:0:16642:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.024497:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.024501:0:16642:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999790.024579:0:6826:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 12 00000100:00100000:3.0:1716999790.024584:0:6826:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6054450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:107d663a-2216-406b-94c6-b2fcb1558728+536:1959:x1800404480754240:12345-192.168.203.3@tcp:63:ll_sa.0 00010000:00010000:2.0:1716999790.024584:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999790.024600:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+536:1956:x1800404480754304:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 151us (278us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999790.024602:0:6826:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1716999790.024605:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4578 00010000:00010000:3.0:1716999790.024609:0:6826:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc76ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661f1 expref: -99 pid: 6826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.024645:0:6823:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.024650:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.024660:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc76b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.024665:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc76b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.024671:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc76b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.024731:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc76bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6cc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.024737:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc76bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.024742:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc76bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.024791:0:6826:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc76c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024811:0:6826:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc76c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024817:0:6826:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc76c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024829:0:6826:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc76c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024834:0:6826:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc76c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024838:0:6826:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc76c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024877:0:6826:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc76d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ce:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024899:0:6826:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc76d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ce:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024905:0:6826:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc76d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ce:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6826 initiator: MDT0 00000004:00200000:3.0:1716999790.024922:0:6826:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6ce:0x0]: returning size 260096 00000004:00200000:3.0:1716999790.024924:0:6826:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999790.024935:0:6826:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc76d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ce:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024941:0:6826:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc76d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024946:0:6826:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc76c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024950:0:6826:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc76c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024954:0:6826:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc76c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024962:0:6826:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.024964:0:6826:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc76c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024969:0:6826:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc76c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024975:0:6826:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x0 (ffff8800a660c200) 00010000:00010000:3.0:1716999790.024977:0:6826:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.024979:0:6826:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc76c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024983:0:6826:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc76c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024990:0:6826:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc76c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024995:0:6826:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc76c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.024999:0:6826:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc76c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.025002:0:6826:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.025004:0:6826:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc76c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.025008:0:6826:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc76c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.025013:0:6826:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x1ec7ed2b (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.025015:0:6826:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.025017:0:6826:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc76c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.025020:0:6826:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc76c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.025037:0:6826:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc76ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661f1 expref: 537 pid: 6826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.025045:0:6826:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc76d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ce:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661f1 expref: 536 pid: 6826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.025050:0:6826:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ce:0x0].0x0 (ffff88009c45d400) 00010000:00010000:3.0:1716999790.025051:0:6826:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999790.025053:0:6826:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c52ac0, rc 0) 00000100:00100000:3.0:1716999790.025073:0:6826:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6054450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:107d663a-2216-406b-94c6-b2fcb1558728+536:1959:x1800404480754240:12345-192.168.203.3@tcp:63:ll_sa.0 Request processed in 488us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.025078:0:6826:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 12 00000040:00080000:0.0:1716999790.025087:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1504, 64 off104512 00000040:00080000:0.0:1716999790.025100:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11618, 184 off2077464 00010000:00010000:0.0:1716999790.025139:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6cc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025145:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025149:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025154:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025158:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025162:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025166:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025170:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.025172:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025176:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76d7 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025182:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cc:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.025184:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.025186:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76d7 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025189:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6cc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025205:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc76bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025209:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc76bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025213:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc76bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025217:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.025219:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc76bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025223:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc76bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025228:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cc:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.025230:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.025473:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc76bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025479:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc76bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6cc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025508:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025513:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025516:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025520:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.025522:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025526:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025532:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x0 (ffff8800a660c200) 00010000:00010000:0.0:1716999790.025534:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.025536:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.025539:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc768a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999790.025545:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b2d80 reply state ffff880089362000 transno 4294986317 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc76b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.025550:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.025573:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480753920:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 7057us (7143us total) trans 4294986317 rc 0/0 00000100:00100000:0.0:1716999790.025579:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45836 00010000:00010000:2.0:1716999790.026442:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7698 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.026463:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7698 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.026467:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7698 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.026471:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b33c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.026474:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7698 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.026479:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7698 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.026486:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x778ea4fb (ffff8801361a8700) 00010000:00010000:2.0:1716999790.026488:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.026490:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7698 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.026494:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7698 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x778ea4fb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.027566:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc76b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.027573:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc76b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.027578:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc76b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.027582:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.027585:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc76b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.027593:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc76b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.027601:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0xec7107a9 (ffff88008a83f200) 00010000:00010000:3.0:1716999790.027603:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.027605:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc76b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.027609:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc76b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ca:0x0].0xec7107a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.028371:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.028398:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.028486:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480754560 00000100:00100000:1.0:1716999790.028486:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480754432 00000100:00100000:3.0:1716999790.028492:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480754560 00000100:00100000:1.0:1716999790.028492:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480754432 00000100:00100000:1.0:1716999790.028527:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9238 00000100:00100000:3.0:1716999790.028532:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9239 00000100:00100000:1.0:1716999790.028533:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eeab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480754432:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.028536:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480754560:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.028685:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eeab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+538:11420:x1800404480754432:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 151us (314us total) trans 4294986318 rc 0/0 00000100:00100000:1.0:1716999790.028690:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9238 00000040:00080000:3.0:1716999790.028825:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11619, 168 off2077632 00000001:00080000:3.0:1716999790.028830:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986319 00000100:00100000:3.0:1716999790.028876:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+538:11419:x1800404480754560:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 339us (477us total) trans 4294986320 rc 0/0 00000100:00100000:3.0:1716999790.028918:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9239 00000020:00080000:3.0:1716999790.028921:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.029855:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.030338:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.030401:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480754688 00000100:00100000:3.0:1716999790.030405:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480754688 00000100:00100000:3.0:1716999790.030432:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480754816 00000100:00100000:3.0:1716999790.030435:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480754816 00000100:00100000:3.0:1716999790.030453:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9240 00000100:00100000:3.0:1716999790.030457:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+539:11420:x1800404480754688:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.030457:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9241 00000100:00100000:2.0:1716999790.030461:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+539:11419:x1800404480754816:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.030560:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+540:11419:x1800404480754816:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 97us (221us total) trans 4294986321 rc 0/0 00000100:00100000:2.0:1716999790.030566:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9241 00000040:00080000:3.0:1716999790.030755:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11620, 168 off2077800 00000100:00100000:3.0:1716999790.030970:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+540:11420:x1800404480754688:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 510us (1169us total) trans 4294986322 rc 0/0 00000100:00100000:3.0:1716999790.030976:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9240 00000100:00100000:2.0:1716999790.032317:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.032337:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480754944 00000100:00100000:0.0:1716999790.032341:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480754944 00000100:00100000:2.0:1716999790.032343:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.032379:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480755072 00000100:00100000:1.0:1716999790.032383:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480755072 00000100:00100000:0.0:1716999790.032473:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45838 00000100:00100000:0.0:1716999790.032478:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+541:11419:x1800404480754944:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.032508:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999790.032525:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc76d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ce:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661f1 expref: 541 pid: 6826 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.032539:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8d7b984 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ce:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f240 expref: 540 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.032549:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901f80/0x6d188eabd8d7be70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ce:0x0].0x0 bits 0xc/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f3ba expref: 539 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.032557:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d680/0x6d188eabd8d7b6ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ce:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f14b expref: 538 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.032564:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ce:0x0].0x0 (ffff88009c45d400) 00010000:00010000:0.0:1716999790.032572:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.032589:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.032598:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.032604:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.032614:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc76e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.032619:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc76e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.032624:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc76e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.032702:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc76ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6ce:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.032708:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc76ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.032714:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc76ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999790.033101:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45839 00000100:00100000:1.0:1716999790.033107:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480755072:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.033128:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.033138:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905da400/0x6d188eabd8d80dbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72b:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50e24 expref: 537 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.033153:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb986c0/0x6d188eabd8d79263 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x72b:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4e5d6 expref: 536 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.033165:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905d9d40/0x6d188eabd8d80cff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72b:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50dec expref: 535 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.033174:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8902640/0x6d188eabd8d724e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c26d expref: 534 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.033181:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72b:0x0].0x0 (ffff880131c40a00) 00010000:00010000:1.0:1716999790.033188:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.033199:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc76f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.033206:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc76f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.033212:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc76f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.033219:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc76fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0xa149fd88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.033224:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc76fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.033229:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc76fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.033283:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7701 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x72b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.033288:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7701 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.033297:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7701 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:1.0:1716999790.033983:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1502, 64 off104384 00000040:00080000:1.0:1716999790.034004:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11621, 184 off2077984 00010000:00010000:1.0:1716999790.034057:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7708 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x72b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034064:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7708 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034071:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7708 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034076:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7708 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x72b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034080:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7708 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x72b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034085:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7708 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x72b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034090:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7708 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x72b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034095:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.034098:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7708 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x72b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034103:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7708 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x72b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034111:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72b:0x0].0x0 (ffff8800a6ad7c00) 00010000:00010000:1.0:1716999790.034114:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.034116:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7708 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x72b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034120:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7708 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x72b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034138:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7701 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034142:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7701 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x72b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034146:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7701 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034150:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.034153:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7701 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034157:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7701 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x72b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034162:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72b:0x0].0x0 (ffff8800a6ad7c00) 00010000:00010000:1.0:1716999790.034164:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.034166:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7701 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x72b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034171:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7701 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x72b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034207:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc76f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034212:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc76f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034216:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc76f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034220:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.034222:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc76f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034227:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc76f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034233:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:1.0:1716999790.034235:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.034237:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc76f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.034241:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc76f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.034247:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88013502b100 reply state ffff8800935b2000 transno 4294986323 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc76fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.034253:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.034313:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480755072:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1204us (1967us total) trans 4294986323 rc 0/0 00000100:00100000:1.0:1716999790.034319:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45839 00000040:00080000:0.0:1716999790.034583:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1505, 64 off104576 00000040:00080000:0.0:1716999790.034595:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11622, 184 off2078168 00010000:00010000:0.0:1716999790.034639:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc770f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ce:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034646:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc770f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034652:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc770f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034656:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc770f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034660:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc770f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034664:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc770f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034672:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc770f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034676:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.034678:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc770f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034682:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc770f lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034688:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ce:0x0].0x0 (ffff88008a83f700) 00010000:00010000:0.0:1716999790.034690:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.034692:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc770f lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034696:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc770f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ce:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034710:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc76ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034714:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc76ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6ce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034719:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc76ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034722:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.034724:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc76ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034728:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc76ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6ce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034736:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ce:0x0].0x0 (ffff88008a83f700) 00010000:00010000:0.0:1716999790.034738:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.034740:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc76ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6ce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034743:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc76ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6ce:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034768:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034772:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034776:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034779:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.034781:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034785:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034790:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x0 (ffff8800a660c200) 00010000:00010000:0.0:1716999790.034792:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.034794:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76de lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.034798:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc76de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ca:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999790.034816:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135029500 reply state ffff8800b5236000 transno 4294986324 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc76e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.034821:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.034849:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480754944:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2370us (2534us total) trans 4294986324 rc 0/0 00000100:00100000:0.0:1716999790.034855:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45838 00010000:00010000:2.0:1716999790.035825:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc76fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.035832:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc76fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.035836:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc76fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.035839:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.035842:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc76fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.035846:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc76fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.035853:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0xa149fd88 (ffff8801361a8a00) 00010000:00010000:2.0:1716999790.035855:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.035857:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc76fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.035861:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc76fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0xa149fd88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.037324:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc76e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.037333:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc76e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.037338:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc76e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.037343:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.037346:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc76e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.037351:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc76e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.037365:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x1ec7ed2b (ffff88008a83f600) 00010000:00010000:3.0:1716999790.037367:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.037370:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc76e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.037374:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc76e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ca:0x0].0x1ec7ed2b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.038873:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.039608:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.039629:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480755200 00000100:00100000:3.0:1716999790.039635:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480755200 00000100:00100000:3.0:1716999790.040138:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480755264 00000100:00100000:3.0:1716999790.040142:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480755264 00000100:00100000:3.0:1716999790.040172:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9242 00000100:00100000:3.0:1716999790.040179:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480755200:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.040295:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9243 00000100:00100000:2.0:1716999790.040300:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480755264:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999790.040491:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480755200:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 312us (1622us total) trans 4294986325 rc 0/0 00000100:00100000:3.0:1716999790.040498:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9242 00000100:00100000:2.0:1716999790.042866:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480755264:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 2557us (3250us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.042875:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9243 00000100:00100000:0.0:1716999790.042966:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.042983:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480755392 00000100:00100000:0.0:1716999790.043145:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480755392 00000100:00100000:0.0:1716999790.043172:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45840 00000100:00100000:0.0:1716999790.043177:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480755392:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.043214:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999790.043232:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801331406c0/0x6d188eabd8d7fa36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x717:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5079b expref: 535 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.043247:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216cfc0/0x6d188eabd8d77e19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x717:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4df2a expref: 534 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.043256:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133141b00/0x6d188eabd8d7f9f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x717:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5078d expref: 533 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.043265:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339fb840/0x6d188eabd8d71eb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x717:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf95 expref: 532 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.043271:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x717:0x0].0x0 (ffff880136963e00) 00010000:00010000:0.0:1716999790.043281:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.043300:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7716 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043310:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7716 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043317:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7716 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043326:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc771d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x863e0f88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043330:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc771d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043334:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc771d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043408:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7724 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x717:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043414:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7724 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x717:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043420:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7724 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x717:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00080000:0.0:1716999790.043787:0:6823:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x717:0x0] is inserted into orphan list, open count = 1 00000040:00080000:0.0:1716999790.043839:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11623, 184 off2078352 00010000:00010000:0.0:1716999790.043921:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7724 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x717:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043927:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7724 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x717:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043932:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7724 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x717:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043940:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.043944:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7724 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x717:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043949:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7724 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x717:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043956:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x717:0x0].0x0 (ffff88008a83f500) 00010000:00010000:0.0:1716999790.043959:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.043962:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7724 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x717:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043966:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7724 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x717:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043976:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7716 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043981:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7716 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043985:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7716 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043988:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.043990:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7716 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043993:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7716 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.043998:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999790.044000:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.044002:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7716 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.044006:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7716 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999790.044013:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af53100 reply state ffff880133934000 transno 4294986326 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc771d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.044018:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.044049:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480755392:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 871us (1083us total) trans 4294986326 rc 0/0 00000100:00100000:0.0:1716999790.044055:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45840 00010000:00010000:2.0:1716999790.046665:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc771d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.046676:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc771d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.046681:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc771d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.046685:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.046688:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc771d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.046693:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc771d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.046703:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x863e0f88 (ffff88008a83fb00) 00010000:00010000:2.0:1716999790.046705:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.046707:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc771d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.046711:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc771d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x863e0f88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999790.048335:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.048742:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480755520 00000100:00100000:0.0:1716999790.048749:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480755520 00000100:00100000:0.0:1716999790.050328:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9244 00000100:00100000:0.0:1716999790.050337:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eeab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480755520:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.050407:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.050468:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480755648 00000100:00100000:0.0:1716999790.050472:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480755648 00000100:00100000:0.0:1716999790.050503:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9245 00000100:00100000:0.0:1716999790.050507:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480755648:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999790.050844:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11624, 168 off2078520 00000001:00080000:0.0:1716999790.050848:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986327 00000100:00100000:0.0:1716999790.050926:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480755648:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 418us (518us total) trans 4294986328 rc 0/0 00000100:00100000:0.0:1716999790.050932:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9245 00000020:00080000:0.0:1716999790.050935:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:0.0:1716999790.051071:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986329 00000100:00100000:0.0:1716999790.051107:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eeab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480755520:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 772us (2777us total) trans 4294986330 rc 0/0 00000100:00100000:0.0:1716999790.051115:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9244 00000020:00080000:0.0:1716999790.051117:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999790.053020:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.053040:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.053061:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.053373:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480755712 00000100:00100000:0.0:1716999790.053379:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480755712 00000100:00100000:3.0:1716999790.053678:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480755840 00000100:00100000:3.0:1716999790.053682:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480755840 00000100:00100000:3.0:1716999790.053710:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9246 00000100:00100000:3.0:1716999790.053716:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480755840:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.053779:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480755968 00000100:00100000:0.0:1716999790.053783:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480755968 00000100:00100000:0.0:1716999790.053813:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45841 00000100:00100000:0.0:1716999790.053818:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+538:11556:x1800404480755712:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:0.0:1716999790.053826:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999790.053840:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc772b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661f8 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.053862:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc772b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661f8 expref: 539 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.053872:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc772b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661f8 expref: 539 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.053898:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x0 (ffff8800910ceb00) 00010000:00010000:0.0:1716999790.053901:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.053904:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133600, rc 0) 00000100:00100000:0.0:1716999790.053944:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+539:11556:x1800404480755712:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 125us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.053949:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45841 00000100:00100000:0.0:1716999790.053962:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45842 00000100:00100000:0.0:1716999790.053966:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+538:11420:x1800404480755968:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.053988:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999790.054001:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133142d00/0x6d188eabd8d7f2c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x70f:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50548 expref: 538 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.054014:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216c000/0x6d188eabd8d771c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x70f:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4dad8 expref: 537 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.054023:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb9ba80/0x6d188eabd8d7f2b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50541 expref: 536 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.054034:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f98c0/0x6d188eabd8d71c3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x70f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be7d expref: 535 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.054040:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70f:0x0].0x0 (ffff8800a6ad7000) 00010000:00010000:0.0:1716999790.054045:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.054062:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7732 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.054069:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7732 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.054075:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7732 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.054085:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7739 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x704:0x0].0x5538fb88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.054090:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.054094:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.054168:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7740 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x70f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.054174:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7740 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.054179:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7740 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.054749:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480755840:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1032us (1685us total) trans 4294986331 rc 0/0 00000100:00100000:3.0:1716999790.054756:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9246 00000004:00080000:0.0:1716999790.057268:0:7785:0:(mdd_dir.c:1774:mdd_finish_unlink()) Object [0x200000401:0x70f:0x0] is inserted into orphan list, open count = 1 00000040:00080000:0.0:1716999790.057314:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11625, 184 off2078704 00010000:00010000:0.0:1716999790.057383:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7740 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x70f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057391:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7740 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x70f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057397:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7740 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057402:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.057405:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7740 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x70f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057410:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7740 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x70f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057421:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70f:0x0].0x0 (ffff88008a83f200) 00010000:00010000:0.0:1716999790.057423:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.057426:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7740 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x70f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057430:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7740 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x70f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057444:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7732 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057449:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7732 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057453:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7732 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057456:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.057458:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7732 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057462:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7732 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057467:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999790.057469:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.057471:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7732 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.057475:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7732 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x704:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999790.057482:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135029880 reply state ffff880133935000 transno 4294986332 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.057489:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.057553:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480755968:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3583us (4508us total) trans 4294986332 rc 0/0 00000100:00100000:0.0:1716999790.057560:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45842 00000100:00100000:2.0:1716999790.057702:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.057756:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.057810:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480756160 00000100:00100000:1.0:1716999790.057816:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480756160 00000100:00100000:3.0:1716999790.057831:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480756032 00000100:00100000:3.0:1716999790.057834:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480756032 00000100:00100000:1.0:1716999790.057843:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45843 00000100:00100000:3.0:1716999790.057848:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9247 00000100:00100000:1.0:1716999790.057849:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480756160:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:3.0:1716999790.057852:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+537:11556:x1800404480756032:12345-192.168.203.3@tcp:37:ll_sa.0 00010000:00010000:1.0:1716999790.057898:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1716999790.057912:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008efb4fc0/0x6d188eabd8d82e62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ff:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5185e expref: 537 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.057928:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963ef40/0x6d188eabd8d7e8d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ff:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f501e4 expref: 536 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.057940:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009186db00/0x6d188eabd8d7e8af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ff:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f501d6 expref: 535 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.057951:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68900/0x6d188eabd8d71726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ff:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc5b expref: 534 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.057968:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ff:0x0].0x0 (ffff88012de9c500) 00010000:00010000:1.0:1716999790.057978:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf46c0/0x6d188eabd8dc6f8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66188 expref: 533 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.057985:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x0 (ffff8800910ceb00) 00010000:00010000:1.0:1716999790.057987:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.058003:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.058012:0:6822:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc772b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661f8 expref: 532 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.058018:0:6822:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.058039:0:6822:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc772b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661f8 expref: 532 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.058048:0:6822:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc772b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661f8 expref: 532 pid: 7785 timeout: 409 lvb_type: 0 00000100:00100000:1.0:1716999790.058058:0:6822:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800917b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6822:1800404483017216:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999790.058087:0:6822:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093698300 going to sleep for 11 seconds 00000100:00100000:2.0:1716999790.061836:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11556:x1800404480756032:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 3973us (4126us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.061846:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9247 00010000:00010000:0.0:1716999790.062149:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x704:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.062158:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7739 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.062164:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.062169:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.062172:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.062178:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7739 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x704:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.062189:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x5538fb88 (ffff88008a83f700) 00010000:00010000:0.0:1716999790.062191:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.062194:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7739 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.062199:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7739 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x704:0x0].0x5538fb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.063348:0:6822:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800917b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6822:1800404483017216:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999790.063368:0:6822:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.064426:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.065357:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480756224 00000100:00100000:2.0:1716999790.065364:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480756224 00000100:00100000:2.0:1716999790.065553:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9248 00000100:00100000:2.0:1716999790.065560:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+531:11420:x1800404480756224:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999790.066476:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.066530:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480756288 00000100:00100000:3.0:1716999790.066535:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480756288 00010000:00010000:3.0:1716999790.066552:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc772b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661f8 expref: 532 pid: 7785 timeout: 409 lvb_type: 0 00000100:00100000:3.0:1716999790.066576:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4579 00000100:00100000:3.0:1716999790.066580:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+532:1957:x1800404480756288:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999790.066588:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999790.066593:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc772b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661f8 expref: 532 pid: 7785 timeout: 409 lvb_type: 0 00010000:00010000:3.0:1716999790.066607:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc772b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661f8 expref: 532 pid: 7785 timeout: 409 lvb_type: 0 00010000:00010000:3.0:1716999790.066627:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc772b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661f8 expref: 532 pid: 7785 timeout: 409 lvb_type: 0 00010000:00010000:3.0:1716999790.066640:0:16642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x0 (ffff8800910ceb00) 00010000:00010000:3.0:1716999790.066644:0:16642:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.066652:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.066657:0:16642:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.066670:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.066679:0:6822:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.066685:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.066698:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc774e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6fd:0x0].0x582e84a0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.066700:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+531:1957:x1800404480756288:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 119us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.066705:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4579 00010000:00010000:0.0:1716999790.066705:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc774e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.066711:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc774e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.066781:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7755 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6ff:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.066787:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7755 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.066793:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7755 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:0.0:1716999790.068784:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1503, 64 off104448 00000040:00080000:0.0:1716999790.068814:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11626, 176 off2078880 00010000:00010000:0.0:1716999790.068872:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc775c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ff:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.068908:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc775c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.068916:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc775c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.068922:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc775c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.068926:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc775c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.068930:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc775c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.068935:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc775c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069044:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.069048:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc775c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069053:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc775c lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069061:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ff:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.069063:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.069065:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc775c lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069069:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc775c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ff:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069090:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7755 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069094:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7755 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069098:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7755 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069101:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.069103:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7755 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069107:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7755 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069111:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ff:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.069113:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.069115:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7755 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069118:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7755 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6ff:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069154:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069158:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069162:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069165:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b18c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.069167:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069170:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069174:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x0 (ffff8800910ceb00) 00010000:00010000:0.0:1716999790.069175:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.069177:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.069181:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7747 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:0.0:1716999790.069186:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88013502ad80 reply state ffff8800935b3000 transno 4294986333 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc774e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.069191:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.069494:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480756160:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 11642us (11734us total) trans 4294986333 rc 0/0 00000100:00100000:0.0:1716999790.069501:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45843 00000100:00100000:2.0:1716999790.069504:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480756224:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3944us (5079us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.069511:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9248 00010000:00010000:2.0:1716999790.071966:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc774e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.071975:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc774e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.071980:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc774e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.071985:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.071988:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc774e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.071993:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc774e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.072003:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x582e84a0 (ffff88008a83fa00) 00010000:00010000:2.0:1716999790.072005:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.072008:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc774e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6fd:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.072011:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc774e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6fd:0x0].0x582e84a0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.073182:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.073223:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480756416 00000100:00100000:2.0:1716999790.073230:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480756416 00000100:00100000:2.0:1716999790.073267:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9249 00000100:00100000:2.0:1716999790.073272:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eeaac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+530:11419:x1800404480756416:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999790.073661:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11627, 168 off2079048 00000001:00080000:2.0:1716999790.073667:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986334 00000100:00100000:2.0:1716999790.073739:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eeaac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480756416:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 465us (559us total) trans 4294986335 rc 0/0 00000100:00100000:2.0:1716999790.073746:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9249 00000020:00080000:2.0:1716999790.073751:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.074670:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.075095:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480756544 00000100:00100000:2.0:1716999790.075100:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480756544 00000100:00100000:2.0:1716999790.075301:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9250 00000100:00100000:2.0:1716999790.075307:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480756544:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.075519:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480756544:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 211us (849us total) trans 4294986336 rc 0/0 00000100:00100000:2.0:1716999790.075526:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9250 00000100:00100000:0.0:1716999790.078234:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.078826:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480756672 00000100:00100000:3.0:1716999790.078833:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480756672 00000100:00100000:3.0:1716999790.078872:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9251 00000100:00100000:3.0:1716999790.078893:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480756672:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999790.079256:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11628, 168 off2079216 00000001:00080000:3.0:1716999790.079261:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986337 00000100:00100000:3.0:1716999790.079331:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480756672:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 452us (1100us total) trans 4294986338 rc 0/0 00000100:00100000:3.0:1716999790.079340:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9251 00000020:00080000:3.0:1716999790.079344:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.079404:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.079599:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480756800 00000100:00100000:2.0:1716999790.079604:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480756800 00000100:00100000:2.0:1716999790.079624:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45844 00000100:00100000:2.0:1716999790.079629:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480756800:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.079651:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.079670:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093538fc0/0x6d188eabd8d850ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x703:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52324 expref: 535 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.079685:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0480/0x6d188eabd8d7ea22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x703:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50254 expref: 534 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.079695:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2880/0x6d188eabd8d7e9ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x703:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50246 expref: 533 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.079704:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef2f40/0x6d188eabd8d71853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x703:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bce0 expref: 532 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.079712:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x703:0x0].0x0 (ffff88012ca38800) 00010000:00010000:2.0:1716999790.079719:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.079736:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7763 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.079745:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7763 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.079752:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7763 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.079760:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc776a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6fd:0x0].0x396e6a5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.079764:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc776a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.079771:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc776a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.079844:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7771 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x703:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.079849:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x703:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.079854:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x703:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:2.0:1716999790.080208:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1504, 64 off104512 00000004:00080000:2.0:1716999790.080213:0:6822:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309279332241ns, next at 310279331334ns, rc = 0 00000040:00080000:2.0:1716999790.080225:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11629, 184 off2079400 00010000:00010000:2.0:1716999790.080263:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7778 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x703:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080269:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7778 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x703:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080274:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7778 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x703:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080279:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7778 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x703:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080283:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7778 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x703:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080287:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7778 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x703:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080292:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7778 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x703:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080297:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.080299:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7778 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x703:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080305:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7778 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x703:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080311:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x703:0x0].0x0 (ffff880088977d00) 00010000:00010000:2.0:1716999790.080312:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.080314:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7778 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x703:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080318:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7778 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x703:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080330:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x703:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080334:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7771 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x703:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080338:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7771 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x703:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080341:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.080343:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7771 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x703:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080346:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7771 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x703:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080351:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x703:0x0].0x0 (ffff880088977d00) 00010000:00010000:2.0:1716999790.080353:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.080355:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7771 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x703:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080359:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7771 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x703:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080388:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7763 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080392:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7763 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080396:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7763 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080399:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.080401:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7763 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080406:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7763 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080411:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x0 (ffff8800910ceb00) 00010000:00010000:2.0:1716999790.080412:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.080414:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7763 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.080417:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7763 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999790.080423:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af52d80 reply state ffff88009983c000 transno 4294986339 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc776a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999790.080428:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.080461:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480756800:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 830us (1055us total) trans 4294986339 rc 0/0 00000100:00100000:2.0:1716999790.080466:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45844 00000100:00100000:0.0:1716999790.083291:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.083350:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480756928 00000100:00100000:1.0:1716999790.083357:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480756928 00000100:00100000:1.0:1716999790.083397:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9252 00000100:00100000:1.0:1716999790.083403:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480756928:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.083621:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480756928:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 216us (335us total) trans 4294986340 rc 0/0 00000100:00100000:1.0:1716999790.083627:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9252 00010000:00010000:2.0:1716999790.084216:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc776a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.084225:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc776a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.084230:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc776a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.084235:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.084239:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc776a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.084244:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc776a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.084255:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x396e6a5e (ffff880088977100) 00010000:00010000:2.0:1716999790.084258:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.084261:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc776a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6fd:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.084265:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc776a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6fd:0x0].0x396e6a5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.086331:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.086380:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.086511:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480757056 00000100:00100000:1.0:1716999790.086519:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480757056 00000100:00100000:2.0:1716999790.086526:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480757184 00000100:00100000:2.0:1716999790.086530:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480757184 00000100:00100000:2.0:1716999790.086549:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45845 00000100:00100000:2.0:1716999790.086554:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480757184:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.086591:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00000100:00100000:1.0:1716999790.086705:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9253 00000100:00100000:1.0:1716999790.086710:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+534:11419:x1800404480757056:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:2.0:1716999790.086766:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6880/0x6d188eabd8d7ffa7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ed:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50977 expref: 534 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.086782:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3cc0/0x6d188eabd8d7da5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ed:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fd22 expref: 533 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.086797:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8d7d989 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ed:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fcd5 expref: 532 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.086835:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8f600/0x6d188eabd8d710ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ed:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9d7 expref: 531 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.086842:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ed:0x0].0x0 (ffff88012bacdf00) 00010000:00010000:2.0:1716999790.086851:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012face640/0x6d188eabd8dc6ea3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6615e expref: 530 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.086858:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:2.0:1716999790.086860:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.086877:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc777f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00000040:00080000:1.0:1716999790.087096:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11630, 168 off2079568 00000001:00080000:1.0:1716999790.087102:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986341 00000100:00100000:1.0:1716999790.087165:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480757056:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 454us (839us total) trans 4294986342 rc 0/0 00000100:00100000:1.0:1716999790.087171:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9253 00000020:00080000:1.0:1716999790.087175:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1716999790.087330:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc777f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087340:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc777f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087350:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7786 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dd:0x0].0xf9a88606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087356:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7786 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087364:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7786 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087434:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc778d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6ed:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087440:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc778d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087446:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc778d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:2.0:1716999790.087735:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1505, 64 off104576 00000040:00080000:2.0:1716999790.087746:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11631, 184 off2079752 00010000:00010000:2.0:1716999790.087781:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7794 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087788:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087793:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7794 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087797:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7794 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087814:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7794 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087818:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7794 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087823:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7794 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087831:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833a80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.087833:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7794 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087839:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7794 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087845:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ed:0x0].0x0 (ffff880088977900) 00010000:00010000:2.0:1716999790.087848:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.087850:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7794 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087854:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7794 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ed:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087870:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc778d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087874:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc778d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087895:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc778d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087900:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918321c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.087902:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc778d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087907:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc778d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087913:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ed:0x0].0x0 (ffff880088977900) 00010000:00010000:2.0:1716999790.087914:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.087917:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc778d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087920:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc778d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6ed:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087955:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc777f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087960:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc777f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087964:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc777f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087968:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.087969:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc777f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087974:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc777f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087979:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:2.0:1716999790.087981:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.087983:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc777f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.087986:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc777f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999790.087992:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af53480 reply state ffff880099838000 transno 4294986343 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7786 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999790.087997:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.088027:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480757184:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1472us (1646us total) trans 4294986343 rc 0/0 00000100:00100000:2.0:1716999790.088033:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45845 00000100:00100000:0.0:1716999790.090311:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.090364:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480757312 00000100:00100000:3.0:1716999790.090370:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480757312 00000100:00100000:3.0:1716999790.090408:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9254 00000100:00100000:3.0:1716999790.090414:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480757312:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.090555:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480757312:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 141us (249us total) trans 4294986344 rc 0/0 00000100:00100000:3.0:1716999790.090562:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9254 00010000:00010000:0.0:1716999790.092192:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7786 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.092202:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7786 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.092207:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7786 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.092211:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.092215:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7786 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.092220:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7786 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.092231:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0xf9a88606 (ffff880088977300) 00010000:00010000:0.0:1716999790.092234:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.092236:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7786 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.092240:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7786 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.092619:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.093474:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.093512:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480757568 00000100:00100000:1.0:1716999790.093518:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480757568 00000100:00100000:2.0:1716999790.093549:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480757440 00000100:00100000:2.0:1716999790.093552:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480757440 00000100:00100000:2.0:1716999790.093574:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45846 00000100:00100000:2.0:1716999790.093579:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480757440:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.093611:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.093659:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8d84d80 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x701:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52213 expref: 533 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.093675:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009186c240/0x6d188eabd8d7e97a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x701:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5021c expref: 532 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.093684:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8d7e957 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x701:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5020e expref: 531 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.093692:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fad00/0x6d188eabd8d717b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x701:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc9a expref: 530 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.093698:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x701:0x0].0x0 (ffff88009a33ca00) 00010000:00010000:2.0:1716999790.093704:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.093723:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc779b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.093731:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc779b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.093737:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc779b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.093747:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc77a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6fd:0x0].0x261139b2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.093751:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc77a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.093755:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc77a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.093837:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc77a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x701:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.093842:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc77a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x701:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.093846:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc77a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x701:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999790.094146:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9255 00000100:00100000:1.0:1716999790.094152:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eeaa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+529:11420:x1800404480757568:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999790.094246:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1506, 64 off104640 00000040:00080000:2.0:1716999790.094262:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11632, 184 off2079936 00010000:00010000:2.0:1716999790.094301:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc77b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x701:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094308:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc77b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x701:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094314:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc77b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x701:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094319:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc77b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x701:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094323:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc77b0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x701:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094331:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc77b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x701:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094336:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc77b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x701:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094339:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.094342:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc77b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x701:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094347:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc77b0 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x701:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00000001:00080000:1.0:1716999790.094347:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986345 00010000:00010000:2.0:1716999790.094353:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x701:0x0].0x0 (ffff880088977f00) 00010000:00010000:2.0:1716999790.094355:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.094357:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc77b0 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x701:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094362:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc77b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x701:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094377:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc77a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x701:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094382:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc77a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x701:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094386:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc77a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x701:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094390:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.094392:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc77a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x701:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094400:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc77a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x701:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094405:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x701:0x0].0x0 (ffff880088977f00) 00010000:00010000:2.0:1716999790.094407:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.094409:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc77a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x701:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094413:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc77a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x701:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094444:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc779b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00000040:00080000:1.0:1716999790.094447:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11633, 168 off2080104 00010000:00010000:2.0:1716999790.094449:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc779b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00000001:00080000:1.0:1716999790.094450:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986347 00010000:00010000:2.0:1716999790.094454:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc779b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094457:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918306c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.094459:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc779b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094464:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc779b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094469:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x0 (ffff8800910ceb00) 00010000:00010000:2.0:1716999790.094471:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.094473:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc779b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.094477:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc779b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6fd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999790.094483:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af53800 reply state ffff880099839000 transno 4294986346 ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc77a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999790.094487:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.094520:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eeaa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480757568:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 367us (1046us total) trans 4294986348 rc 0/0 00000100:00100000:1.0:1716999790.094527:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9255 00000020:00080000:1.0:1716999790.094531:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1716999790.095590:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480757440:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2008us (2970us total) trans 4294986346 rc 0/0 00000100:00100000:2.0:1716999790.095596:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45846 00010000:00010000:1.0:1716999790.095821:0:11316:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1716999790.097780:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc77a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.097790:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc77a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.097795:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc77a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.097808:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.097811:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc77a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.097817:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc77a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6fd:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.097827:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x261139b2 (ffff880088977700) 00010000:00010000:3.0:1716999790.097830:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.097833:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc77a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6fd:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.097840:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc77a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6fd:0x0].0x261139b2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.097905:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.097948:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480757696 00000100:00100000:1.0:1716999790.097954:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480757696 00000100:00100000:1.0:1716999790.098158:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9256 00000100:00100000:1.0:1716999790.098164:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480757696:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.098530:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480757696:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 365us (627us total) trans 4294986349 rc 0/0 00000100:00100000:1.0:1716999790.098536:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9256 00000100:00100000:0.0:1716999790.101786:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.101837:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480757760 00000100:00100000:1.0:1716999790.101843:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480757760 00000100:00100000:1.0:1716999790.102071:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9257 00000100:00100000:1.0:1716999790.102078:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480757760:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999790.102260:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.102354:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480757888 00000100:00100000:2.0:1716999790.102359:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480757888 00000100:00100000:2.0:1716999790.102378:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45847 00000100:00100000:2.0:1716999790.102382:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480757888:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.102409:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.102426:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8d80d45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6e1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50df3 expref: 534 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.102440:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d58c0/0x6d188eabd8d7cfd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6e1:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f9c5 expref: 533 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.102449:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d7cc0/0x6d188eabd8d7cfa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f9a9 expref: 532 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.102458:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091184d80/0x6d188eabd8d70d5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b841 expref: 531 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.102465:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e1:0x0].0x0 (ffff880091e2d800) 00010000:00010000:2.0:1716999790.102471:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.102487:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc77b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.102497:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc77b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.102504:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc77b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.102511:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dd:0x0].0xf61990e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.102515:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.102519:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.102588:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc77c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.102593:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc77c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.102597:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc77c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:2.0:1716999790.102972:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1507, 64 off104704 00000040:00080000:2.0:1716999790.102990:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11634, 184 off2080288 00010000:00010000:2.0:1716999790.103038:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc77cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103044:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc77cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103050:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc77cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103058:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc77cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103061:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc77cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103066:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc77cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103070:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc77cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103075:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833a80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.103078:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc77cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103083:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc77cc lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103089:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e1:0x0].0x0 (ffff880088977900) 00010000:00010000:2.0:1716999790.103092:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.103094:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc77cc lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103098:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc77cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103115:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc77c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103119:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc77c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103123:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc77c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103128:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918321c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.103130:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc77c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103135:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc77c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103140:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e1:0x0].0x0 (ffff880088977900) 00010000:00010000:2.0:1716999790.103142:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.103144:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc77c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103147:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc77c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103183:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc77b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103187:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc77b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103191:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc77b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103195:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.103197:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc77b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103201:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc77b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103207:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:2.0:1716999790.103208:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.103211:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc77b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.103215:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc77b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999790.103221:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af50380 reply state ffff88008b77f000 transno 4294986350 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999790.103226:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.103271:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480757888:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 887us (1010us total) trans 4294986350 rc 0/0 00000100:00100000:2.0:1716999790.103277:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45847 00000100:00100000:1.0:1716999790.105988:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480757760:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 3904us (4200us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.105996:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9257 00000100:00100000:0.0:1716999790.107570:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999790.107637:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.107646:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.107651:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.107656:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.107659:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.107665:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.107676:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0xf61990e9 (ffff880088977300) 00010000:00010000:2.0:1716999790.107679:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.107681:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.107689:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999790.112020:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480758016 00000100:00100000:1.0:1716999790.112030:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480758016 00000100:00100000:1.0:1716999790.112065:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9258 00000100:00100000:1.0:1716999790.112070:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+530:11420:x1800404480758016:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:1.0:1716999790.112390:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986351 00000040:00080000:1.0:1716999790.112503:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11635, 168 off2080456 00000001:00080000:1.0:1716999790.112507:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986352 00000100:00100000:1.0:1716999790.112584:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480758016:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 512us (5015us total) trans 4294986353 rc 0/0 00000100:00100000:1.0:1716999790.112590:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9258 00000020:00080000:1.0:1716999790.112594:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1716999790.113855:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.114750:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.114986:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480758144 00000100:00100000:3.0:1716999790.114993:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480758144 00000100:00100000:1.0:1716999790.115493:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480758208 00000100:00100000:1.0:1716999790.115498:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480758208 00000100:00100000:0.0:1716999790.115515:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.115532:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45848 00000100:00100000:1.0:1716999790.115538:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+534:11560:x1800404480758208:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:1.0:1716999790.115554:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.115569:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc77d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f661ff expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999790.115672:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480758336 00000100:00100000:3.0:1716999790.115676:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480758336 00000100:00100000:0.0:1716999790.115678:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9259 00000100:00100000:0.0:1716999790.115682:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480758144:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.115690:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9260 00000100:00100000:3.0:1716999790.115693:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480758336:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.115834:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480758336:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 139us (319us total) trans 4294986354 rc 0/0 00000100:00100000:3.0:1716999790.115840:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9260 00010000:00010000:1.0:1716999790.116035:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc77d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ff expref: 536 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.116046:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc77d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ff expref: 536 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.116053:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999790.116056:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.116059:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b0fc0, rc 0) 00000100:00100000:1.0:1716999790.116089:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11560:x1800404480758208:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 551us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.116095:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45848 00000040:00080000:0.0:1716999790.118701:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11636, 168 off2080624 00000001:00080000:0.0:1716999790.118714:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986355 00000100:00100000:0.0:1716999790.118855:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480758144:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 3167us (4997us total) trans 4294986356 rc 0/0 00000100:00100000:0.0:1716999790.118863:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9259 00000020:00080000:0.0:1716999790.118868:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999790.118920:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.118988:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480758464 00000100:00100000:0.0:1716999790.118994:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480758464 00000100:00100000:0.0:1716999790.119029:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45849 00000100:00100000:0.0:1716999790.119034:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480758464:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:1.0:1716999790.119134:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999790.119142:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999790.119160:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8d80edb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6df:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50e71 expref: 537 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.119180:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ed440/0x6d188eabd8d7ce0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6df:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f90f expref: 536 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.119193:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8d7cd65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6df:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f8d7 expref: 535 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.119202:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f24d80/0x6d188eabd8d70cc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6df:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7fb expref: 534 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.119210:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6df:0x0].0x0 (ffff88009c872100) 00010000:00010000:0.0:1716999790.119216:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.119235:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc77da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119245:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc77da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119252:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc77da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119261:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc77e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dd:0x0].0x86195b67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119266:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc77e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119270:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc77e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119343:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc77e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6df:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119348:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc77e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119357:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc77e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999790.119704:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1508, 64 off104768 00000040:00080000:0.0:1716999790.119748:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11638, 184 off2080952 00010000:00010000:0.0:1716999790.119790:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc77ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6df:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119796:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc77ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119815:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc77ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119820:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc77ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119824:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc77ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119829:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc77ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119834:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc77ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119838:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132ac0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.119841:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc77ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119846:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc77ef lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119851:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6df:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.119853:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.119856:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc77ef lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119860:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc77ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6df:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119874:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc77e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119917:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc77e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119922:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc77e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.119926:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.119928:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc77e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.120069:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480758528 00000100:00100000:2.0:1716999790.120073:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480758528 00000100:00100000:2.0:1716999790.120105:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9261 00000100:00100000:2.0:1716999790.120110:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eeaa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11560:x1800404480758528:12345-192.168.203.3@tcp:37:ll_sa.0 00010000:00010000:0.0:1716999790.122043:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc77e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.122055:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6df:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.122057:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.122060:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc77e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.122064:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc77e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6df:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.122114:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc77da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.122118:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999790.122119:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc77da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.122124:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc77da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.122128:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.122131:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc77da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.122135:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480758656 00010000:00010000:0.0:1716999790.122135:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc77da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.122139:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480758656 00010000:00010000:0.0:1716999790.122141:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:0.0:1716999790.122143:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.122145:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc77da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.122148:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc77da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999790.122155:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b1f80 reply state ffff880133937000 transno 4294986357 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc77e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.122157:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9262 00000100:00100000:0.0:1716999790.122161:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.122163:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480758656:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.122197:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+538:11420:x1800404480758464:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3163us (3278us total) trans 4294986357 rc 0/0 00000100:00100000:0.0:1716999790.122203:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45849 00000100:00100000:3.0:1716999790.122272:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+538:11419:x1800404480758656:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 108us (156us total) trans 4294986358 rc 0/0 00000100:00100000:3.0:1716999790.122278:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9262 00000100:00100000:2.0:1716999790.124172:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eeaa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11560:x1800404480758528:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 4057us (5033us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.124180:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9261 00000100:00100000:1.0:1716999790.126822:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.126857:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480758784 00000100:00100000:1.0:1716999790.126863:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480758784 00000100:00100000:1.0:1716999790.126934:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45850 00000100:00100000:1.0:1716999790.126941:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480758784:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.126985:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1716999790.127005:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8d87622 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52b19 expref: 536 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.127026:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf53cc0/0x6d188eabd8d7b2ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c4:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f01e expref: 535 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.127037:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8d7b222 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4eff4 expref: 534 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.127062:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c575f80/0x6d188eabd8d702f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b412 expref: 533 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.127071:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c4:0x0].0x0 (ffff880092a37d00) 00010000:00010000:1.0:1716999790.127083:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4240/0x6d188eabd8dc6fa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6618f expref: 532 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.127089:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999790.127091:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.127119:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.127128:0:7785:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc77d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ff expref: 531 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.127134:0:7785:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.127158:0:7785:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc77d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ff expref: 531 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.127168:0:7785:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc77d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ff expref: 531 pid: 7785 timeout: 409 lvb_type: 0 00000100:00100000:1.0:1716999790.127179:0:7785:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008927d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:7785:1800404483017280:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999790.127218:0:7785:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093698a80 going to sleep for 11 seconds 00010000:00010000:3.0:1716999790.127287:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc77e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.127294:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc77e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.127299:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc77e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.127303:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.127307:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc77e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.127313:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc77e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.127321:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x86195b67 (ffff88008a83f100) 00010000:00010000:3.0:1716999790.127323:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.127326:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc77e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.127330:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc77e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.128832:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.128898:0:4523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480758848 00000100:00100000:2.0:1716999790.128904:0:4523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480758848 00000100:00100000:0.0:1716999790.128913:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.129171:0:4523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:2.0:1716999790.129177:0:4523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+531:1956:x1800404480758848:12345-192.168.203.3@tcp:63:ll_sa.0 00000100:00100000:1.0:1716999790.129224:0:7785:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008927d500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:7785:1800404483017280:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999790.129240:0:7785:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.129502:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480758976 00000100:00100000:3.0:1716999790.129506:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480758976 00000100:00100000:3.0:1716999790.129525:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9263 00000100:00100000:3.0:1716999790.129529:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480758976:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999790.129967:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11639, 168 off2081120 00000001:00080000:3.0:1716999790.129972:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986359 00000100:00100000:3.0:1716999790.130045:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480758976:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 513us (1129us total) trans 4294986360 rc 0/0 00000100:00100000:3.0:1716999790.130051:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9263 00000020:00080000:3.0:1716999790.130055:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.130127:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.130180:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480759040 00000100:00100000:3.0:1716999790.130184:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480759040 00010000:00010000:3.0:1716999790.130196:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc77d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ff expref: 534 pid: 7785 timeout: 409 lvb_type: 0 00010000:00010000:2.0:1716999790.130327:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.130338:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66206 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.130361:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7804 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130370:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7804 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130376:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7804 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130384:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc780b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130389:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc780b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130394:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc780b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130454:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7812 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130459:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130463:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:2.0:1716999790.130479:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc38:0x0]: returning size 11991 00000004:00200000:2.0:1716999790.130482:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999790.130489:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130495:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130500:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7804 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130504:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7804 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130508:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7804 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130512:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.130515:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7804 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130520:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7804 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130527:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999790.130529:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.130531:0:4523:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.130536:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7804 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130541:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7804 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130550:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc780b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130554:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc780b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130558:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc780b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130561:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918321c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.130562:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc780b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130566:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc780b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130570:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff880088977300) 00010000:00010000:2.0:1716999790.130572:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.130574:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc780b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130577:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc780b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130591:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc77fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66206 expref: 536 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.130598:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7812 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66206 expref: 535 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.130603:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:2.0:1716999790.130604:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999790.130606:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091833a80, rc 0) 00010000:00010000:2.0:1716999790.130608:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.130612:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7819 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6620d expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.130622:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7820 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130627:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7820 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130631:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7820 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130638:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7827 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130641:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130649:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130681:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc782e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130686:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130690:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:2.0:1716999790.130701:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc30:0x0]: returning size 15360 00000004:00200000:2.0:1716999790.130703:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999790.130707:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130711:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc782e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130716:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7820 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130719:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7820 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130723:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7820 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130726:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.130728:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7820 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130732:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7820 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130738:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:2.0:1716999790.130739:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.130741:0:4523:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.130746:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7820 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130750:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7820 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130756:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7827 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130760:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7827 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130765:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7827 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130768:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.130769:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7827 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130773:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7827 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130778:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff880088977d00) 00010000:00010000:2.0:1716999790.130780:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.130781:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7827 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:2.0:1716999790.130784:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7827 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00000100:00100000:3.0:1716999790.130786:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4580 00000100:00100000:3.0:1716999790.130792:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+536:1958:x1800404480759040:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999790.130807:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7819 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x3/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6620d expref: 537 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.130809:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999790.130813:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc77d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ff expref: 537 pid: 7785 timeout: 409 lvb_type: 0 00010000:00010000:2.0:1716999790.130815:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc782e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6620d expref: 536 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.130820:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:3.0:1716999790.130821:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc77d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ff expref: 536 pid: 7785 timeout: 409 lvb_type: 0 00010000:00010000:2.0:1716999790.130822:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1716999790.130823:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091830b40, rc 0) 00010000:00010000:3.0:1716999790.130831:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc77d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f661ff expref: 536 pid: 7785 timeout: 409 lvb_type: 0 00010000:00010000:3.0:1716999790.130839:0:16642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999790.130841:0:16642:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.130847:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.130852:0:16642:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.131207:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999790.131214:0:4523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:1956:x1800404480758848:12345-192.168.203.3@tcp:63:ll_sa.0 Request processed in 2036us (2386us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.131221:0:4523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 13 00000100:00100000:3.0:1716999790.131223:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+535:1958:x1800404480759040:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 432us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.131228:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4580 00010000:00010000:1.0:1716999790.131287:0:7785:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131293:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131304:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7835 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x37eb7f65 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131310:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7835 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131316:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7835 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131464:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc783c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131470:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc783c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131476:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc783c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:1.0:1716999790.131871:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1506, 64 off104640 00000040:00080000:1.0:1716999790.131916:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11640, 184 off2081304 00010000:00010000:1.0:1716999790.131964:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7843 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131971:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131977:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7843 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131982:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7843 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131986:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7843 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131990:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7843 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131994:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7843 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.131997:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.132000:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7843 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132004:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7843 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132010:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c4:0x0].0x0 (ffff8800a6ad7200) 00010000:00010000:1.0:1716999790.132012:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.132014:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7843 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132017:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7843 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132031:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc783c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132035:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc783c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132040:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc783c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132043:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.132046:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc783c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132049:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc783c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132055:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c4:0x0].0x0 (ffff8800a6ad7200) 00010000:00010000:1.0:1716999790.132057:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.132059:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc783c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132062:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc783c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6c4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132092:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132097:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132101:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132104:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.132106:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132110:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132115:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999790.132117:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.132119:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.132122:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc77f6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.132128:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b3800 reply state ffff8800935b5000 transno 4294986361 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7835 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.132133:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.132171:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480758784:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 5230us (5354us total) trans 4294986361 rc 0/0 00000100:00100000:1.0:1716999790.132176:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45850 00000100:00100000:3.0:1716999790.133921:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.133982:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480759168 00000100:00100000:2.0:1716999790.133989:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480759168 00000100:00100000:2.0:1716999790.134020:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9264 00000100:00100000:2.0:1716999790.134026:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480759168:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.134169:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480759168:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 143us (251us total) trans 4294986362 rc 0/0 00000100:00100000:2.0:1716999790.134175:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9264 00010000:00010000:0.0:1716999790.135126:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7835 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.135137:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7835 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.135143:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7835 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.135147:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b18c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.135150:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7835 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.135156:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7835 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.135166:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x37eb7f65 (ffff8800a6ad7a00) 00010000:00010000:0.0:1716999790.135169:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.135172:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7835 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.135175:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7835 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.135376:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.135419:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480759296 00000100:00100000:0.0:1716999790.135425:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480759296 00000100:00100000:0.0:1716999790.135454:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9265 00000100:00100000:0.0:1716999790.135458:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480759296:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999790.135790:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11641, 168 off2081472 00000001:00080000:0.0:1716999790.135796:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986363 00000100:00100000:0.0:1716999790.136775:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480759296:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 401us (485us total) trans 4294986364 rc 0/0 00000100:00100000:0.0:1716999790.136782:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9265 00000020:00080000:0.0:1716999790.136787:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999790.136823:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.136863:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480759424 00000100:00100000:1.0:1716999790.136868:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480759424 00000100:00100000:1.0:1716999790.136906:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45851 00000100:00100000:1.0:1716999790.136911:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480759424:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.136938:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.136952:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091367a80/0x6d188eabd8d80526 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ef:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50b3e expref: 537 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.136967:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d46c0/0x6d188eabd8d7db0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ef:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fd61 expref: 536 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.136978:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d4900/0x6d188eabd8d7dae7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ef:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fd53 expref: 535 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.136987:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65faac0/0x6d188eabd8d7117d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ef:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba1d expref: 534 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.136994:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ef:0x0].0x0 (ffff8800910ce200) 00010000:00010000:1.0:1716999790.137000:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.137016:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc784a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137025:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc784a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137032:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc784a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137041:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7851 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dd:0x0].0xe8edbb38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137045:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137050:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137116:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7858 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6ef:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137121:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7858 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137127:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7858 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:1.0:1716999790.137454:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1509, 64 off104832 00000040:00080000:1.0:1716999790.137468:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11642, 184 off2081656 00010000:00010000:1.0:1716999790.137510:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc785f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ef:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137517:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc785f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137522:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc785f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137527:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc785f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137531:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc785f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137536:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc785f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.137540:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc785f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.137843:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.137939:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480759552 00000100:00100000:2.0:1716999790.137943:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480759552 00000100:00100000:2.0:1716999790.137973:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9266 00000100:00100000:2.0:1716999790.137978:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480759552:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.138072:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480759552:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 92us (228us total) trans 4294986366 rc 0/0 00000100:00100000:2.0:1716999790.138078:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9266 00010000:00010000:1.0:1716999790.138572:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3600 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.138576:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc785f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138581:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc785f lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138590:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ef:0x0].0x0 (ffff8800a6ad7000) 00010000:00010000:1.0:1716999790.138592:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.138594:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc785f lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138598:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc785f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ef:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138610:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7858 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138614:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7858 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138618:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7858 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138622:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b33c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.138624:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7858 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138628:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7858 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138633:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ef:0x0].0x0 (ffff8800a6ad7000) 00010000:00010000:1.0:1716999790.138635:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.138637:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7858 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138640:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7858 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6ef:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138671:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc784a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138675:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc784a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138679:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc784a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138682:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.138684:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc784a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138687:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc784a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138691:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:1.0:1716999790.138693:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.138694:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc784a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.138698:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc784a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.138703:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca9880 reply state ffff88013634e000 transno 4294986365 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.138708:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.138777:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480759424:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1865us (1954us total) trans 4294986365 rc 0/0 00000100:00100000:1.0:1716999790.138783:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45851 00010000:00010000:3.0:1716999790.139602:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7851 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.139610:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7851 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.139614:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7851 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.139619:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.139621:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7851 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.139626:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7851 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.139633:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0xe8edbb38 (ffff8800a6ad7600) 00010000:00010000:3.0:1716999790.139635:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.139637:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7851 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.139641:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7851 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.140620:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.140778:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480759680 00000100:00100000:1.0:1716999790.140785:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480759680 00000100:00100000:3.0:1716999790.141007:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45852 00000100:00100000:3.0:1716999790.141013:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480759680:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.141048:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.141060:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8d87b4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52cc4 expref: 535 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.141072:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c0fc0/0x6d188eabd8d7b54e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c6:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f0d4 expref: 534 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.141086:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6ba80/0x6d188eabd8d7b4bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f0aa expref: 533 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.141104:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fb180/0x6d188eabd8d703b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b466 expref: 532 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.141111:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c6:0x0].0x0 (ffff8800a660ce00) 00010000:00010000:3.0:1716999790.141116:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.141133:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7866 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141142:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7866 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141148:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7866 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141155:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc786d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x3d99db37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141159:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc786d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141163:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc786d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141231:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7874 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141236:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7874 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141243:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7874 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999790.141623:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1507, 64 off104704 00000040:00080000:3.0:1716999790.141642:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11643, 184 off2081840 00010000:00010000:3.0:1716999790.141693:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc787b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141700:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc787b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141706:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc787b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141711:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc787b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141716:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc787b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141720:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc787b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141724:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc787b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141728:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c518c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.141731:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc787b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141736:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc787b lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6c6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141742:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c6:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999790.141745:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.141747:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc787b lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6c6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141751:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc787b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141766:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7874 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141771:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7874 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141775:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7874 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141779:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c533c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.141781:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7874 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141785:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7874 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141791:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c6:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999790.141793:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.141795:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7874 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141809:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7874 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6c6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141842:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7866 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141846:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7866 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141851:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7866 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141855:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.141857:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7866 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141861:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7866 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141866:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999790.141868:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.141870:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7866 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.141874:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7866 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999790.141896:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af51180 reply state ffff880131ff5000 transno 4294986367 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc786d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.141901:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.141956:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480759680:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 943us (1337us total) trans 4294986367 rc 0/0 00000100:00100000:3.0:1716999790.141962:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45852 00000100:00100000:0.0:1716999790.142193:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.142403:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480759808 00000100:00100000:3.0:1716999790.142408:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480759808 00000100:00100000:3.0:1716999790.143850:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9267 00000100:00100000:3.0:1716999790.143859:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eeaa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480759808:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:1.0:1716999790.144607:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc786d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.144615:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc786d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.144619:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc786d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.144623:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.144626:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc786d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.144631:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc786d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.144640:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x3d99db37 (ffff8800a5c6eb00) 00010000:00010000:1.0:1716999790.144642:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.144644:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc786d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.144648:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc786d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999790.145853:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11644, 168 off2082008 00000001:00080000:3.0:1716999790.145860:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986368 00000100:00100000:3.0:1716999790.145986:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eeaa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480759808:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2125us (3790us total) trans 4294986369 rc 0/0 00000100:00100000:3.0:1716999790.145993:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9267 00000020:00080000:3.0:1716999790.145998:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999790.146307:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.146558:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480759936 00000100:00100000:3.0:1716999790.146564:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480759936 00000100:00100000:3.0:1716999790.146591:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9268 00000100:00100000:3.0:1716999790.146596:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+534:11419:x1800404480759936:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999790.146809:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11645, 168 off2082176 00000001:00080000:3.0:1716999790.146813:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986370 00000100:00100000:3.0:1716999790.146866:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480759936:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 268us (559us total) trans 4294986371 rc 0/0 00000100:00100000:3.0:1716999790.146871:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9268 00000020:00080000:3.0:1716999790.146873:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.148897:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.149332:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480760064 00000100:00100000:2.0:1716999790.149339:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480760064 00000100:00100000:0.0:1716999790.149727:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.149784:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480760192 00000100:00100000:1.0:1716999790.149788:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480760192 00000100:00100000:2.0:1716999790.150283:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9269 00000100:00100000:2.0:1716999790.150290:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480760064:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.150447:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+538:11420:x1800404480760064:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 156us (1568us total) trans 4294986372 rc 0/0 00000100:00100000:2.0:1716999790.150453:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9269 00000100:00100000:1.0:1716999790.150756:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45853 00000100:00100000:1.0:1716999790.150762:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480760192:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.150789:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1716999790.150817:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7812 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc38:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66206 expref: 537 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.150831:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ea400/0x6d188eabd8dc4bbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc38:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65605 expref: 536 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.150840:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc4b87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc38:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655f7 expref: 535 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.150848:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a660c900) 00010000:00010000:1.0:1716999790.150857:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.150905:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7882 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.150916:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7882 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.150923:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7882 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.150932:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7889 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.150937:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7889 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.150941:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7889 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151015:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7890 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151023:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7890 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151028:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7890 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:1.0:1716999790.151407:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1510, 64 off104896 00000040:00080000:1.0:1716999790.151424:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11646, 176 off2082352 00010000:00010000:1.0:1716999790.151465:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7897 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151470:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151476:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151481:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7897 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151485:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7897 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151490:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7897 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151495:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7897 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151499:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b18c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.151501:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7897 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151506:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7897 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151512:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a6ad7a00) 00010000:00010000:1.0:1716999790.151514:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.151516:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7897 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151520:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7897 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151533:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7890 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151538:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7890 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151541:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7890 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151544:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.151547:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7890 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151550:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7890 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151555:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc38:0x0].0x0 (ffff8800a6ad7a00) 00010000:00010000:1.0:1716999790.151557:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.151558:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7890 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151562:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7890 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151589:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7882 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151594:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7882 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151598:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7882 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151601:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.151602:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7882 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151607:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7882 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151612:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999790.151613:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.151615:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7882 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.151619:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7882 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.151624:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af50700 reply state ffff880136348000 transno 4294986373 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7889 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.151629:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.151670:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480760192:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 908us (1943us total) trans 4294986373 rc 0/0 00000100:00100000:1.0:1716999790.151675:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45853 00000100:00100000:0.0:1716999790.156474:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999790.156571:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7889 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.156580:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7889 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.156586:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7889 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.156590:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.156594:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7889 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.156599:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7889 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.156613:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x4b9bf994 (ffff8800a6ad7200) 00010000:00010000:3.0:1716999790.156616:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.156619:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7889 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.156627:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7889 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.157214:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480760320 00000100:00100000:1.0:1716999790.157222:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480760320 00000100:00100000:1.0:1716999790.158053:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45854 00000100:00100000:1.0:1716999790.158060:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480760320:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.158103:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.158117:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8d7f8df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50732 expref: 535 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.158131:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091333a80/0x6d188eabd8d7dffd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6f3:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fef0 expref: 534 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.158142:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8d7dfb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fec6 expref: 533 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.158151:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f273c0/0x6d188eabd8d712b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4baa9 expref: 532 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.158158:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f3:0x0].0x0 (ffff880129eedd00) 00010000:00010000:1.0:1716999790.158164:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.158183:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc789e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.158191:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc789e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.158198:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc789e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.158206:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc78a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dd:0x0].0xd60d7337 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.158210:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc78a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.158215:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc78a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.158292:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc78ac lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6f3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.158298:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc78ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.158303:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc78ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.160833:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.160907:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480760448 00000100:00100000:3.0:1716999790.160915:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480760448 00000100:00100000:3.0:1716999790.160944:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9270 00000100:00100000:3.0:1716999790.160950:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480760448:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999790.161949:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1508, 64 off104768 00000040:00080000:1.0:1716999790.161968:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11647, 184 off2082536 00010000:00010000:1.0:1716999790.162020:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc78b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162033:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc78b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162043:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc78b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162049:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc78b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162054:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc78b3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162058:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc78b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162063:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc78b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162067:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1b00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.162071:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc78b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162078:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc78b3 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162086:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f3:0x0].0x0 (ffff8800a6ad7700) 00010000:00010000:1.0:1716999790.162088:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.162091:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc78b3 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162095:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc78b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162115:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc78ac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162119:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc78ac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162123:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc78ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162126:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.162129:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc78ac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162132:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc78ac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162137:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f3:0x0].0x0 (ffff8800a6ad7700) 00010000:00010000:1.0:1716999790.162139:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.162140:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc78ac lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162144:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc78ac lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6f3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162181:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc789e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162186:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc789e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162190:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc789e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162193:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b06c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.162195:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc789e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162200:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc789e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162205:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:1.0:1716999790.162207:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.162209:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc789e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.162212:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc789e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.162219:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af52680 reply state ffff88008e7b4000 transno 4294986375 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc78a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.162225:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1716999790.162383:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986374 00000040:00080000:3.0:1716999790.162506:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11648, 168 off2082704 00000001:00080000:3.0:1716999790.162510:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986376 00000100:00100000:1.0:1716999790.164204:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480760320:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 6138us (7730us total) trans 4294986375 rc 0/0 00000100:00100000:1.0:1716999790.164213:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45854 00000100:00100000:3.0:1716999790.164273:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480760448:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 3321us (3444us total) trans 4294986377 rc 0/0 00000100:00100000:3.0:1716999790.164279:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9270 00000020:00080000:3.0:1716999790.164283:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1716999790.166328:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc78a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.166340:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc78a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.166345:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc78a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.166349:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.166352:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc78a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.166357:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc78a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.166367:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0xd60d7337 (ffff8800a6ad7000) 00010000:00010000:1.0:1716999790.166369:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.166371:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc78a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.166376:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc78a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.169610:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.169649:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.172097:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480760704 00000100:00100000:3.0:1716999790.172107:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480760704 00000100:00100000:3.0:1716999790.172142:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9271 00000100:00100000:3.0:1716999790.172148:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480760704:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999790.172408:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11649, 168 off2082872 00000100:00100000:3.0:1716999790.172511:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480760704:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 362us (2859us total) trans 4294986378 rc 0/0 00000100:00100000:3.0:1716999790.172518:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9271 00000100:00100000:1.0:1716999790.172589:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480760576 00000100:00100000:1.0:1716999790.172594:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480760576 00000100:00100000:1.0:1716999790.172626:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45855 00000100:00100000:1.0:1716999790.172630:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480760576:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.172653:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1716999790.172670:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc782e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc30:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6620d expref: 536 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.172684:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918eb180/0x6d188eabd8dc4306 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc30:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65334 expref: 535 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.172695:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918ebcc0/0x6d188eabd8dc42c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc30:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65326 expref: 534 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.172702:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a660c700) 00010000:00010000:1.0:1716999790.172709:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.172727:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc78ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.172737:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc78ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.172744:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc78ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.172753:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc78c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.172758:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc78c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.172762:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc78c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.172836:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc78c8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.172842:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc78c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.172847:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc78c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:1.0:1716999790.173177:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1511, 64 off104960 00000040:00080000:1.0:1716999790.173191:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11650, 184 off2083056 00010000:00010000:1.0:1716999790.173228:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc78cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173235:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc78cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173241:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc78cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173247:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc78cf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173251:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc78cf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173255:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc78cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173260:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc78cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173264:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0b40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.173267:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc78cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173272:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc78cf lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173278:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a6ad7e00) 00010000:00010000:1.0:1716999790.173281:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.173283:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc78cf lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173287:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc78cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc30:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173302:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc78c8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173306:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc78c8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173310:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc78c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173313:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.173315:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc78c8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173319:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc78c8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173324:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc30:0x0].0x0 (ffff8800a6ad7e00) 00010000:00010000:1.0:1716999790.173326:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.173327:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc78c8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173332:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc78c8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173362:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc78ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173367:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc78ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173372:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc78ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173375:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.173378:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc78ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173381:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc78ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173387:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999790.173388:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.173390:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc78ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.173395:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc78ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.173402:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af52a00 reply state ffff88008e7b6000 transno 4294986379 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc78c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.173407:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.173436:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480760576:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 804us (3832us total) trans 4294986379 rc 0/0 00000100:00100000:1.0:1716999790.173442:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45855 00010000:00010000:3.0:1716999790.175361:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc78c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.175370:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc78c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.175375:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc78c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.175379:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.175382:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc78c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.175386:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc78c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.175397:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x7fa9a95 (ffff8800a6ad7500) 00010000:00010000:3.0:1716999790.175399:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.175402:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc78c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.175406:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc78c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.175951:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.176016:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480760832 00000100:00100000:2.0:1716999790.176023:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480760832 00000100:00100000:2.0:1716999790.176057:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9272 00000100:00100000:2.0:1716999790.176063:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480760832:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.176224:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480760832:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 160us (274us total) trans 4294986380 rc 0/0 00000100:00100000:2.0:1716999790.176230:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9272 00000100:00100000:0.0:1716999790.181513:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.181590:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480760960 00000100:00100000:3.0:1716999790.181598:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480760960 00000100:00100000:3.0:1716999790.181628:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9273 00000100:00100000:3.0:1716999790.181634:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eea9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480760960:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999790.182030:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11651, 168 off2083224 00000001:00080000:3.0:1716999790.182034:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986381 00000100:00100000:3.0:1716999790.182110:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eea9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480760960:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 476us (602us total) trans 4294986382 rc 0/0 00000100:00100000:3.0:1716999790.182119:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9273 00000020:00080000:3.0:1716999790.182123:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.182665:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.185774:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480761088 00000100:00100000:3.0:1716999790.185783:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480761088 00000100:00100000:3.0:1716999790.185914:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45856 00000100:00100000:3.0:1716999790.185921:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480761088:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.185968:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.185986:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8d7ff14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ea:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5093f expref: 537 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.186003:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1b00/0x6d188eabd8d7d791 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ea:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fc34 expref: 536 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.186011:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d5f80/0x6d188eabd8d7d759 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ea:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fc1f expref: 535 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.186020:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fb840/0x6d188eabd8d71049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ea:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b98a expref: 534 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.186028:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ea:0x0].0x0 (ffff8800910ce300) 00010000:00010000:3.0:1716999790.186036:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.186056:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc78d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186064:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc78d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186070:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc78d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186082:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc78dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dd:0x0].0x92de3403 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186087:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc78dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.186101:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999790.186102:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc78dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186198:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc78e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6ea:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186204:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc78e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186209:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc78e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999790.186568:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1512, 64 off105024 00000040:00080000:3.0:1716999790.186584:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11652, 184 off2083408 00010000:00010000:3.0:1716999790.186629:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc78eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ea:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186635:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc78eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186641:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc78eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186646:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc78eb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186650:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc78eb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186658:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc78eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186662:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc78eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186667:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.186669:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc78eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186675:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc78eb lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186681:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ea:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.186683:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.186685:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc78eb lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186690:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc78eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ea:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186707:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc78e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186712:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc78e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186717:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc78e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186721:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.186724:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc78e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186731:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc78e4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186736:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ea:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.186738:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.186740:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc78e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186744:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc78e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6ea:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186783:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc78d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186788:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc78d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186793:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc78d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186796:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.186827:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc78d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186832:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc78d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186839:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:3.0:1716999790.186840:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.186843:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc78d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.186847:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc78d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999790.186854:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339fd880 reply state ffff88009c0e4000 transno 4294986383 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc78dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.186859:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.186930:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480761088:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1008us (4264us total) trans 4294986383 rc 0/0 00000100:00100000:3.0:1716999790.186936:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45856 00000100:00100000:1.0:1716999790.186954:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480761216 00000100:00100000:1.0:1716999790.186959:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480761216 00000100:00100000:1.0:1716999790.186991:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9274 00000100:00100000:1.0:1716999790.186996:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480761216:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.187111:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480761216:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 113us (1009us total) trans 4294986384 rc 0/0 00000100:00100000:1.0:1716999790.187117:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9274 00000100:00100000:2.0:1716999790.192099:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999790.192194:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc78dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.192206:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc78dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.192212:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc78dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.192216:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.192220:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc78dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.192225:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc78dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.192237:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x92de3403 (ffff8800a5c6e100) 00010000:00010000:1.0:1716999790.192240:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.192243:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc78dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.192247:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc78dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.193254:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480761344 00000100:00100000:3.0:1716999790.193262:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480761344 00000100:00100000:3.0:1716999790.193299:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45857 00000100:00100000:3.0:1716999790.193305:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480761344:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.193344:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.193358:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009353b600/0x6d188eabd8d88001 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c8:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52e29 expref: 535 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.193370:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef33c0/0x6d188eabd8d7b7f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c8:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f1b4 expref: 534 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.193380:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef0000/0x6d188eabd8d7b738 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f175 expref: 533 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.193389:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c577600/0x6d188eabd8d7044f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4ac expref: 532 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.193396:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c8:0x0].0x0 (ffff880092a37100) 00010000:00010000:3.0:1716999790.193401:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.193422:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc78f2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.193432:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc78f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.193439:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc78f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.193448:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc78f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c2:0x0].0xbfc2eca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.193453:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc78f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.193457:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc78f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.193537:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7900 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.193543:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7900 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.193549:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7900 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999790.194455:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.194507:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480761472 00000100:00100000:2.0:1716999790.194511:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480761472 00000100:00100000:2.0:1716999790.194543:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9275 00000100:00100000:2.0:1716999790.194548:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480761472:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999790.194860:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11653, 168 off2083576 00000001:00080000:2.0:1716999790.194866:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986385 00000100:00100000:2.0:1716999790.195354:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480761472:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 803us (898us total) trans 4294986386 rc 0/0 00000100:00100000:2.0:1716999790.195361:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9275 00000020:00080000:2.0:1716999790.195365:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1716999790.196059:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1509, 64 off104832 00000040:00080000:3.0:1716999790.196077:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11654, 184 off2083760 00010000:00010000:3.0:1716999790.196137:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7907 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196147:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196155:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196164:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7907 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196168:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7907 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196171:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7907 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196176:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7907 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196181:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c506c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.196183:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7907 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196188:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7907 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196195:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c8:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999790.196198:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.196201:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7907 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196206:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7907 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196220:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7900 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196225:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7900 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196229:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7900 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196232:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.196235:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7900 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196239:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7900 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196244:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c8:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999790.196246:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.196248:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7900 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196251:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7900 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6c8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196288:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc78f2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196293:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc78f2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196297:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc78f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196301:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.196303:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc78f2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196307:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc78f2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196313:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999790.196315:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.196318:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc78f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.196323:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc78f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999790.196329:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88013502a680 reply state ffff88009c0e6000 transno 4294986387 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc78f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.196334:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.196378:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480761344:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3071us (4284us total) trans 4294986387 rc 0/0 00000100:00100000:3.0:1716999790.196383:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45857 00000100:00100000:2.0:1716999790.196983:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.198304:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480761600 00000100:00100000:3.0:1716999790.198311:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480761600 00010000:00010000:2.0:1716999790.198356:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc78f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.198364:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc78f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.198370:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc78f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.198374:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.198377:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc78f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.198382:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc78f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c2:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.198383:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9276 00000100:00100000:3.0:1716999790.198388:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480761600:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:2.0:1716999790.198391:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0xbfc2eca6 (ffff8800a5c6e000) 00010000:00010000:2.0:1716999790.198393:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.198395:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc78f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.198399:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc78f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c2:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.198562:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480761600:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 172us (1578us total) trans 4294986388 rc 0/0 00000100:00100000:3.0:1716999790.198568:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9276 00000100:00100000:0.0:1716999790.204717:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.204760:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.205052:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480761664 00000100:00100000:3.0:1716999790.205059:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480761664 00000100:00100000:2.0:1716999790.205533:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480761792 00000100:00100000:2.0:1716999790.205538:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480761792 00000100:00100000:3.0:1716999790.205608:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9277 00000100:00100000:3.0:1716999790.205615:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480761664:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999790.205972:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45858 00000100:00100000:0.0:1716999790.205978:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480761792:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.206009:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999790.206028:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8d7f91e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6e5:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50739 expref: 536 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.206055:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d6640/0x6d188eabd8d7d235 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6e5:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fa6d expref: 535 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.206066:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646ba80/0x6d188eabd8d7d18d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fa3c expref: 534 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.206078:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fbcc0/0x6d188eabd8d70e89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8c6 expref: 533 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.206086:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e5:0x0].0x0 (ffff880091e2ec00) 00010000:00010000:0.0:1716999790.206093:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.206112:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc790e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.206121:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc790e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.206129:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc790e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.206139:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7915 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dd:0x0].0xdfedbb38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.206145:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7915 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.206149:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7915 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.206227:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc791c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.206233:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc791c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.206238:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc791c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999790.207537:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1513, 64 off105088 00000040:00080000:0.0:1716999790.207561:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11655, 184 off2083944 00010000:00010000:0.0:1716999790.207614:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7923 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.207622:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.207628:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208153:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7923 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208159:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7923 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208164:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7923 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208169:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7923 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208173:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132f40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.208176:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7923 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208181:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7923 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208190:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e5:0x0].0x0 (ffff88008a83f200) 00010000:00010000:0.0:1716999790.208193:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.208196:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7923 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208200:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7923 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208220:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc791c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208224:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc791c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208228:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc791c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208232:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.208234:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc791c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208238:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc791c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208242:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e5:0x0].0x0 (ffff88008a83f200) 00010000:00010000:0.0:1716999790.208244:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.208246:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc791c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208249:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc791c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208284:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc790e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208287:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc790e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208291:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc790e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208295:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.208296:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc790e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208303:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc790e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208308:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:0.0:1716999790.208309:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.208311:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc790e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.208314:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc790e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999790.208320:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339fdc00 reply state ffff880133933000 transno 4294986389 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7915 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.208325:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.209254:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480761792:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3269us (4487us total) trans 4294986389 rc 0/0 00000100:00100000:0.0:1716999790.209261:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45858 00000100:00100000:3.0:1716999790.209867:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480761664:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 4250us (5154us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.209874:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9277 00010000:00010000:1.0:1716999790.210383:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7915 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.210391:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7915 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.210397:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7915 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.210402:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.210405:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7915 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.210411:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7915 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.210420:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0xdfedbb38 (ffff88008a83ff00) 00010000:00010000:1.0:1716999790.210423:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.210426:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7915 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.210430:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7915 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.211405:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.212168:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480761920 00000100:00100000:3.0:1716999790.212175:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480761920 00000100:00100000:3.0:1716999790.212218:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9278 00000100:00100000:3.0:1716999790.212225:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480761920:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999790.212565:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11656, 168 off2084112 00000100:00100000:3.0:1716999790.212702:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480761920:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 477us (1299us total) trans 4294986390 rc 0/0 00000100:00100000:3.0:1716999790.212710:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9278 00000100:00100000:0.0:1716999790.214782:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.214862:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.215084:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480762048 00000100:00100000:3.0:1716999790.215090:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480762048 00000100:00100000:3.0:1716999790.215125:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480762176 00000100:00100000:3.0:1716999790.215127:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480762176 00000100:00100000:3.0:1716999790.215144:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9279 00000100:00100000:3.0:1716999790.215149:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eea9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+534:11419:x1800404480762048:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999790.215540:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11657, 168 off2084280 00000001:00080000:3.0:1716999790.215546:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986391 00000100:00100000:3.0:1716999790.215620:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eea9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480762048:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 470us (842us total) trans 4294986392 rc 0/0 00000100:00100000:3.0:1716999790.215626:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9279 00000020:00080000:3.0:1716999790.215630:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999790.215657:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9280 00000100:00100000:3.0:1716999790.215660:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480762176:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.215718:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480762176:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 57us (856us total) trans 4294986393 rc 0/0 00000100:00100000:3.0:1716999790.215723:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9280 00000100:00100000:0.0:1716999790.218941:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.219028:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.219198:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480762432 00000100:00100000:1.0:1716999790.219205:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480762432 00000100:00100000:1.0:1716999790.219247:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45859 00000100:00100000:1.0:1716999790.219253:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480762432:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.219292:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.219311:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8d7fea4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6e9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5091c expref: 536 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.219330:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8d7d6d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6e9:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fbf5 expref: 535 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.219339:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2640/0x6d188eabd8d7d6b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fbe7 expref: 534 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.219347:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911861c0/0x6d188eabd8d70fbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b94b expref: 533 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.219359:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e9:0x0].0x0 (ffff880091e2de00) 00000100:00100000:2.0:1716999790.219360:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480762304 00000100:00100000:2.0:1716999790.219363:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480762304 00010000:00010000:1.0:1716999790.219366:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999790.219381:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9281 00010000:00010000:1.0:1716999790.219385:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc792a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.219386:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480762304:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:1.0:1716999790.219395:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc792a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.219401:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc792a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.219410:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7931 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dd:0x0].0x7264b700 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.219414:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7931 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.219418:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7931 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.219487:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7938 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.219492:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7938 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.219496:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7938 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.219514:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+534:11419:x1800404480762304:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 128us (581us total) trans 4294986394 rc 0/0 00000100:00100000:2.0:1716999790.219520:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9281 00000040:00080000:1.0:1716999790.219875:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1514, 64 off105152 00000040:00080000:1.0:1716999790.219917:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11658, 184 off2084464 00010000:00010000:1.0:1716999790.220795:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc793f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220810:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc793f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220816:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc793f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220821:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc793f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220825:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc793f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220829:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc793f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220834:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc793f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220838:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2f40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.220840:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc793f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220845:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc793f lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220851:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e9:0x0].0x0 (ffff8800a6ad7200) 00010000:00010000:1.0:1716999790.220853:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.220856:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc793f lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220860:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc793f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220874:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7938 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220941:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7938 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220946:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7938 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220949:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.220951:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7938 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220956:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7938 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220962:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e9:0x0].0x0 (ffff8800a6ad7200) 00010000:00010000:1.0:1716999790.220963:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.220965:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7938 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.220969:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7938 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.221058:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc792a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.221063:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc792a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.221067:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc792a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.221074:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.221076:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc792a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.221081:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc792a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.221087:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:0.0:1716999790.221089:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.221091:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc792a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.221094:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc792a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999790.221101:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339fc700 reply state ffff880093a43000 transno 4294986395 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7931 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.221106:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.221149:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480762432:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1895us (2120us total) trans 4294986395 rc 0/0 00000100:00100000:0.0:1716999790.221156:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45859 00000100:00100000:0.0:1716999790.221624:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.221661:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480762560 00000100:00100000:2.0:1716999790.221666:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480762560 00000100:00100000:2.0:1716999790.221695:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45860 00000100:00100000:2.0:1716999790.221699:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480762560:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.221723:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1716999790.221735:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133142ac0/0x6d188eabd8d7f941 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50747 expref: 535 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.221747:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963cd80/0x6d188eabd8d7dec2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6f2:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fe79 expref: 534 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.221758:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0240/0x6d188eabd8d7de44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fe56 expref: 533 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.221766:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68240/0x6d188eabd8d712aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4baa2 expref: 532 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.221782:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f2:0x0].0x0 (ffff880091e2dc00) 00010000:00010000:2.0:1716999790.221793:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf73c0/0x6d188eabd8dc6fd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66196 expref: 531 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.221809:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:2.0:1716999790.221811:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.221825:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7946 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.221832:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7946 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.221837:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7946 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.221846:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc794d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dc:0x0].0xd60d7337 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.221850:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc794d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.221854:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc794d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.221954:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7954 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6f2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.221960:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7954 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.221966:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7954 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222459:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7931 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222466:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7931 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222470:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7931 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222478:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b21c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.222480:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7931 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222484:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7931 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222491:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x7264b700 (ffff8800a6ad7f00) 00010000:00010000:2.0:1716999790.222492:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.222494:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7931 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222498:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7931 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000040:00080000:2.0:1716999790.222670:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1515, 64 off105216 00000040:00080000:2.0:1716999790.222686:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11659, 184 off2084648 00010000:00010000:2.0:1716999790.222727:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc795b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222733:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc795b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222738:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc795b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222743:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc795b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222746:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc795b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222751:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc795b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222755:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc795b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222758:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.222760:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc795b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222764:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc795b lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222769:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f2:0x0].0x0 (ffff880088977f00) 00010000:00010000:2.0:1716999790.222770:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.222772:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc795b lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222775:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc795b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222787:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7954 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222791:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7954 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222795:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7954 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222809:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.222811:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7954 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222815:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7954 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222823:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f2:0x0].0x0 (ffff880088977f00) 00010000:00010000:2.0:1716999790.222825:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.222827:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7954 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222830:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7954 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6f2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222858:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7946 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222862:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7946 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222866:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7946 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222869:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.222871:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7946 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222874:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7946 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222908:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:2.0:1716999790.222909:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.222911:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7946 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.222915:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7946 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999790.222921:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339ff800 reply state ffff88008b77d000 transno 4294986396 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc794d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.222926:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.222958:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480762560:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1257us (1334us total) trans 4294986396 rc 0/0 00000100:00100000:2.0:1716999790.222964:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45860 00000100:00100000:0.0:1716999790.225856:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.226007:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480762688 00000100:00100000:2.0:1716999790.226014:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480762688 00000100:00100000:2.0:1716999790.226057:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9282 00000100:00100000:2.0:1716999790.226063:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+531:11420:x1800404480762688:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:1.0:1716999790.226316:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc794d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.226324:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc794d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00000040:00080000:2.0:1716999790.226328:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11660, 168 off2084816 00010000:00010000:1.0:1716999790.226330:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc794d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.226335:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.226338:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc794d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.226347:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc794d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.226358:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0xd60d7337 (ffff880088977e00) 00010000:00010000:1.0:1716999790.226361:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.226364:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc794d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.226369:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc794d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0xd60d7337 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.227927:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+531:11420:x1800404480762688:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1856us (2070us total) trans 4294986397 rc 0/0 00000100:00100000:2.0:1716999790.227938:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9282 00000100:00100000:0.0:1716999790.228134:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.228179:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480762816 00000100:00100000:3.0:1716999790.228186:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480762816 00000100:00100000:3.0:1716999790.228221:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9283 00000100:00100000:3.0:1716999790.228225:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480762816:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999790.228639:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11661, 168 off2084984 00000001:00080000:3.0:1716999790.228645:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986398 00000100:00100000:3.0:1716999790.228712:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480762816:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 486us (579us total) trans 4294986399 rc 0/0 00000100:00100000:3.0:1716999790.228718:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9283 00000020:00080000:3.0:1716999790.228722:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.231281:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.231320:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.231423:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480762944 00000100:00100000:3.0:1716999790.231429:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480762944 00000100:00100000:3.0:1716999790.231453:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480763072 00000100:00100000:3.0:1716999790.231455:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480763072 00000100:00100000:3.0:1716999790.231473:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9284 00000100:00100000:3.0:1716999790.231478:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480762944:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.231624:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480762944:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 145us (349us total) trans 4294986400 rc 0/0 00000100:00100000:3.0:1716999790.231630:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9284 00000100:00100000:3.0:1716999790.231643:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9285 00000100:00100000:3.0:1716999790.231646:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eea9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+534:11419:x1800404480763072:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.231708:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eea9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480763072:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 60us (387us total) trans 4294986401 rc 0/0 00000100:00100000:3.0:1716999790.231713:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9285 00000100:00100000:0.0:1716999790.233430:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.233469:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.233574:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480763200 00000100:00100000:2.0:1716999790.233579:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480763200 00000100:00100000:2.0:1716999790.233607:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480763328 00000100:00100000:2.0:1716999790.233609:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480763328 00000100:00100000:2.0:1716999790.233632:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45861 00000100:00100000:2.0:1716999790.233637:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480763200:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.233668:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.233686:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913673c0/0x6d188eabd8d80947 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50ca3 expref: 536 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.233701:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e06c0/0x6d188eabd8d7dd5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6f1:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fe10 expref: 535 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.233712:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7eed00/0x6d188eabd8d7dcfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fde6 expref: 534 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.233723:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fba80/0x6d188eabd8d7121e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba63 expref: 533 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.233731:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f1:0x0].0x0 (ffff8800910cef00) 00010000:00010000:2.0:1716999790.233738:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.233758:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7962 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.233768:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7962 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.233776:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7962 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.233785:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7969 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dd:0x0].0x66c02682 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.233790:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.233794:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.233908:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7970 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6f1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.233914:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7970 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.233920:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7970 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:2.0:1716999790.234311:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1516, 64 off105280 00000040:00080000:2.0:1716999790.234331:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11662, 176 off2085160 00010000:00010000:2.0:1716999790.234378:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7977 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234384:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7977 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234390:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7977 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234395:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7977 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234399:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7977 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234403:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7977 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234409:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7977 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234413:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.234415:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7977 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234420:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7977 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234425:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f1:0x0].0x0 (ffff880088977700) 00010000:00010000:2.0:1716999790.234427:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.234430:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7977 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234434:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7977 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234451:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7970 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234455:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7970 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234459:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7970 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234462:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.234464:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7970 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234468:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7970 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234474:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f1:0x0].0x0 (ffff880088977700) 00010000:00010000:2.0:1716999790.234475:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.234477:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7970 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234481:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7970 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6f1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234517:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7962 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234522:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7962 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234526:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7962 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234529:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.234532:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7962 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234536:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7962 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234542:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:2.0:1716999790.234543:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.234545:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7962 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234549:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7962 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999790.234555:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339fc000 reply state ffff88008b779000 transno 4294986402 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.234560:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.234600:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480763200:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 961us (1173us total) trans 4294986402 rc 0/0 00000100:00100000:2.0:1716999790.234606:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45861 00000100:00100000:2.0:1716999790.234618:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45862 00000100:00100000:2.0:1716999790.234621:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480763328:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.234635:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.234643:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800913661c0/0x6d188eabd8d804d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ee:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50b29 expref: 533 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.234653:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091187180/0x6d188eabd8d7dab6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ee:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fd45 expref: 532 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.234661:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d7600/0x6d188eabd8d7da93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ee:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fd37 expref: 531 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.234671:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f27840/0x6d188eabd8d71176 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ee:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba16 expref: 530 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.234676:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ee:0x0].0x0 (ffff880136b1d200) 00010000:00010000:2.0:1716999790.234682:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.234690:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc797e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234695:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc797e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234700:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc797e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234707:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7985 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dc:0x0].0xe8edbb38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234710:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234714:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234754:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc798c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6ee:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234759:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc798c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.234763:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc798c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:2.0:1716999790.235066:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1510, 64 off104896 00000040:00080000:2.0:1716999790.235078:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11663, 184 off2085344 00010000:00010000:2.0:1716999790.235117:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7993 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ee:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235123:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235129:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235133:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7993 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235137:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7993 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235141:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235145:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7993 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235149:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.235151:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7993 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235155:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7993 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235161:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ee:0x0].0x0 (ffff880088977800) 00010000:00010000:2.0:1716999790.235163:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.235165:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7993 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235169:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7993 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ee:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235182:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc798c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235186:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc798c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235190:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc798c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235194:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.235195:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc798c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235200:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc798c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235205:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ee:0x0].0x0 (ffff880088977800) 00010000:00010000:2.0:1716999790.235206:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.235208:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc798c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235212:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc798c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6ee:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235238:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc797e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235243:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc797e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235247:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc797e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235250:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.235253:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc797e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235257:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc797e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235262:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:2.0:1716999790.235264:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.235266:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc797e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.235270:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc797e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999790.235275:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339fd500 reply state ffff88008b77a000 transno 4294986403 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.235280:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.235304:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480763328:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 680us (1834us total) trans 4294986403 rc 0/0 00000100:00100000:2.0:1716999790.235309:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45862 00000100:00100000:0.0:1716999790.238315:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.239582:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480763456 00000100:00100000:1.0:1716999790.239591:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480763456 00000100:00100000:1.0:1716999790.239641:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9286 00000100:00100000:1.0:1716999790.239648:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+531:11420:x1800404480763456:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999790.239928:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11664, 168 off2085512 00000100:00100000:1.0:1716999790.240025:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480763456:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 376us (1714us total) trans 4294986404 rc 0/0 00000100:00100000:1.0:1716999790.240031:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9286 00000100:00100000:0.0:1716999790.240277:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.240399:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480763584 00000100:00100000:3.0:1716999790.240404:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480763584 00000100:00100000:3.0:1716999790.240422:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9287 00000100:00100000:3.0:1716999790.240427:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480763584:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:3.0:1716999790.240649:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986405 00000040:00080000:3.0:1716999790.240769:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11665, 168 off2085680 00000001:00080000:3.0:1716999790.240773:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986406 00000100:00100000:3.0:1716999790.240836:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480763584:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 407us (558us total) trans 4294986407 rc 0/0 00000100:00100000:3.0:1716999790.240842:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9287 00000020:00080000:3.0:1716999790.240850:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1716999790.240902:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7969 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.240912:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7969 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.240916:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.240918:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7969 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.240922:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7985 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.240923:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.240926:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7969 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.240927:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7985 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.240931:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.240933:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7985 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.240936:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7969 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.240938:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7985 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.240947:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x66c02682 (ffff880088977900) 00010000:00010000:1.0:1716999790.240947:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0xe8edbb38 (ffff880088977400) 00010000:00010000:2.0:1716999790.240950:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.240950:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.240953:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7969 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.240953:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7985 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.240957:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc7969 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.240957:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc7985 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0xe8edbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.242508:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.242741:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480763712 00000100:00100000:0.0:1716999790.242746:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480763712 00000100:00100000:0.0:1716999790.242782:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9288 00000100:00100000:0.0:1716999790.242789:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480763712:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.242948:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480763712:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 159us (443us total) trans 4294986408 rc 0/0 00000100:00100000:0.0:1716999790.242954:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9288 00000100:00100000:0.0:1716999790.243017:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.243051:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480763840 00000100:00100000:0.0:1716999790.243054:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480763840 00000100:00100000:0.0:1716999790.243082:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9289 00000100:00100000:0.0:1716999790.243086:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+534:11419:x1800404480763840:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.243763:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480763840:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 673us (743us total) trans 4294986409 rc 0/0 00000100:00100000:0.0:1716999790.243769:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9289 00000100:00100000:0.0:1716999790.246168:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.246677:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480763968 00000100:00100000:2.0:1716999790.246685:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480763968 00000100:00100000:2.0:1716999790.246727:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45863 00000100:00100000:2.0:1716999790.246733:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480763968:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.246772:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.246791:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf5200/0x6d188eabd8d7fe11 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6e7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f508eb expref: 535 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.246819:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8d7d4ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6e7:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fb46 expref: 534 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.246829:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb98240/0x6d188eabd8d7d411 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fb07 expref: 533 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.246840:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65f8240/0x6d188eabd8d70f2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b913 expref: 532 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.246847:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e7:0x0].0x0 (ffff8800910ce100) 00010000:00010000:2.0:1716999790.246856:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.246876:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc799a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.246914:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc799a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.246921:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc799a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.246932:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc79a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dd:0x0].0xc7fe5838 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.246937:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc79a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.246941:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc79a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247019:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc79a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247025:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc79a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247030:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc79a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:2.0:1716999790.247430:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1517, 64 off105344 00000040:00080000:2.0:1716999790.247449:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11666, 184 off2085864 00010000:00010000:2.0:1716999790.247499:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc79af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247506:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc79af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247514:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc79af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247519:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc79af lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247523:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc79af lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247527:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc79af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247532:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc79af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247537:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.247540:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc79af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247545:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc79af lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247552:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e7:0x0].0x0 (ffff880088977300) 00010000:00010000:2.0:1716999790.247555:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.247557:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc79af lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247562:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc79af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247579:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc79a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247583:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc79a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247588:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc79a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247592:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.247594:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc79a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247614:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc79a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247620:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e7:0x0].0x0 (ffff880088977300) 00010000:00010000:2.0:1716999790.247622:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.247624:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc79a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247628:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc79a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247678:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc799a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247683:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc799a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247687:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc799a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247691:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.247693:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc799a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247697:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc799a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247707:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:2.0:1716999790.247709:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.247711:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc799a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.247715:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc799a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999790.247722:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339ff480 reply state ffff88008b77b000 transno 4294986410 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc79a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999790.247727:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.247787:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480763968:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1053us (1623us total) trans 4294986410 rc 0/0 00000100:00100000:2.0:1716999790.247794:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45863 00000100:00100000:1.0:1716999790.249828:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.250194:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480764096 00000100:00100000:3.0:1716999790.250201:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480764096 00000100:00100000:3.0:1716999790.250277:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45864 00000100:00100000:3.0:1716999790.250283:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480764096:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.250314:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.250330:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8d80ec6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6de:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50e6a expref: 533 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.250345:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d6d00/0x6d188eabd8d7ccc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6de:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f8ad expref: 532 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.250355:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d7840/0x6d188eabd8d7cbf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6de:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f867 expref: 531 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.250365:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f25f80/0x6d188eabd8d70c91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6de:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7e6 expref: 530 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.250372:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6de:0x0].0x0 (ffff88009c872a00) 00010000:00010000:3.0:1716999790.250378:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.250394:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc79b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250405:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc79b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250411:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc79b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250420:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc79bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dc:0x0].0x86195b67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250425:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc79bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250430:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc79bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250491:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc79c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6de:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250496:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc79c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6de:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250501:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc79c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6de:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999790.250850:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1511, 64 off104960 00000040:00080000:3.0:1716999790.250866:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11667, 184 off2086048 00010000:00010000:3.0:1716999790.250945:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc79cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6de:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250952:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc79cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250957:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc79cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250966:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc79cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250971:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc79cb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250975:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc79cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250980:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc79cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250984:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.250987:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc79cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250992:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc79cb lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.250997:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6de:0x0].0x0 (ffff8800a5c6eb00) 00010000:00010000:3.0:1716999790.251000:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.251002:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc79cb lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251006:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc79cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6de:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251022:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc79c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6de:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251026:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc79c4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6de:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251030:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc79c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6de:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251034:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.251036:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc79c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6de:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251040:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc79c4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6de:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251046:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6de:0x0].0x0 (ffff8800a5c6eb00) 00010000:00010000:3.0:1716999790.251048:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.251050:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc79c4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6de:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251055:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc79c4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6de:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251099:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc79b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251104:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc79b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251109:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc79b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251112:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.251115:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc79b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251119:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc79b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251125:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:3.0:1716999790.251127:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.251130:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc79b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.251134:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc79b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999790.251140:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012b7f4700 reply state ffff88009c0e7000 transno 4294986411 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc79bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.251144:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1716999790.253215:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc79a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.253225:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc79a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.253230:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc79a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.253234:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.253238:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc79a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.253243:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc79a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.253253:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0xc7fe5838 (ffff880088977200) 00010000:00010000:2.0:1716999790.253256:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.253258:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc79a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.253262:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc79a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999790.254033:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.254120:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480764224 00000100:00100000:0.0:1716999790.254127:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480764224 00000100:00100000:3.0:1716999790.254221:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480764096:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3935us (4393us total) trans 4294986411 rc 0/0 00000100:00100000:3.0:1716999790.254228:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45864 00000100:00100000:0.0:1716999790.256425:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9290 00000100:00100000:0.0:1716999790.256433:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+530:11420:x1800404480764224:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999790.256835:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11668, 168 off2086216 00000001:00080000:0.0:1716999790.256841:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986412 00000100:00100000:0.0:1716999790.256935:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480764224:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 502us (2903us total) trans 4294986413 rc 0/0 00000100:00100000:0.0:1716999790.256944:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9290 00000020:00080000:0.0:1716999790.256949:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1716999790.257039:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc79bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.257046:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc79bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.257052:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc79bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.257057:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.257060:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc79bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.257066:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc79bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.257076:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x86195b67 (ffff8800a5c6e900) 00010000:00010000:1.0:1716999790.257078:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.257081:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc79bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.257086:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc79bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0x86195b67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999790.260569:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.260627:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480764352 00000100:00100000:0.0:1716999790.260634:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480764352 00000100:00100000:0.0:1716999790.260675:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9291 00000100:00100000:0.0:1716999790.260681:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eea9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480764352:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.262122:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.262283:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480764480 00000100:00100000:3.0:1716999790.262289:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480764480 00000100:00100000:3.0:1716999790.262313:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9292 00000100:00100000:3.0:1716999790.262318:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480764480:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.262462:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480764480:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 142us (343us total) trans 4294986414 rc 0/0 00000100:00100000:3.0:1716999790.262468:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9292 00000040:00080000:1.0:1716999790.262748:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11669, 168 off2086384 00000001:00080000:1.0:1716999790.262754:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986415 00000100:00100000:1.0:1716999790.262814:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eea9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+534:11419:x1800404480764352:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2132us (2250us total) trans 4294986416 rc 0/0 00000100:00100000:1.0:1716999790.262820:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9291 00000020:00080000:1.0:1716999790.262823:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.264587:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.265401:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.265523:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480764736 00000100:00100000:3.0:1716999790.265529:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480764736 00000100:00100000:3.0:1716999790.265556:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45865 00000100:00100000:3.0:1716999790.265562:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480764736:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.265598:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.265619:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092844000/0x6d188eabd8d8f675 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6e3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5549b expref: 534 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.265637:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e3840/0x6d188eabd8d7d0a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6e3:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f9fd expref: 533 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.265647:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012facc000/0x6d188eabd8d7d083 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f9ef expref: 532 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.265657:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f24900/0x6d188eabd8d70df6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b887 expref: 531 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.265667:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e3:0x0].0x0 (ffff88009c872500) 00010000:00010000:3.0:1716999790.265674:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.265695:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc79d2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.265706:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc79d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.265714:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc79d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.265725:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc79d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dd:0x0].0x3dce1c64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.265730:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc79d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.265735:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc79d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.265816:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc79e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.265822:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc79e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.265829:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc79e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999790.266246:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1518, 64 off105408 00000040:00080000:3.0:1716999790.266264:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11670, 184 off2086568 00010000:00010000:3.0:1716999790.266315:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc79e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266322:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc79e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266328:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc79e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266332:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc79e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266336:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc79e7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266340:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc79e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266344:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc79e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266348:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.266351:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc79e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266356:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc79e7 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266361:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e3:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:3.0:1716999790.266364:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.266367:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc79e7 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266371:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc79e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266387:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc79e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266391:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc79e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266395:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc79e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266399:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.266401:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc79e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266405:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc79e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266411:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e3:0x0].0x0 (ffff8800a5c6e700) 00010000:00010000:3.0:1716999790.266413:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.266415:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc79e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266419:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc79e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266453:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc79d2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266458:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc79d2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266462:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc79d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266465:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.266467:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc79d2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266471:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc79d2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266475:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:3.0:1716999790.266476:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.266478:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc79d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.266481:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc79d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999790.266486:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339ffb80 reply state ffff88009c0e0000 transno 4294986417 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc79d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.266491:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.266543:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480764736:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 980us (1143us total) trans 4294986417 rc 0/0 00000100:00100000:3.0:1716999790.266549:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45865 00000100:00100000:2.0:1716999790.266756:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480764608 00000100:00100000:2.0:1716999790.266761:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480764608 00000100:00100000:2.0:1716999790.266781:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9293 00000100:00100000:2.0:1716999790.266786:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480764608:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.266917:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480764608:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 130us (2333us total) trans 4294986418 rc 0/0 00000100:00100000:2.0:1716999790.266923:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9293 00010000:00010000:2.0:1716999790.268105:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc79d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.268112:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc79d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.268117:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc79d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.268121:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.268123:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc79d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.268127:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc79d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dd:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.268139:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x3dce1c64 (ffff8800a5c6e200) 00010000:00010000:2.0:1716999790.268141:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.268143:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc79d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.268148:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc79d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dd:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.270254:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.270326:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480764800 00000100:00100000:1.0:1716999790.270332:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480764800 00000100:00100000:1.0:1716999790.270714:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9294 00000100:00100000:1.0:1716999790.270721:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480764800:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:0.0:1716999790.271777:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.271794:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480764928 00000100:00100000:0.0:1716999790.271808:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480764928 00000100:00100000:0.0:1716999790.271842:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45866 00000100:00100000:0.0:1716999790.271847:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480764928:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.271898:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999790.272162:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf6d00/0x6d188eabd8d7ff29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ec:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50946 expref: 533 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.272708:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d6f40/0x6d188eabd8d7d8da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ec:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fc96 expref: 532 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.272720:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e21c0/0x6d188eabd8d7d7fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ec:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fc5e expref: 531 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.272728:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f24240/0x6d188eabd8d710c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ec:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9d0 expref: 530 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.272739:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ec:0x0].0x0 (ffff88009c872300) 00010000:00010000:0.0:1716999790.272748:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.272768:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc79ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.272778:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc79ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.272785:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc79ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.272793:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc79f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dc:0x0].0xf9a88606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.272807:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc79f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.272812:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc79f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273111:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc79fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6ec:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273118:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc79fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273123:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc79fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:0.0:1716999790.273505:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1512, 64 off105024 00000040:00080000:0.0:1716999790.273523:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11671, 184 off2086752 00010000:00010000:0.0:1716999790.273574:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7a03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ec:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273581:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7a03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273587:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7a03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273592:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7a03 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273597:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7a03 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273602:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7a03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273607:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7a03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273612:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.273614:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7a03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273619:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7a03 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273625:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ec:0x0].0x0 (ffff88008a83f600) 00010000:00010000:0.0:1716999790.273627:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.273630:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7a03 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273635:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7a03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ec:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273653:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc79fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273658:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc79fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273663:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc79fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273666:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.273668:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc79fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273672:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc79fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273677:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ec:0x0].0x0 (ffff88008a83f600) 00010000:00010000:0.0:1716999790.273679:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.273681:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc79fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273684:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc79fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6ec:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273722:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc79ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273727:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc79ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273731:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc79ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273735:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.273737:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc79ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273744:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc79ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273749:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:0.0:1716999790.273750:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.273752:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc79ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999790.273756:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc79ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:0.0:1716999790.273761:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339fdf80 reply state ffff88012d28b000 transno 4294986419 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc79f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999790.273767:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.273858:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480764928:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2008us (2081us total) trans 4294986419 rc 0/0 00000100:00100000:0.0:1716999790.273864:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45866 00010000:00010000:1.0:1716999790.277616:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc79f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999790.277628:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc79f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999790.277634:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc79f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999790.277639:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.277643:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc79f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999790.277649:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc79f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999790.277660:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0xf9a88606 (ffff88008a83ff00) 00010000:00010000:1.0:1716999790.277663:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.277667:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc79f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999790.277671:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc79f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0xf9a88606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999790.278006:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.278096:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480765056 00000100:00100000:2.0:1716999790.278103:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480765056 00000100:00100000:2.0:1716999790.278140:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9295 00000100:00100000:2.0:1716999790.278146:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480765056:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:2.0:1716999790.278477:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986420 00000040:00080000:2.0:1716999790.278607:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11672, 168 off2086920 00000001:00080000:2.0:1716999790.278612:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986421 00000100:00100000:2.0:1716999790.278682:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+534:11419:x1800404480765056:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 535us (679us total) trans 4294986422 rc 0/0 00000100:00100000:2.0:1716999790.278688:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9295 00000020:00080000:2.0:1716999790.278692:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1716999790.279508:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480764800:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 8785us (9257us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.279515:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9294 00000100:00100000:0.0:1716999790.281094:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.282115:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480765184 00000100:00100000:1.0:1716999790.282121:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480765184 00000100:00100000:1.0:1716999790.282537:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9296 00000100:00100000:1.0:1716999790.282543:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480765184:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.282708:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480765184:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 165us (1617us total) trans 4294986423 rc 0/0 00000100:00100000:1.0:1716999790.282714:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9296 00000100:00100000:0.0:1716999790.285815:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.285971:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480765312 00000100:00100000:2.0:1716999790.285978:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480765312 00000100:00100000:2.0:1716999790.286370:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45867 00000100:00100000:2.0:1716999790.286377:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480765312:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.286418:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.286437:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905da1c0/0x6d188eabd8d80d68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6e0:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50e01 expref: 533 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.286453:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1f80/0x6d188eabd8d7ceca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6e0:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f963 expref: 532 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.286462:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e18c0/0x6d188eabd8d7ce6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f939 expref: 531 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.286471:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091187a80/0x6d188eabd8d70d2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b825 expref: 530 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.286480:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e0:0x0].0x0 (ffff880091e2d600) 00010000:00010000:2.0:1716999790.286487:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.286508:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc7a0a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.286517:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc7a0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.286524:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc7a0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.286533:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7a11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dc:0x0].0xf61990e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.286538:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.286542:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.286621:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7a18 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.286627:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7a18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.286636:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7a18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:2.0:1716999790.287056:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1513, 64 off105088 00000040:00080000:2.0:1716999790.287075:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11673, 184 off2087104 00010000:00010000:2.0:1716999790.287125:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7a1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287132:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7a1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287137:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7a1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287142:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7a1f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287147:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7a1f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287151:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7a1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287156:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7a1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287160:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.287162:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7a1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287167:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7a1f lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287173:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e0:0x0].0x0 (ffff880088977300) 00010000:00010000:2.0:1716999790.287175:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.287177:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7a1f lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287180:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc7a1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287196:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7a18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287199:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7a18 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287203:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7a18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287206:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.287208:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7a18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287211:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7a18 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287216:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e0:0x0].0x0 (ffff880088977300) 00010000:00010000:2.0:1716999790.287218:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.287220:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7a18 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287224:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc7a18 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287258:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc7a0a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287263:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc7a0a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287267:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc7a0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287270:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.287272:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc7a0a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287275:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc7a0a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287280:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:2.0:1716999790.287282:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.287284:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc7a0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.287287:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc7a0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999790.287293:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339ff100 reply state ffff88012e8a4000 transno 4294986424 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999790.287297:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.287344:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480765312:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 967us (1545us total) trans 4294986424 rc 0/0 00000100:00100000:2.0:1716999790.287350:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45867 00000100:00100000:0.0:1716999790.290106:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.290783:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.290840:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480765440 00000100:00100000:3.0:1716999790.290848:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480765440 00000100:00100000:3.0:1716999790.290905:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9297 00000100:00100000:3.0:1716999790.290912:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eea8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+531:11420:x1800404480765440:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999790.291311:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11674, 168 off2087272 00000001:00080000:3.0:1716999790.291316:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986425 00000100:00100000:3.0:1716999790.291389:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eea8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480765440:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 476us (1288us total) trans 4294986426 rc 0/0 00000100:00100000:3.0:1716999790.291395:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9297 00000020:00080000:3.0:1716999790.291399:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.292167:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.292223:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480765632 00000100:00100000:1.0:1716999790.292228:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480765632 00000100:00100000:1.0:1716999790.292249:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9298 00000100:00100000:1.0:1716999790.292254:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480765632:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999790.292525:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11675, 168 off2087440 00000001:00080000:1.0:1716999790.292530:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986427 00000100:00100000:1.0:1716999790.292582:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480765632:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 327us (415us total) trans 4294986428 rc 0/0 00000100:00100000:1.0:1716999790.292588:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9298 00000020:00080000:1.0:1716999790.292591:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1716999790.292809:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7a11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.292818:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7a11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.292823:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7a11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.292828:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.292832:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7a11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.292837:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7a11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.292850:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0xf61990e9 (ffff880088977000) 00010000:00010000:2.0:1716999790.292852:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.292855:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7a11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.292859:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc7a11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0xf61990e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999790.294793:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480765504 00000100:00100000:3.0:1716999790.294813:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480765504 00000100:00100000:3.0:1716999790.294855:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45868 00000100:00100000:3.0:1716999790.294862:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+534:11564:x1800404480765504:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:3.0:1716999790.294875:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.294905:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7a26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66214 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.294929:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66214 expref: 535 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.294939:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66214 expref: 535 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.294946:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999790.294948:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.294950:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c53cc0, rc 0) 00000100:00100000:3.0:1716999790.294988:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+535:11564:x1800404480765504:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 127us (4206us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.294994:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45868 00000100:00100000:0.0:1716999790.295415:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.295456:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.295733:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480765760 00000100:00100000:1.0:1716999790.295738:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480765760 00000100:00100000:1.0:1716999790.295979:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480765888 00000100:00100000:1.0:1716999790.295983:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480765888 00000100:00100000:1.0:1716999790.295999:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9299 00000100:00100000:1.0:1716999790.296005:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480765760:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.296140:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480765760:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 134us (725us total) trans 4294986429 rc 0/0 00000100:00100000:1.0:1716999790.296146:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9299 00000100:00100000:1.0:1716999790.296156:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9300 00000100:00100000:1.0:1716999790.296160:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480765888:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.296221:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480765888:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 59us (765us total) trans 4294986430 rc 0/0 00000100:00100000:1.0:1716999790.296226:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9300 00000100:00100000:0.0:1716999790.298723:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.299833:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.300144:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480765952 00000100:00100000:2.0:1716999790.300151:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480765952 00000100:00100000:2.0:1716999790.300846:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9301 00000100:00100000:2.0:1716999790.300854:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+537:11564:x1800404480765952:12345-192.168.203.3@tcp:37:ll_sa.0 00000100:00100000:0.0:1716999790.301653:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.302040:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480766080 00000100:00100000:3.0:1716999790.302046:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480766080 00000100:00100000:3.0:1716999790.302074:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45869 00000100:00100000:3.0:1716999790.302079:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+539:11419:x1800404480766080:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.302112:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.302133:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094778fc0/0x6d188eabd8d8f82e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6e2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f55520 expref: 539 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.302163:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216cd80/0x6d188eabd8d7d028 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6e2:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f9e1 expref: 538 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.302174:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ef180/0x6d188eabd8d7d005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f9d3 expref: 537 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.302184:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fb180/0x6d188eabd8d70dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b86b expref: 536 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.302191:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e2:0x0].0x0 (ffff880092624200) 00010000:00010000:3.0:1716999790.302198:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.302214:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7a2d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302224:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7a2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302231:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7a2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302239:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7a34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dc:0x0].0x3dce1c64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302244:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7a34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302249:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7a34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302308:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7a3b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302313:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7a3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302318:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7a3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:3.0:1716999790.302673:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1514, 64 off105152 00000040:00080000:3.0:1716999790.302690:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11676, 184 off2087624 00010000:00010000:3.0:1716999790.302739:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7a42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302745:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7a42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302750:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7a42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302755:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7a42 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302760:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7a42 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302765:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7a42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302770:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7a42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302774:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.302777:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7a42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302783:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7a42 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302789:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e2:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999790.302791:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.302793:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7a42 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302813:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7a42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302829:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7a3b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302833:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7a3b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302837:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7a3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302841:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.302843:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7a3b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302848:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7a3b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302853:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e2:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999790.302855:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.302857:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7a3b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302861:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7a3b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302906:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7a2d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302922:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7a2d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302927:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7a2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302931:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.302933:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7a2d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302937:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7a2d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302942:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:3.0:1716999790.302944:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.302946:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7a2d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.302950:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7a2d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:3.0:1716999790.302956:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131d5e680 reply state ffff88009c203000 transno 4294986431 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7a34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999790.302961:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.302995:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480766080:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 915us (3163us total) trans 4294986431 rc 0/0 00000100:00100000:3.0:1716999790.303002:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45869 00000100:00100000:3.0:1716999790.303763:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480766208 00000100:00100000:3.0:1716999790.303770:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480766208 00000100:00100000:3.0:1716999790.303793:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45870 00000100:00100000:3.0:1716999790.303811:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480766208:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.303841:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:3.0:1716999790.303854:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093538240/0x6d188eabd8d8756c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c5:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52acc expref: 537 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.303868:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013541a1c0/0x6d188eabd8d7b405 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c5:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f072 expref: 536 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.303896:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf51f80/0x6d188eabd8d7b364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f048 expref: 535 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.303911:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fa400/0x6d188eabd8d70384 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b44a expref: 534 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.303919:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c5:0x0].0x0 (ffff8800a660c500) 00010000:00010000:3.0:1716999790.303930:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c0b40/0x6d188eabd8dc6ebf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66165 expref: 533 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.303938:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999790.303940:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.303956:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.303964:0:6822:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7a26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66214 expref: 532 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.303971:0:6822:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.303993:0:6822:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66214 expref: 532 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.304003:0:6822:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7a26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66214 expref: 532 pid: 6822 timeout: 409 lvb_type: 0 00000100:00100000:3.0:1716999790.304015:0:6822:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6822:1800404483017344:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999790.304066:0:6822:0:(client.c:2542:ptlrpc_set_wait()) set ffff880131c0a600 going to sleep for 11 seconds 00000100:00100000:2.0:1716999790.305029:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+531:11564:x1800404480765952:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 4173us (6308us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.305037:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9301 00000100:00100000:1.0:1716999790.310634:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999790.310702:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7a34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.310711:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7a34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.310717:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7a34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.310724:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.310728:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7a34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.310733:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7a34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.310745:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x3dce1c64 (ffff8800a5c6ec00) 00010000:00010000:2.0:1716999790.310748:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.310750:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7a34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.310754:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7a34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0x3dce1c64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999790.310858:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480766336 00000100:00100000:3.0:1716999790.310865:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480766336 00000100:00100000:3.0:1716999790.310909:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9302 00000100:00100000:3.0:1716999790.310914:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+530:11419:x1800404480766336:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999790.311145:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11677, 168 off2087792 00000100:00100000:3.0:1716999790.311231:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480766336:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 316us (604us total) trans 4294986432 rc 0/0 00000100:00100000:3.0:1716999790.311237:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9302 00000100:00100000:2.0:1716999790.313907:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.314749:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480766400 00000100:00100000:0.0:1716999790.314756:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480766400 00010000:00010000:0.0:1716999790.314783:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7a26 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66214 expref: 531 pid: 6822 timeout: 409 lvb_type: 0 00000100:00100000:0.0:1716999790.314814:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4581 00000100:00100000:0.0:1716999790.314819:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+531:1956:x1800404480766400:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999790.314831:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999790.314836:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7a26 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66214 expref: 531 pid: 6822 timeout: 409 lvb_type: 0 00010000:00010000:0.0:1716999790.314845:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7a26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66214 expref: 531 pid: 6822 timeout: 409 lvb_type: 0 00010000:00010000:0.0:1716999790.314862:0:16642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999790.314866:0:16642:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.314873:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.314897:0:16642:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.314919:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999790.314949:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+531:1956:x1800404480766400:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 130us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.314955:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4581 00000100:00100000:0.0:1716999790.315013:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.315206:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480766528 00000100:00100000:2.0:1716999790.315210:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480766528 00000100:00100000:2.0:1716999790.315227:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9303 00000100:00100000:2.0:1716999790.315231:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eea8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480766528:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.315364:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eea8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480766528:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 132us (351us total) trans 4294986433 rc 0/0 00000100:00100000:2.0:1716999790.315370:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9303 00010000:00010000:3.0:1716999790.316197:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7a26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66214 expref: 531 pid: 6822 timeout: 409 lvb_type: 0 00000100:00100000:3.0:1716999790.316208:0:6822:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6822:1800404483017344:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999790.316225:0:6822:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316231:0:6822:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316235:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316251:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7a50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x37eb7f65 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316258:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7a50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316264:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7a50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316349:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7a57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316354:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7a57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316359:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7a57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999790.316744:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1519, 64 off105472 00000040:00080000:3.0:1716999790.316764:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11678, 184 off2087976 00010000:00010000:3.0:1716999790.316824:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7a5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316832:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316838:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7a5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316844:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7a5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316849:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7a5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316857:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7a5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316862:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7a5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316867:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.316870:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7a5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316876:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7a5e lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316904:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c5:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.316906:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.316909:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7a5e lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316913:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7a5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316929:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7a57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316933:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7a57 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316937:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7a57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316940:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.316942:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7a57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316949:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7a57 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316954:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c5:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.316955:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.316957:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7a57 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316960:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7a57 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6c5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316992:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.316997:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.317001:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.317004:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.317006:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.317010:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.317015:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999790.317017:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.317019:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.317022:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7a49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999790.317029:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131d5c700 reply state ffff88009ed8d000 transno 4294986434 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7a50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.317034:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.317083:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480766208:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 13282us (15429us total) trans 4294986434 rc 0/0 00000100:00100000:3.0:1716999790.317090:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45870 00000100:00100000:0.0:1716999790.318181:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.318497:0:4523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480766592 00000100:00100000:3.0:1716999790.318504:0:4523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480766592 00000100:00100000:3.0:1716999790.318529:0:4523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:3.0:1716999790.318535:0:4523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:1958:x1800404480766592:12345-192.168.203.3@tcp:63:ll_sa.0 00010000:00010000:3.0:1716999790.318559:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.318571:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7a65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6621b expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.318601:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7a6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318611:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7a6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318618:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7a6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318627:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7a73 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318633:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318638:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318708:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7a7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318714:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318720:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:3.0:1716999790.318740:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc39:0x0]: returning size 11991 00000004:00200000:3.0:1716999790.318743:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999790.318754:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318761:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318766:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7a6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318777:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7a6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318782:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7a6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318787:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.318789:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7a6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318794:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7a6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318813:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999790.318816:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.318819:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7a6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318824:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7a6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318832:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7a73 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318837:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7a73 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318841:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318845:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.318848:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7a73 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318852:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7a73 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318858:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999790.318860:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.318861:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7a73 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.318866:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7a73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319486:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7a65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6621b expref: 534 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.319498:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7a7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6621b expref: 533 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.319502:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:3.0:1716999790.319503:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999790.319505:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c506c0, rc 0) 00010000:00010000:3.0:1716999790.319508:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.319513:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7a81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66222 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.319526:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7a88 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319531:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319535:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319541:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7a8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319544:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319547:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319583:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7a96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319586:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319589:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:3.0:1716999790.319600:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0xc31:0x0]: returning size 15360 00000004:00200000:3.0:1716999790.319602:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999790.319606:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319610:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7a96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319613:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7a88 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319615:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7a88 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319617:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7a88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319620:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.319621:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7a88 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319624:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7a88 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319628:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999790.319629:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.319630:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7a88 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319633:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7a88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319637:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319640:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7a8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319642:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7a8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319644:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.319646:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7a8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319648:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7a8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319650:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff8800a5c6eb00) 00010000:00010000:3.0:1716999790.319651:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.319652:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7a8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319655:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7a8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:3.0:1716999790.319664:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7a81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66222 expref: 535 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.319669:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7a96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66222 expref: 534 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.319672:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:3.0:1716999790.319673:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1716999790.319674:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50240, rc 0) 00000100:00100000:3.0:1716999790.319707:0:4523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+534:1958:x1800404480766592:12345-192.168.203.3@tcp:63:ll_sa.0 Request processed in 1173us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.319712:0:4523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 14 00000100:00100000:2.0:1716999790.320053:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.320311:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480766720 00000100:00100000:3.0:1716999790.320316:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480766720 00000100:00100000:3.0:1716999790.320351:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45871 00000100:00100000:3.0:1716999790.320356:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+534:11419:x1800404480766720:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.320452:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.320464:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133141d40/0x6d188eabd8d7fdd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6e6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f508d6 expref: 534 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.320476:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012facfcc0/0x6d188eabd8d7d33f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6e6:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fac8 expref: 533 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.320485:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0d80/0x6d188eabd8d7d2b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fa90 expref: 532 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.320495:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fb3c0/0x6d188eabd8d70ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8fe expref: 531 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.320502:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e6:0x0].0x0 (ffff880091e2e300) 00010000:00010000:3.0:1716999790.320507:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.320521:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7a9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.320530:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.320539:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.320547:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7aa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dc:0x0].0xc7fe5838 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.320552:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.320557:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.320613:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7aab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.320619:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7aab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.320625:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7aab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999790.321107:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1515, 64 off105216 00000040:00080000:3.0:1716999790.321126:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11679, 184 off2088160 00010000:00010000:3.0:1716999790.321175:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7ab2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321181:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321187:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7ab2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321193:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7ab2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321201:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7ab2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321206:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7ab2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321210:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7ab2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321214:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c518c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.321216:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7ab2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321222:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7ab2 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321228:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e6:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999790.321230:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.321233:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7ab2 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321237:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7ab2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321252:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7aab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321256:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7aab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321260:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7aab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321264:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c533c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.321266:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7aab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321271:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7aab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321276:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e6:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999790.321278:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.321280:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7aab lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321285:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7aab lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321319:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321323:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7a9d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321327:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7a9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321331:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.321333:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7a9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321337:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7a9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321343:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:3.0:1716999790.321345:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.321347:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7a9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.321354:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7a9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999790.321361:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135029f80 reply state ffff8801310dc000 transno 4294986435 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.321366:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.321405:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480766720:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1048us (1352us total) trans 4294986435 rc 0/0 00000100:00100000:3.0:1716999790.321411:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45871 00010000:00010000:0.0:1716999790.321511:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7a50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.321517:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7a50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.321522:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7a50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.321526:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.321528:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7a50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.321533:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7a50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.321540:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x37eb7f65 (ffff8800a5c6e200) 00010000:00010000:0.0:1716999790.321542:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.321544:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7a50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.321551:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7a50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x37eb7f65 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.322264:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.323089:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999790.323135:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.323143:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7aa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.323152:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7aa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999790.323155:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480766848 00010000:00010000:2.0:1716999790.323161:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa1389790) 00000100:00100000:1.0:1716999790.323162:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480766848 00010000:00010000:2.0:1716999790.323164:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7aa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.323168:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7aa4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.323177:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0xc7fe5838 (ffff8800a5c6e100) 00010000:00010000:2.0:1716999790.323179:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.323181:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7aa4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.323185:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7aa4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0xc7fe5838 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999790.323185:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9304 00000100:00100000:1.0:1716999790.323191:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+531:11420:x1800404480766848:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.323921:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480766976 00000100:00100000:3.0:1716999790.323926:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480766976 00000100:00100000:3.0:1716999790.323953:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9305 00000100:00100000:3.0:1716999790.323958:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480766976:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999790.324220:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11680, 168 off2088328 00000001:00080000:1.0:1716999790.324227:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986436 00000040:00080000:3.0:1716999790.324234:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11681, 168 off2088496 00000100:00100000:1.0:1716999790.324315:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480766848:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1123us (2051us total) trans 4294986437 rc 0/0 00000100:00100000:3.0:1716999790.324316:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+534:11419:x1800404480766976:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 356us (1226us total) trans 4294986438 rc 0/0 00000100:00100000:1.0:1716999790.324322:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9304 00000100:00100000:3.0:1716999790.324326:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9305 00000020:00080000:1.0:1716999790.324326:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999790.325912:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.325979:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480767104 00000100:00100000:3.0:1716999790.325984:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480767104 00000100:00100000:3.0:1716999790.326004:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9306 00000100:00100000:3.0:1716999790.326009:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480767104:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.326279:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.326326:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480767232 00000100:00100000:0.0:1716999790.326330:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480767232 00000100:00100000:0.0:1716999790.326346:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9307 00000100:00100000:0.0:1716999790.326350:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480767232:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.326375:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480767104:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 364us (464us total) trans 4294986439 rc 0/0 00000100:00100000:3.0:1716999790.326381:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9306 00000100:00100000:0.0:1716999790.326433:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480767232:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 81us (154us total) trans 4294986440 rc 0/0 00000100:00100000:0.0:1716999790.326441:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9307 00000100:00100000:1.0:1716999790.328758:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.328843:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480767488 00000100:00100000:3.0:1716999790.328849:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480767488 00000100:00100000:0.0:1716999790.329013:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.329181:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480767424 00000100:00100000:3.0:1716999790.329184:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480767424 00000100:00100000:3.0:1716999790.329415:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45872 00000100:00100000:3.0:1716999790.329422:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480767488:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.329458:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.329475:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009186df80/0x6d188eabd8d8095c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f0:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50caa expref: 536 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.329492:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091185f80/0x6d188eabd8d7dbf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6f0:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fda7 expref: 535 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.329502:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0b40/0x6d188eabd8d7db3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fd6f expref: 534 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.329512:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091186ac0/0x6d188eabd8d711fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba5c expref: 533 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.329520:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f0:0x0].0x0 (ffff88009cfbdc00) 00010000:00010000:3.0:1716999790.329528:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.329547:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7ab9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.329556:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.329564:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.329573:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ac0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dc:0x0].0x66c02682 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.329581:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.329586:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.329661:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7ac7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6f0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.329667:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7ac7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.329672:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7ac7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999790.329709:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45873 00000100:00100000:1.0:1716999790.329714:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480767424:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.329730:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.329739:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094779b00/0x6d188eabd8d87fad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c9:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52e14 expref: 532 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.329762:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8d7b922 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c9:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f21d expref: 531 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.329771:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7edb00/0x6d188eabd8d7b87a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f1de expref: 530 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.329782:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c5761c0/0x6d188eabd8d7049c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4cf expref: 529 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.329790:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c9:0x0].0x0 (ffff880092a37e00) 00010000:00010000:1.0:1716999790.330235:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.330275:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7ace lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330282:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7ace lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330287:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7ace lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330292:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7ad5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0xbfc2eca6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330295:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330298:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330340:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7adc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330345:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7adc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330349:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7adc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:0.0:1716999790.330742:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1520, 64 off105536 00000040:00080000:0.0:1716999790.330760:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11682, 184 off2088680 00010000:00010000:0.0:1716999790.330820:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7ae3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330828:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330832:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7ae3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330836:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7ae3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330839:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7ae3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330842:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7ae3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330844:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7ae3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330848:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.330850:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7ae3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330853:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7ae3 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330857:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c9:0x0].0x0 (ffff88008a83f400) 00010000:00010000:0.0:1716999790.330858:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.330860:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7ae3 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330862:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7ae3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330877:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7adc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330893:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7adc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330896:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7adc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330898:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.330899:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7adc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330902:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7adc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330905:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c9:0x0].0x0 (ffff88008a83f400) 00010000:00010000:0.0:1716999790.330906:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.330907:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7adc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330917:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7adc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6c9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330944:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7ace lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330947:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7ace lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330949:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7ace lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330952:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.330953:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7ace lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330958:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7ace lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330961:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999790.330962:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.330963:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7ace lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.330966:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7ace lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999790.330970:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131d5e300 reply state ffff8800a6704000 transno 4294986441 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.330973:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000040:00080000:3.0:1716999790.330985:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1516, 64 off105280 00000040:00080000:3.0:1716999790.330998:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11683, 176 off2088856 00000100:00100000:0.0:1716999790.331023:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+531:11420:x1800404480767424:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1308us (2010us total) trans 4294986441 rc 0/0 00000100:00100000:0.0:1716999790.331028:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45873 00010000:00010000:3.0:1716999790.331155:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7aea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331163:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331170:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7aea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331175:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7aea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331179:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7aea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331184:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7aea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331192:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7aea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331196:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.331198:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7aea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331203:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7aea lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331209:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f0:0x0].0x0 (ffff8800a5c6e200) 00010000:00010000:3.0:1716999790.331211:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.331213:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7aea lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331218:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7aea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331229:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7ac7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331234:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7ac7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331238:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7ac7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331242:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.331244:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7ac7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331248:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7ac7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331256:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f0:0x0].0x0 (ffff8800a5c6e200) 00010000:00010000:3.0:1716999790.331258:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.331260:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7ac7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331264:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7ac7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6f0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331292:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331297:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7ab9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331302:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7ab9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331305:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.331308:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7ab9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331312:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7ab9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331318:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:3.0:1716999790.331320:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.331322:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7ab9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.331326:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7ab9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999790.331332:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df0000 reply state ffff8801310de000 transno 4294986442 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.331337:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.331399:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480767488:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1976us (2644us total) trans 4294986442 rc 0/0 00000100:00100000:3.0:1716999790.331405:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45872 00010000:00010000:2.0:1716999790.332031:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.332038:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7ad5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.332042:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7ad5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.332046:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.332048:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7ad5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.332053:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7ad5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.332061:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0xbfc2eca6 (ffff88008a83f600) 00010000:00010000:2.0:1716999790.332062:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.332065:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7ad5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.332069:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7ad5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0xbfc2eca6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.333923:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.333959:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480767616 00000100:00100000:1.0:1716999790.333966:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480767616 00010000:00010000:2.0:1716999790.334118:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.334126:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ac0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.334131:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.334134:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.334137:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.334143:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ac0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.334152:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x66c02682 (ffff8800a5c6ec00) 00010000:00010000:2.0:1716999790.334154:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.334157:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ac0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.334161:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ac0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0x66c02682 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999790.334258:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9308 00000100:00100000:1.0:1716999790.334264:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+529:11420:x1800404480767616:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999790.334600:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11685, 168 off2089128 00000001:00080000:1.0:1716999790.334606:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986443 00000100:00100000:1.0:1716999790.335446:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+531:11420:x1800404480767616:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1178us (1563us total) trans 4294986444 rc 0/0 00000100:00100000:1.0:1716999790.335453:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9308 00000020:00080000:1.0:1716999790.335458:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999790.335579:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.335634:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480767744 00000100:00100000:3.0:1716999790.335639:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480767744 00000100:00100000:3.0:1716999790.335657:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9309 00000100:00100000:3.0:1716999790.335661:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eea8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480767744:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:3.0:1716999790.335858:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11686, 168 off2089296 00000100:00100000:3.0:1716999790.335942:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eea8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480767744:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 280us (458us total) trans 4294986445 rc 0/0 00000100:00100000:3.0:1716999790.335948:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9309 00000100:00100000:0.0:1716999790.338012:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.338055:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.338565:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480768000 00000100:00100000:2.0:1716999790.338572:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480768000 00000100:00100000:2.0:1716999790.338601:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9310 00000100:00100000:2.0:1716999790.338606:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480768000:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.338748:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480768000:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 141us (692us total) trans 4294986446 rc 0/0 00000100:00100000:2.0:1716999790.338754:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9310 00000100:00100000:3.0:1716999790.338958:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480767872 00000100:00100000:3.0:1716999790.338963:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480767872 00000100:00100000:3.0:1716999790.339033:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45874 00000100:00100000:3.0:1716999790.339038:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480767872:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.339059:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1716999790.339076:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7a7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc39:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6621b expref: 533 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.339091:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e8d80/0x6d188eabd8dc4dfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc39:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f656ad expref: 532 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.339100:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc4dd3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc39:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6569f expref: 531 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.339113:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff88009240e500) 00010000:00010000:3.0:1716999790.339119:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.339136:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7af1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339146:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7af1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339153:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7af1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339162:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7af8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339167:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7af8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339171:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7af8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339242:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7aff lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339248:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7aff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339253:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7aff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999790.339605:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1517, 64 off105344 00000040:00080000:3.0:1716999790.339623:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11687, 176 off2089472 00010000:00010000:3.0:1716999790.339665:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7b06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339672:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7b06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339678:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7b06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339683:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7b06 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339688:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7b06 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339693:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7b06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339698:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7b06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339703:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52400 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.339706:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7b06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339711:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7b06 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339717:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.339720:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.339723:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7b06 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339727:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7b06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339741:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7aff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339746:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7aff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339750:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7aff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339754:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.339756:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7aff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339760:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7aff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339765:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc39:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.339766:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.339769:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7aff lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339773:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7aff lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339823:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7af1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339829:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7af1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339834:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7af1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339837:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.339840:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7af1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339847:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7af1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339853:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999790.339855:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.339857:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7af1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.339861:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7af1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999790.339867:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131d5fb80 reply state ffff8801310df000 transno 4294986447 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7af8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.339873:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.339926:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480767872:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 886us (1916us total) trans 4294986447 rc 0/0 00000100:00100000:3.0:1716999790.339932:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45874 00000100:00100000:0.0:1716999790.343194:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999790.343289:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7af8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.343297:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7af8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.343303:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7af8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.343308:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c521c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.343312:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7af8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.343317:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7af8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.343329:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x4b9bf994 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999790.343331:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.343334:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7af8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.343338:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7af8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x4b9bf994 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999790.343402:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480768128 00000100:00100000:1.0:1716999790.343409:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480768128 00000100:00100000:1.0:1716999790.343654:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45875 00000100:00100000:1.0:1716999790.343660:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480768128:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.343697:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.343709:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133143600/0x6d188eabd8d7fe42 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6e8:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f508f9 expref: 531 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.343722:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e1d40/0x6d188eabd8d7d641 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6e8:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fba8 expref: 530 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.343733:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215d440/0x6d188eabd8d7d55a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fb69 expref: 529 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.343742:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091187600/0x6d188eabd8d70f93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b944 expref: 528 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.343749:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e8:0x0].0x0 (ffff880091e2da00) 00010000:00010000:1.0:1716999790.343755:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.343775:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7b0d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.343784:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7b0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.343791:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7b0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.343814:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7b14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dc:0x0].0x7264b700 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.343823:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7b14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.343828:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7b14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.344649:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.344665:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480768256 00000100:00100000:0.0:1716999790.344668:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480768256 00000100:00100000:0.0:1716999790.344685:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9311 00000100:00100000:0.0:1716999790.344690:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+528:11420:x1800404480768256:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:0.0:1716999790.345005:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986448 00000040:00080000:0.0:1716999790.345124:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11688, 168 off2089640 00000001:00080000:0.0:1716999790.345129:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986449 00000100:00100000:0.0:1716999790.345192:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+531:11420:x1800404480768256:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 501us (543us total) trans 4294986450 rc 0/0 00000100:00100000:0.0:1716999790.345198:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9311 00000020:00080000:0.0:1716999790.345202:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1716999790.345685:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7b1b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.345694:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7b1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.345701:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7b1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:1.0:1716999790.346034:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1518, 64 off105408 00000040:00080000:1.0:1716999790.346047:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11689, 184 off2089824 00010000:00010000:1.0:1716999790.346090:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7b22 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346098:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7b22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346104:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7b22 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346110:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7b22 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346115:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7b22 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346119:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7b22 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346128:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7b22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346132:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0000 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.346135:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7b22 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346140:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7b22 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346148:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e8:0x0].0x0 (ffff8800a6ad7a00) 00010000:00010000:1.0:1716999790.346150:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.346152:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7b22 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346156:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7b22 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346169:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7b1b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346174:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7b1b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346179:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7b1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346182:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.346184:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7b1b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346188:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7b1b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346197:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e8:0x0].0x0 (ffff8800a6ad7a00) 00010000:00010000:1.0:1716999790.346198:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.346200:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7b1b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346204:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7b1b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346237:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7b0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346242:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7b0d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346246:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7b0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346250:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.346252:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7b0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346257:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7b0d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346262:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:1.0:1716999790.346264:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.346266:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7b0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.346270:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7b0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999790.346276:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131d5f480 reply state ffff8801331bf000 transno 4294986451 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7b14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999790.346282:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.348423:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480768128:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 4757us (5229us total) trans 4294986451 rc 0/0 00000100:00100000:1.0:1716999790.348431:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45875 00000100:00100000:0.0:1716999790.350664:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.352538:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999790.352541:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7b14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.352549:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7b14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.352556:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7b14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.352561:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.352564:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7b14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.352574:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7b14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.352586:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x7264b700 (ffff8800a6ad7700) 00010000:00010000:3.0:1716999790.352589:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.352592:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7b14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.352596:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7b14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0x7264b700 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999790.352662:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480768512 00000100:00100000:2.0:1716999790.352669:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480768512 00000100:00100000:2.0:1716999790.352697:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9312 00000100:00100000:2.0:1716999790.352703:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480768512:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.352720:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480768384 00000100:00100000:1.0:1716999790.352724:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480768384 00000100:00100000:1.0:1716999790.352741:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45876 00000100:00100000:1.0:1716999790.352745:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480768384:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.352767:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1716999790.352779:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7a96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66222 expref: 532 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.352791:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdeac0/0x6d188eabd8dc44a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653b9 expref: 531 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.352810:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97180/0x6d188eabd8dc4479 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc31:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f653ab expref: 530 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.352817:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff88009330d200) 00010000:00010000:1.0:1716999790.352823:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.352839:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc7b29 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.352848:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc7b29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.352853:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc7b29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.352864:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7b30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.352868:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7b30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.352872:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7b30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.352948:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7b37 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.352953:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7b37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.352958:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7b37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:2.0:1716999790.353112:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11690, 168 off2089992 00000001:00080000:2.0:1716999790.353117:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986452 00000100:00100000:2.0:1716999790.353187:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480768512:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 484us (653us total) trans 4294986453 rc 0/0 00000100:00100000:2.0:1716999790.353194:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9312 00000020:00080000:2.0:1716999790.353197:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1716999790.353290:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1519, 64 off105472 00000040:00080000:1.0:1716999790.353303:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11691, 184 off2090176 00010000:00010000:0.0:1716999790.354741:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7b3e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354750:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7b3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354757:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7b3e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354762:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7b3e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354766:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7b3e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354770:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7b3e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354775:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7b3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354779:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.354781:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7b3e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354785:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7b3e lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354796:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff8800a6ad7500) 00010000:00010000:0.0:1716999790.354807:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.354810:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7b3e lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354814:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7b3e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354832:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7b37 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354836:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7b37 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354840:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7b37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354843:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b21c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.354845:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7b37 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354849:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7b37 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354854:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc31:0x0].0x0 (ffff8800a6ad7500) 00010000:00010000:0.0:1716999790.354855:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.354857:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7b37 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354861:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc7b37 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354910:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc7b29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354914:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc7b29 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354918:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc7b29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354921:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.354923:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc7b29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354927:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc7b29 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354932:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999790.354934:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.354936:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc7b29 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.354939:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc7b29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999790.354945:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131d5dc00 reply state ffff88009c1e7000 transno 4294986454 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7b30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.354950:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.354999:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480768384:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2251us (4338us total) trans 4294986454 rc 0/0 00000100:00100000:0.0:1716999790.355005:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45876 00000100:00100000:1.0:1716999790.357394:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.358346:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480768640 00000100:00100000:0.0:1716999790.358354:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480768640 00000100:00100000:0.0:1716999790.358389:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9313 00000100:00100000:0.0:1716999790.358395:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480768640:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:3.0:1716999790.358432:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7b30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.358441:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7b30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.358447:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7b30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.358451:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.358454:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7b30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.358459:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7b30 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.358469:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x7fa9a95 (ffff8800a6ad7e00) 00010000:00010000:3.0:1716999790.358471:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.358474:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7b30 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.358479:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7b30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x7fa9a95 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.358548:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480768640:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 153us (1158us total) trans 4294986455 rc 0/0 00000100:00100000:0.0:1716999790.358555:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9313 00000100:00100000:1.0:1716999790.360036:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.360085:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480768768 00000100:00100000:0.0:1716999790.360089:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480768768 00000100:00100000:0.0:1716999790.360116:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9314 00000100:00100000:0.0:1716999790.360121:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480768768:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999790.360462:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11692, 168 off2090344 00000001:00080000:0.0:1716999790.360467:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986456 00000100:00100000:0.0:1716999790.360534:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480768768:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 411us (499us total) trans 4294986457 rc 0/0 00000100:00100000:0.0:1716999790.360540:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9314 00000020:00080000:0.0:1716999790.360544:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999790.361261:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.362059:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480768896 00000100:00100000:0.0:1716999790.362065:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480768896 00000100:00100000:0.0:1716999790.362093:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45877 00000100:00100000:0.0:1716999790.362099:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+534:11419:x1800404480768896:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.362125:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00000100:00100000:1.0:1716999790.362128:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999790.362140:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880133142400/0x6d188eabd8d7f96b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6e4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50755 expref: 534 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.362164:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e2f40/0x6d188eabd8d7d116 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6e4:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fa19 expref: 533 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.362174:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646bcc0/0x6d188eabd8d7d0d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fa0b expref: 532 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.362195:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65f8900/0x6d188eabd8d70e5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6e4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8b8 expref: 531 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.362203:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e4:0x0].0x0 (ffff880091e2ea00) 00010000:00010000:0.0:1716999790.362210:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.362227:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7b45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362236:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7b45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362243:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7b45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362252:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7b4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dc:0x0].0xdfedbb38 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362257:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362262:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362324:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7b53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6e4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362329:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7b53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362334:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7b53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:0.0:1716999790.362636:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1520, 64 off105536 00000040:00080000:0.0:1716999790.362652:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11693, 184 off2090528 00010000:00010000:0.0:1716999790.362693:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7b5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6e4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362700:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362706:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7b5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362710:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7b5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362715:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7b5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362719:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7b5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362725:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7b5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362729:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.362732:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7b5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362737:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7b5a lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362743:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e4:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.362746:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.362748:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7b5a lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362753:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7b5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6e4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362769:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7b53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362774:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7b53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362778:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7b53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362782:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.362784:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7b53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362788:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7b53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362793:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6e4:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.362795:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.362812:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7b53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362816:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7b53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6e4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362850:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7b45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362854:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7b45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362857:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7b45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362860:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.362862:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7b45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362866:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7b45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362872:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:0.0:1716999790.362874:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.362875:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7b45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.362897:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7b45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999790.362904:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135028a80 reply state ffff88012d28a000 transno 4294986458 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.362908:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.362946:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480768896:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 847us (1686us total) trans 4294986458 rc 0/0 00000100:00100000:0.0:1716999790.362952:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45877 00000100:00100000:0.0:1716999790.362971:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480769024 00000100:00100000:0.0:1716999790.362975:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480769024 00000100:00100000:0.0:1716999790.363005:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9315 00000100:00100000:0.0:1716999790.363009:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012eea8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480769024:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.363082:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012eea8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480769024:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 71us (954us total) trans 4294986459 rc 0/0 00000100:00100000:0.0:1716999790.363087:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9315 00000100:00100000:2.0:1716999790.366898:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999790.367872:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.367896:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7b4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.367903:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7b4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.367908:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.367912:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7b4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.367918:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7b4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.367930:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0xdfedbb38 (ffff88008a83fa00) 00010000:00010000:3.0:1716999790.367932:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.367935:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7b4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.367940:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7b4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0xdfedbb38 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999790.368042:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.368227:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480769280 00000100:00100000:1.0:1716999790.368234:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480769280 00000100:00100000:1.0:1716999790.368264:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9316 00000100:00100000:1.0:1716999790.368270:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480769280:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.368827:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480769152 00000100:00100000:3.0:1716999790.368831:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480769152 00000100:00100000:3.0:1716999790.368863:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45878 00000100:00100000:3.0:1716999790.368868:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480769152:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.368904:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.368917:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009353a400/0x6d188eabd8d87ac8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52c93 expref: 533 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.368929:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d440/0x6d188eabd8d7b6cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c7:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f159 expref: 532 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.368938:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8d7b5f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f10c expref: 531 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.368945:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c5773c0/0x6d188eabd8d70417 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b490 expref: 530 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.368951:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c7:0x0].0x0 (ffff880092a37400) 00010000:00010000:3.0:1716999790.368956:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.368974:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7b61 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.368983:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7b61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.368990:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7b61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.368999:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7b68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c3:0x0].0x3d99db37 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.369004:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.369008:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.369074:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7b6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.369079:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7b6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.369084:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7b6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:1.0:1716999790.370310:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11694, 168 off2090696 00000100:00100000:1.0:1716999790.370423:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+530:11419:x1800404480769280:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2150us (2380us total) trans 4294986460 rc 0/0 00000100:00100000:1.0:1716999790.370433:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9316 00000040:00080000:3.0:1716999790.371704:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1521, 64 off105600 00000040:00080000:3.0:1716999790.371721:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11695, 184 off2090880 00010000:00010000:3.0:1716999790.371788:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7b76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6c7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371809:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371821:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371827:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7b76 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371832:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7b76 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371836:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7b76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371841:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7b76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371846:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.371849:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7b76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371854:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7b76 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371861:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c7:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.371863:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.371866:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7b76 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371871:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7b76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371904:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7b6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371909:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7b6f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371913:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7b6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371917:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.371919:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7b6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371924:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7b6f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371929:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c7:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.371931:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.371933:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7b6f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371937:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7b6f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6c7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371975:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7b61 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371980:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7b61 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371984:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7b61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371988:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.371990:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7b61 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.371994:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7b61 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.372003:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999790.372004:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.372007:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7b61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.372011:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7b61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6c3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999790.372016:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135028380 reply state ffff8801310dd000 transno 4294986461 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.372022:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.372079:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+531:11420:x1800404480769152:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3208us (5200us total) trans 4294986461 rc 0/0 00000100:00100000:3.0:1716999790.372085:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45878 00000100:00100000:2.0:1716999790.377578:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.377664:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.377681:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480769408 00000100:00100000:2.0:1716999790.377687:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480769408 00000100:00100000:2.0:1716999790.377713:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480769472 00000100:00100000:2.0:1716999790.377715:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480769472 00000100:00100000:2.0:1716999790.377738:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9317 00000100:00100000:2.0:1716999790.377743:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480769408:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.377935:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480769408:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 191us (362us total) trans 4294986462 rc 0/0 00000100:00100000:2.0:1716999790.377941:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9317 00000100:00100000:2.0:1716999790.377953:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9318 00000100:00100000:2.0:1716999790.377956:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480769472:12345-192.168.203.3@tcp:37:dbench.0 00010000:00010000:3.0:1716999790.378633:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.378642:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7b68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.378647:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7b68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.378652:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.378654:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7b68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.378661:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7b68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6c3:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.378673:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x3d99db37 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999790.378676:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.378679:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7b68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.378684:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7b68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6c3:0x0].0x3d99db37 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999790.382617:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.382689:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480769600 00000100:00100000:3.0:1716999790.382695:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480769600 00000100:00100000:3.0:1716999790.382723:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45879 00000100:00100000:3.0:1716999790.382729:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480769600:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.382767:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.382785:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8d7feb9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6eb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50923 expref: 532 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.382808:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d4fc0/0x6d188eabd8d7d728 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6eb:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fc11 expref: 531 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.382818:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903a80/0x6d188eabd8d7d705 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6eb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4fc03 expref: 530 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.382826:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911846c0/0x6d188eabd8d71042 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6eb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b991 expref: 529 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.382833:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6eb:0x0].0x0 (ffff8800b431d000) 00010000:00010000:3.0:1716999790.382840:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.382860:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7b7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.382868:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7b7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.382875:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7b7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.383031:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7b84 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6dc:0x0].0x92de3403 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.383036:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7b84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.383041:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7b84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.383114:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7b8b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6eb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.383119:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7b8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.383123:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7b8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.383163:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+528:11420:x1800404480769472:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 5203us (5497us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.383174:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9318 00000040:00080000:3.0:1716999790.385330:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1521, 64 off105600 00000040:00080000:3.0:1716999790.385349:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11696, 184 off2091064 00010000:00010000:3.0:1716999790.385409:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7b92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6eb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385420:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385427:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7b92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385433:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7b92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385441:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7b92 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385445:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7b92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385449:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7b92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385453:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.385456:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7b92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385460:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7b92 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385468:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6eb:0x0].0x0 (ffff8800a5c6ea00) 00010000:00010000:3.0:1716999790.385470:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.385473:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7b92 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385477:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc7b92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6eb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385495:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7b8b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385499:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7b8b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385504:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7b8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385508:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.385511:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7b8b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385515:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7b8b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385520:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6eb:0x0].0x0 (ffff8800a5c6ea00) 00010000:00010000:3.0:1716999790.385522:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.385524:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7b8b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385528:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc7b8b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6eb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385565:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7b7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385570:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7b7d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385574:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7b7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385577:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.385579:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7b7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385583:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7b7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385589:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:3.0:1716999790.385591:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.385593:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7b7d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.385600:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc7b7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6dc:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999790.385606:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88013502bb80 reply state ffff8800996ad000 transno 4294986463 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7b84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.385611:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.389488:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+529:11419:x1800404480769600:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 6748us (6867us total) trans 4294986463 rc 0/0 00000100:00100000:3.0:1716999790.389497:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45879 00000100:00100000:1.0:1716999790.389570:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.389590:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480769728 00000100:00100000:0.0:1716999790.389597:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480769728 00000100:00100000:0.0:1716999790.389623:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9319 00000100:00100000:0.0:1716999790.389628:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+530:11420:x1800404480769728:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.389674:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.389742:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480769792 00000100:00100000:2.0:1716999790.389746:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480769792 00000100:00100000:2.0:1716999790.390433:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45880 00000100:00100000:2.0:1716999790.390438:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+530:11566:x1800404480769792:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:2.0:1716999790.390446:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.390458:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7b99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66229 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.390479:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66229 expref: 531 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.390489:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66229 expref: 531 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.390494:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999790.390496:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.390499:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091831b00, rc 0) 00000100:00100000:2.0:1716999790.390530:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11566:x1800404480769792:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 92us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.390534:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45880 00000040:00080000:0.0:1716999790.390642:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11697, 168 off2091232 00000001:00080000:0.0:1716999790.390648:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986464 00000100:00100000:0.0:1716999790.391079:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480769728:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1074us (1132us total) trans 4294986465 rc 0/0 00000100:00100000:0.0:1716999790.391085:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9319 00000020:00080000:0.0:1716999790.391088:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999790.394683:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999790.394753:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7b84 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.394758:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480769856 00010000:00010000:3.0:1716999790.394762:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7b84 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.394765:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480769856 00010000:00010000:3.0:1716999790.394768:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7b84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.394772:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.394776:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7b84 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.394782:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7b84 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6dc:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.394793:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x92de3403 (ffff8800a5c6ec00) 00000100:00100000:0.0:1716999790.394793:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9320 00010000:00010000:3.0:1716999790.394804:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.394808:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7b84 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.394808:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11566:x1800404480769856:12345-192.168.203.3@tcp:37:ll_sa.0 00010000:00010000:3.0:1716999790.394812:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc7b84 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6dc:0x0].0x92de3403 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999790.400108:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.400153:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480769984 00000100:00100000:1.0:1716999790.400162:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480769984 00000100:00100000:1.0:1716999790.400201:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9321 00000100:00100000:1.0:1716999790.400208:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480769984:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.400820:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480769984:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 611us (717us total) trans 4294986466 rc 0/0 00000100:00100000:1.0:1716999790.400828:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9321 00000100:00100000:0.0:1716999790.400837:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11566:x1800404480769856:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 6037us (6160us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.400843:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9320 00000100:00100000:2.0:1716999790.401845:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.401895:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.401928:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480770176 00000100:00100000:3.0:1716999790.401933:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480770176 00000100:00100000:0.0:1716999790.401940:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480770112 00000100:00100000:0.0:1716999790.401943:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480770112 00000100:00100000:3.0:1716999790.401955:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45881 00000100:00100000:3.0:1716999790.401960:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11568:x1800404480770176:12345-192.168.203.3@tcp:101:ll_sa.0 00000100:00100000:0.0:1716999790.401961:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9322 00000100:00100000:0.0:1716999790.401965:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480770112:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:3.0:1716999790.401970:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.401982:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7ba0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x731:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66230 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.402001:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66230 expref: 534 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.402010:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66230 expref: 534 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.402016:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x731:0x0].0x0 (ffff8800939bae00) 00010000:00010000:3.0:1716999790.402018:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.402021:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50000, rc 0) 00000100:00100000:3.0:1716999790.402039:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+534:11568:x1800404480770176:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 80us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.402044:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45881 00000001:00080000:0.0:1716999790.402250:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986467 00000100:00100000:0.0:1716999790.402304:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480770112:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 337us (459us total) trans 4294986468 rc 0/0 00000100:00100000:0.0:1716999790.402311:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9322 00000020:00080000:0.0:1716999790.402315:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999790.407916:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.407947:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.407971:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.408094:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480770304 00000100:00100000:2.0:1716999790.408102:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480770304 00000100:00100000:1.0:1716999790.408110:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480770368 00000100:00100000:1.0:1716999790.408114:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480770368 00000100:00100000:1.0:1716999790.408128:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480770496 00000100:00100000:1.0:1716999790.408130:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480770496 00000100:00100000:2.0:1716999790.408134:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45882 00000100:00100000:2.0:1716999790.408142:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480770304:12345-192.168.203.3@tcp:36:dbench.0 00000100:00100000:1.0:1716999790.408146:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9323 00000100:00100000:1.0:1716999790.408151:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11568:x1800404480770368:12345-192.168.203.3@tcp:37:ll_sa.0 00000100:00100000:2.0:1716999790.408154:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9324 00000100:00100000:2.0:1716999790.408156:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480770496:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999790.408529:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11698, 168 off2091400 00000100:00100000:2.0:1716999790.409176:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+539:11419:x1800404480770496:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1016us (1203us total) trans 4294986469 rc 0/0 00000100:00100000:2.0:1716999790.409184:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9324 00010000:00010000:2.0:1716999790.409229:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:2.0:1716999790.409249:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093538900/0x6d188eabd8d86463 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d7:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52618 expref: 538 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.409264:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb9b840/0x6d188eabd8d7c60a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d7:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f645 expref: 537 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.409273:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f261c0/0x6d188eabd8d7c5e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f637 expref: 536 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.409283:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012face1c0/0x6d188eabd8d709ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6ce expref: 535 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.409292:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d7:0x0].0x0 (ffff8800b431df00) 00010000:00010000:2.0:1716999790.409306:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a646b3c0/0x6d188eabd8dc6edb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6616c expref: 534 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.409315:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999790.409318:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.409334:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.409343:0:6823:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7b99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66229 expref: 533 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.409349:0:6823:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.409371:0:6823:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66229 expref: 533 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.409381:0:6823:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7b99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66229 expref: 533 pid: 6823 timeout: 409 lvb_type: 0 00000100:00100000:2.0:1716999790.409391:0:6823:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135028000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6823:1800404483017408:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999790.409431:0:6823:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009c108900 going to sleep for 11 seconds 00000100:00100000:2.0:1716999790.412484:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11568:x1800404480770368:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 4328us (4531us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.412494:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9323 00000100:00100000:3.0:1716999790.415290:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.415333:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480770560 00000100:00100000:0.0:1716999790.415340:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480770560 00010000:00010000:0.0:1716999790.415364:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7b99 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66229 expref: 532 pid: 6823 timeout: 409 lvb_type: 0 00000100:00100000:0.0:1716999790.415398:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4582 00000100:00100000:0.0:1716999790.415403:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:1956:x1800404480770560:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999790.415414:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999790.415419:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7b99 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66229 expref: 532 pid: 6823 timeout: 409 lvb_type: 0 00010000:00010000:0.0:1716999790.415428:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7b99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66229 expref: 532 pid: 6823 timeout: 409 lvb_type: 0 00010000:00010000:0.0:1716999790.415444:0:15839:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:0.0:1716999790.415448:0:15839:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.415455:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.415459:0:15839:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.415472:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999790.415498:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:1956:x1800404480770560:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.415506:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4582 00010000:00010000:2.0:1716999790.415840:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc7b99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66229 expref: 531 pid: 6823 timeout: 409 lvb_type: 0 00000100:00100000:2.0:1716999790.415855:0:6823:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880135028000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6823:1800404483017408:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999790.415871:0:6823:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.415876:0:6823:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.415893:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.416613:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7bae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xc734d1c8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.416622:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.416628:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999790.416854:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999790.417553:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7bb5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.417560:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7bb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.417566:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7bb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:2.0:1716999790.417976:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1522, 64 off105664 00000040:00080000:2.0:1716999790.417995:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11699, 184 off2091584 00010000:00010000:2.0:1716999790.418048:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7bbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418055:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7bbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418064:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7bbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418070:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7bbc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418074:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7bbc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418077:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7bbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418082:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7bbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418086:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.418089:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7bbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418093:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7bbc lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418101:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d7:0x0].0x0 (ffff880088977f00) 00010000:00010000:2.0:1716999790.418103:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.418105:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7bbc lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418109:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc7bbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418127:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7bb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418131:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7bb5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6d7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418136:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7bb5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418140:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.418142:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7bb5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418146:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7bb5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6d7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418151:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d7:0x0].0x0 (ffff880088977f00) 00010000:00010000:2.0:1716999790.418152:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.418154:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7bb5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6d7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418157:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc7bb5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6d7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418194:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418198:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418202:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418206:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.418208:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418212:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418220:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999790.418222:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.418224:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.418227:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc7ba7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999790.418232:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131ca8380 reply state ffff88012d292000 transno 4294986470 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999790.418237:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.418288:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480770304:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 10146us (10378us total) trans 4294986470 rc 0/0 00000100:00100000:2.0:1716999790.418295:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45882 00000100:00100000:2.0:1716999790.418310:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480770688 00000100:00100000:2.0:1716999790.418315:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480770688 00000100:00100000:2.0:1716999790.418339:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45883 00000100:00100000:2.0:1716999790.418343:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+532:11419:x1800404480770688:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.420155:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 6 locks, starting at 0 00010000:00010000:2.0:1716999790.420173:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135419d40/0x6d188eabd8d81660 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x733:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f510bd expref: 532 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.420187:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091330240/0x6d188eabd8d7c12c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x733:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f4a8 expref: 531 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.420200:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905d9200/0x6d188eabd8d81636 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x733:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f510af expref: 530 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.420213:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419f3c0/0x6d188eabd8d727db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x733:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c37e expref: 529 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.420223:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x733:0x0].0x0 (ffff8800b4877500) 00010000:00010000:2.0:1716999790.420234:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf7840/0x6d188eabd8d813f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x731:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f51000 expref: 528 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.420242:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8df80/0x6d188eabd8d7f401 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x731:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f505aa expref: 527 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.420248:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x731:0x0].0x0 (ffff8800939bae00) 00010000:00010000:2.0:1716999790.420250:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.420264:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x731:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.420272:0:7785:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66230 expref: 526 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.420277:0:7785:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.420300:0:7785:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66230 expref: 526 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.420309:0:7785:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66230 expref: 526 pid: 6822 timeout: 409 lvb_type: 0 00000100:00100000:2.0:1716999790.420319:0:7785:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880135028000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:7785:1800404483017472:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999790.420365:0:7785:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009c108900 going to sleep for 11 seconds 00010000:00010000:0.0:1716999790.421270:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7bae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.421277:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7bae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.421281:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7bae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.421286:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.421289:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7bae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.421294:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7bae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.421301:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xc734d1c8 (ffff880088977100) 00010000:00010000:0.0:1716999790.421304:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.421306:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7bae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.421310:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc7bae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xc734d1c8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999790.424608:0:7785:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880135028000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:7785:1800404483017472:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999790.424632:0:7785:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.424698:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.425153:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480770752 00000100:00100000:1.0:1716999790.425159:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480770752 00010000:00010000:1.0:1716999790.425179:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66230 expref: 526 pid: 6822 timeout: 409 lvb_type: 0 00000100:00100000:1.0:1716999790.425743:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4583 00000100:00100000:1.0:1716999790.425749:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+526:1958:x1800404480770752:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999790.425759:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999790.425764:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66230 expref: 526 pid: 6822 timeout: 409 lvb_type: 0 00010000:00010000:1.0:1716999790.425773:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66230 expref: 526 pid: 6822 timeout: 409 lvb_type: 0 00010000:00010000:1.0:1716999790.425787:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc7ba0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66230 expref: 526 pid: 6822 timeout: 409 lvb_type: 0 00010000:00010000:1.0:1716999790.425816:0:16642:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x731:0x0].0x0 (ffff8800939bae00) 00010000:00010000:1.0:1716999790.425821:0:16642:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.425828:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.425834:0:16642:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.425848:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.425852:0:7785:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.425858:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.425874:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7bca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x731:0x0].0x41c358e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.425896:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+525:1958:x1800404480770752:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 129us (1181us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999790.425898:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x731:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.425902:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4583 00010000:00010000:2.0:1716999790.425904:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x731:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.425999:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7bd1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x733:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426004:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7bd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x733:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426009:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7bd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x733:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:2.0:1716999790.426415:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1522, 64 off105664 00000040:00080000:2.0:1716999790.426433:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11700, 184 off2091768 00010000:00010000:2.0:1716999790.426483:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7bd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x733:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426492:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x733:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426498:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x733:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426503:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7bd8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x733:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426508:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7bd8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x733:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426512:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7bd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x733:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426516:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7bd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x733:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426521:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833a80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.426523:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7bd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x733:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426528:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7bd8 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x733:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426534:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x733:0x0].0x0 (ffff880088977800) 00010000:00010000:2.0:1716999790.426537:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.426539:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7bd8 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x733:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426543:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7bd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x733:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426559:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7bd1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x733:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426564:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7bd1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x733:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426568:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7bd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x733:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426571:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.426573:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7bd1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x733:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426577:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7bd1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x733:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426582:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x733:0x0].0x0 (ffff880088977800) 00010000:00010000:2.0:1716999790.426583:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.426586:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7bd1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x733:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426589:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7bd1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x733:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426623:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426627:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426632:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426635:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.426637:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426645:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426650:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x731:0x0].0x0 (ffff8800939bae00) 00010000:00010000:2.0:1716999790.426651:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.426653:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.426657:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7bc3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999790.426664:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131caaa00 reply state ffff88012d2bf000 transno 4294986471 ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x731:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.426669:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.426718:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+526:11419:x1800404480770688:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 8372us (9863us total) trans 4294986471 rc 0/0 00000100:00100000:2.0:1716999790.426723:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45883 00000100:00100000:3.0:1716999790.427191:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.427308:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480770880 00000100:00100000:0.0:1716999790.427313:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480770880 00000100:00100000:0.0:1716999790.427343:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9325 00000100:00100000:0.0:1716999790.427348:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+526:11420:x1800404480770880:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.427511:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+527:11420:x1800404480770880:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 161us (320us total) trans 4294986472 rc 0/0 00000100:00100000:0.0:1716999790.427520:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9325 00010000:00010000:2.0:1716999790.430084:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7bca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x731:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.430097:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7bca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x731:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.430103:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7bca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x731:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.430108:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.430111:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7bca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x731:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.430117:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7bca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x731:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.430130:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x731:0x0].0x41c358e5 (ffff880088977700) 00010000:00010000:2.0:1716999790.430133:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.430136:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7bca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x731:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.430140:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7bca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x731:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.431839:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.431901:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.431955:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480771008 00000100:00100000:0.0:1716999790.431963:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480771008 00000100:00100000:0.0:1716999790.431987:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480771136 00000100:00100000:0.0:1716999790.431988:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480771136 00000100:00100000:0.0:1716999790.432001:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9326 00000100:00100000:0.0:1716999790.432007:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+527:11420:x1800404480771008:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.432276:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9327 00000040:00080000:0.0:1716999790.432277:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11701, 168 off2091936 00000100:00100000:1.0:1716999790.432282:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+527:11419:x1800404480771136:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.432370:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec27850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+528:11420:x1800404480771008:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 361us (535us total) trans 4294986473 rc 0/0 00000100:00100000:0.0:1716999790.432376:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9326 00000001:00080000:1.0:1716999790.432515:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986474 00000100:00100000:1.0:1716999790.432561:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+529:11419:x1800404480771136:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 279us (681us total) trans 4294986475 rc 0/0 00000100:00100000:1.0:1716999790.432567:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9327 00000020:00080000:1.0:1716999790.432570:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999790.434160:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.434189:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.434230:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480771392 00000100:00100000:2.0:1716999790.434236:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480771392 00000100:00100000:2.0:1716999790.434272:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45884 00000100:00100000:2.0:1716999790.434277:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+529:11420:x1800404480771392:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.434309:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.434326:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc31d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d9:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64dfb expref: 529 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.434342:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d4d80/0x6d188eabd8d7c7e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d9:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f6df expref: 528 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.434352:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68b40/0x6d188eabd8d7393f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c904 expref: 527 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.434370:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215dd40/0x6d188eabd8d738ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d9:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c8da expref: 526 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.434379:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d9:0x0].0x0 (ffff8800b431dd00) 00010000:00010000:2.0:1716999790.434386:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.434404:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7bdf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.434414:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7bdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.434420:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7bdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.434428:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7be6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.434433:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7be6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.434437:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7be6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.434509:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7bed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.434514:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7bed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.434520:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7bed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.435351:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480771328 00000100:00100000:0.0:1716999790.435356:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480771328 00000100:00100000:0.0:1716999790.435390:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9328 00000100:00100000:0.0:1716999790.435396:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+526:11419:x1800404480771328:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999790.435592:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11702, 168 off2092104 00000040:00080000:2.0:1716999790.436129:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1523, 64 off105728 00000040:00080000:2.0:1716999790.436144:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11703, 176 off2092280 00010000:00010000:2.0:1716999790.436190:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7bf4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436200:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436207:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7bf4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436217:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7bf4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436221:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7bf4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436226:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7bf4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436231:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7bf4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436235:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831f80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.436238:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7bf4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436244:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7bf4 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436251:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d9:0x0].0x0 (ffff880088977900) 00010000:00010000:2.0:1716999790.436254:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.436257:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7bf4 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436261:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7bf4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436277:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7bed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436282:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7bed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436285:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7bed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436290:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.436292:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7bed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436296:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7bed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436301:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d9:0x0].0x0 (ffff880088977900) 00010000:00010000:2.0:1716999790.436303:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.436305:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7bed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436308:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7bed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6d9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436343:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7bdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436348:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7bdf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436352:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7bdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436356:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918306c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.436358:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7bdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436362:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7bdf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436368:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999790.436370:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.436372:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7bdf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.436376:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7bdf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999790.436382:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339fe680 reply state ffff8800b53d2000 transno 4294986477 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7be6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.436387:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.436696:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+529:11419:x1800404480771328:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1298us (2536us total) trans 4294986476 rc 0/0 00000100:00100000:0.0:1716999790.436704:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9328 00000100:00100000:2.0:1716999790.436846:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+528:11420:x1800404480771392:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2567us (2655us total) trans 4294986477 rc 0/0 00000100:00100000:2.0:1716999790.436852:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45884 00010000:00010000:0.0:1716999790.439749:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7be6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.439760:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7be6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.439766:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7be6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.439773:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.439777:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7be6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.439782:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7be6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.439793:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xe4a56594 (ffff880088977000) 00010000:00010000:0.0:1716999790.439805:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.439809:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7be6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.439813:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7be6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xe4a56594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.440410:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.440472:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480771520 00000100:00100000:2.0:1716999790.440479:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480771520 00000100:00100000:2.0:1716999790.440515:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45885 00000100:00100000:2.0:1716999790.440520:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+527:11419:x1800404480771520:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.440557:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.440569:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905db840/0x6d188eabd8d81a88 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x737:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f51206 expref: 527 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.440580:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8d7c180 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x737:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f4c4 expref: 526 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.440589:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905d9b00/0x6d188eabd8d81a73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x737:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f511f8 expref: 525 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.440595:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801339f9d40/0x6d188eabd8d72955 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x737:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c411 expref: 524 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.440605:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x737:0x0].0x0 (ffff88009a3f6900) 00010000:00010000:2.0:1716999790.440611:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.440629:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7bfb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x731:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.440637:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7bfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.440643:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7bfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.440652:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7c02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x731:0x0].0x155bec67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.440656:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x731:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.440661:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x731:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.440738:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7c09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x737:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.440744:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7c09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x737:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.440749:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7c09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x737:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:2.0:1716999790.443025:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1524, 64 off105792 00000040:00080000:2.0:1716999790.443043:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11704, 184 off2092464 00010000:00010000:2.0:1716999790.443095:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7c10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x737:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443105:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7c10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x737:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443112:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7c10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x737:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443117:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7c10 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x737:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443121:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7c10 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x737:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443125:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7c10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x737:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443129:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7c10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x737:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443133:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832880 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.443135:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7c10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x737:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443140:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7c10 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x737:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443146:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x737:0x0].0x0 (ffff880088977200) 00010000:00010000:2.0:1716999790.443148:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.443151:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7c10 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x737:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443154:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7c10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x737:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443171:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7c09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x737:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443176:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7c09 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x737:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443180:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7c09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x737:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443183:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.443185:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7c09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x737:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443188:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7c09 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x737:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443192:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x737:0x0].0x0 (ffff880088977200) 00010000:00010000:2.0:1716999790.443194:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.443195:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7c09 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x737:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443199:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7c09 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x737:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443231:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7bfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443235:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7bfb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443238:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7bfb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443241:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918321c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.443243:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7bfb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.443361:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999790.443436:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7bfb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443443:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x731:0x0].0x0 (ffff8800939bae00) 00010000:00010000:2.0:1716999790.443444:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.443447:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7bfb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.443451:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7bfb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999790.443458:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339fe300 reply state ffff8800b53d0000 transno 4294986478 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x731:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.443464:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.443520:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+525:11419:x1800404480771520:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2997us (3111us total) trans 4294986478 rc 0/0 00000100:00100000:2.0:1716999790.443527:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45885 00000100:00100000:0.0:1716999790.443591:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480771648 00000100:00100000:0.0:1716999790.443596:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480771648 00000100:00100000:0.0:1716999790.443632:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9329 00000100:00100000:0.0:1716999790.443637:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+525:11420:x1800404480771648:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999790.443915:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11705, 168 off2092632 00000001:00080000:0.0:1716999790.443921:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986479 00000100:00100000:0.0:1716999790.443992:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+527:11420:x1800404480771648:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 353us (632us total) trans 4294986480 rc 0/0 00000100:00100000:0.0:1716999790.443997:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9329 00000020:00080000:0.0:1716999790.444001:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1716999790.445607:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7c02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x731:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.445617:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7c02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x731:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.445623:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7c02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x731:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.445627:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.445630:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7c02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x731:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.445636:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7c02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x731:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.445647:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x731:0x0].0x155bec67 (ffff880088977300) 00010000:00010000:2.0:1716999790.445649:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.445652:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7c02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x731:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.445656:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7c02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x731:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.447666:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.447982:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480771776 00000100:00100000:3.0:1716999790.447989:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480771776 00000100:00100000:3.0:1716999790.448100:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45886 00000100:00100000:3.0:1716999790.448106:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+526:11420:x1800404480771776:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.448138:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1716999790.448154:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090c97840/0x6d188eabd8dc3ca0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc29:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65120 expref: 526 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.448180:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bddd40/0x6d188eabd8dc3ba4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc29:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650e8 expref: 525 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.448190:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918e98c0/0x6d188eabd8dc3b7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc29:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650da expref: 524 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.448197:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800920ebf00) 00010000:00010000:3.0:1716999790.448203:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.449100:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7c17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449112:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7c17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449119:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7c17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449132:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7c1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449137:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449141:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449214:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7c25 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc29:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449219:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7c25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449223:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7c25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:3.0:1716999790.449547:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1523, 64 off105728 00000040:00080000:3.0:1716999790.449563:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11706, 184 off2092816 00010000:00010000:3.0:1716999790.449617:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7c2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449623:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449629:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7c2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449634:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7c2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449638:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7c2c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449645:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7c2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449650:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7c2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449654:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.449656:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7c2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449661:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7c2c lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449667:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999790.449669:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.449671:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7c2c lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449675:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc7c2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc29:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449691:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7c25 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449695:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7c25 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449699:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7c25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449702:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.449705:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7c25 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449711:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7c25 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449716:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc29:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999790.449717:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.449719:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7c25 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449722:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc7c25 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc29:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449750:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7c17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449754:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7c17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449757:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7c17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449760:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.449762:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7c17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449766:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7c17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449771:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999790.449772:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.449774:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7c17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.449777:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc7c17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999790.449784:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092df1c00 reply state ffff8800996ac000 transno 4294986481 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.449789:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.449863:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+525:11420:x1800404480771776:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1755us (2201us total) trans 4294986481 rc 0/0 00000100:00100000:3.0:1716999790.449870:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45886 00010000:00010000:0.0:1716999790.453019:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7c1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.453030:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7c1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.453039:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7c1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.453044:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.453047:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7c1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.453052:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7c1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.453063:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x985392a1 (ffff8800a5c6ea00) 00010000:00010000:0.0:1716999790.453065:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.453068:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7c1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.453072:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7c1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x985392a1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.456410:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.456474:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.456512:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480771904 00000100:00100000:2.0:1716999790.456519:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480771904 00000100:00100000:2.0:1716999790.456599:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480772032 00000100:00100000:2.0:1716999790.456603:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480772032 00000100:00100000:2.0:1716999790.456618:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9330 00000100:00100000:2.0:1716999790.456624:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+525:11420:x1800404480771904:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.456713:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9331 00000100:00100000:0.0:1716999790.456718:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+525:11419:x1800404480772032:12345-192.168.203.3@tcp:35:dbench.0 00000001:00080000:0.0:1716999790.456962:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986482 00000100:00100000:0.0:1716999790.459133:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+528:11419:x1800404480772032:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2406us (2650us total) trans 4294986484 rc 0/0 00000100:00100000:0.0:1716999790.459142:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9331 00000020:00080000:0.0:1716999790.459147:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1716999790.459182:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+527:11420:x1800404480771904:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2557us (2777us total) trans 4294986483 rc 0/0 00000100:00100000:2.0:1716999790.459188:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9330 00000100:00100000:3.0:1716999790.464462:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.464513:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480772160 00000100:00100000:2.0:1716999790.464520:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480772160 00000100:00100000:3.0:1716999790.464545:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.464548:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9332 00000100:00100000:2.0:1716999790.464555:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+527:11419:x1800404480772160:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999790.464826:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11707, 168 off2092984 00000100:00100000:0.0:1716999790.464907:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480772288 00000100:00100000:0.0:1716999790.464911:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480772288 00000100:00100000:0.0:1716999790.464927:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9333 00000100:00100000:0.0:1716999790.464931:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+529:11420:x1800404480772288:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.464938:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+529:11419:x1800404480772160:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 384us (483us total) trans 4294986485 rc 0/0 00000100:00100000:2.0:1716999790.464945:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9332 00000040:00080000:0.0:1716999790.465062:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11708, 168 off2093152 00000100:00100000:0.0:1716999790.465109:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+529:11420:x1800404480772288:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 177us (563us total) trans 4294986486 rc 0/0 00000100:00100000:0.0:1716999790.465114:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9333 00000100:00100000:3.0:1716999790.466244:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.466283:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480772544 00000100:00100000:0.0:1716999790.466287:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480772544 00000100:00100000:0.0:1716999790.466312:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45887 00000100:00100000:0.0:1716999790.466316:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+529:11420:x1800404480772544:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.466344:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999790.466360:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800917d6880/0x6d188eabd8d7ca39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6db:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f7b8 expref: 529 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.466374:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf53a80/0x6d188eabd8d741dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6db:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4cba4 expref: 528 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.466383:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ee880/0x6d188eabd8d7c9c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6db:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f7a3 expref: 527 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.466393:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a65fa640/0x6d188eabd8d70af4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6db:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b753 expref: 526 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.466400:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6db:0x0].0x0 (ffff880092624800) 00010000:00010000:0.0:1716999790.466407:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.466426:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7c33 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.466435:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7c33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.466445:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7c33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.466454:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7c3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0x7d62b0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.466458:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7c3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.466462:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7c3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.466531:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7c41 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6db:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.466537:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7c41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6db:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.466542:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7c41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6db:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:0.0:1716999790.466925:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1525, 64 off105856 00000040:00080000:0.0:1716999790.466943:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11709, 184 off2093336 00010000:00010000:0.0:1716999790.466990:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7c48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6db:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.466997:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7c48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467004:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7c48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467008:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7c48 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467016:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7c48 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467021:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7c48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467025:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7c48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467029:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.467032:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7c48 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467036:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7c48 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467041:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6db:0x0].0x0 (ffff88008a83f700) 00010000:00010000:0.0:1716999790.467043:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.467045:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7c48 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467049:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7c48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6db:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467063:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7c41 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6db:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467066:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7c41 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6db:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467070:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7c41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6db:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467073:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.467076:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7c41 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6db:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467080:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7c41 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6db:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467085:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6db:0x0].0x0 (ffff88008a83f700) 00010000:00010000:0.0:1716999790.467087:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.467088:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7c41 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6db:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467092:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7c41 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6db:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467119:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7c33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467122:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7c33 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467126:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7c33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467129:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1321c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.467131:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7c33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467135:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7c33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467139:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:0.0:1716999790.467141:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.467142:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7c33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.467148:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7c33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999790.467154:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8801339fed80 reply state ffff88012b157000 transno 4294986487 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7c3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.467159:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.467205:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+527:11420:x1800404480772544:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 886us (961us total) trans 4294986487 rc 0/0 00000100:00100000:0.0:1716999790.467210:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45887 00000100:00100000:3.0:1716999790.467897:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.467959:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480772416 00000100:00100000:0.0:1716999790.467963:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480772416 00000100:00100000:0.0:1716999790.467989:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45888 00000100:00100000:0.0:1716999790.467994:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+527:11419:x1800404480772416:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.468015:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999790.468027:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905d9440/0x6d188eabd8d81812 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x735:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f51142 expref: 527 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.468041:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb9af40/0x6d188eabd8d7c156 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x735:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f4b6 expref: 526 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.468046:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7c3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.468050:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ef840/0x6d188eabd8d817f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x735:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5112d expref: 525 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.468055:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7c3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.468059:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ed680/0x6d188eabd8d728a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x735:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3cb expref: 524 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.468060:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7c3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.468064:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.468066:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7c3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.468067:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x735:0x0].0x0 (ffff880094025900) 00010000:00010000:2.0:1716999790.468071:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7c3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.468072:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.468077:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x7d62b0d (ffff88008a83f200) 00010000:00010000:2.0:1716999790.468078:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.468080:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7c3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.468084:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7c3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x7d62b0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.468084:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7c4f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x731:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468091:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7c4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468096:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7c4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468104:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7c56 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x731:0x0].0xb0773fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468109:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7c56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x731:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468114:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7c56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x731:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468168:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7c5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x735:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468173:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7c5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x735:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468178:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7c5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x735:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999790.468475:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1526, 64 off105920 00000040:00080000:0.0:1716999790.468488:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11710, 184 off2093520 00010000:00010000:0.0:1716999790.468531:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7c64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x735:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468537:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7c64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x735:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468544:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7c64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x735:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468548:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7c64 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x735:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468552:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7c64 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x735:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468556:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7c64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x735:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468559:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7c64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x735:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468563:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131200 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.468565:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7c64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x735:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468569:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7c64 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x735:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468574:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x735:0x0].0x0 (ffff88008a83f600) 00010000:00010000:0.0:1716999790.468576:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.468578:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7c64 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x735:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468582:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7c64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x735:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468595:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7c5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x735:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468600:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7c5d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x735:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468604:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7c5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x735:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468608:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.468610:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7c5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x735:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468614:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7c5d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x735:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468619:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x735:0x0].0x0 (ffff88008a83f600) 00010000:00010000:0.0:1716999790.468620:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.468622:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7c5d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x735:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468626:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7c5d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x735:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468654:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7c4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468658:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7c4f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468662:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7c4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468665:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.468666:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7c4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468670:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7c4f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468677:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x731:0x0].0x0 (ffff8800939bae00) 00010000:00010000:0.0:1716999790.468679:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.468681:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7c4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.468684:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7c4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x731:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999790.468688:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008af52300 reply state ffff88012b156000 transno 4294986488 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7c56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x731:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.468692:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.469667:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+524:11419:x1800404480772416:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1670us (1786us total) trans 4294986488 rc 0/0 00000100:00100000:0.0:1716999790.469674:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45888 00000100:00100000:2.0:1716999790.473329:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999790.473437:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7c56 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x731:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.473446:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7c56 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x731:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.473452:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7c56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x731:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.473456:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.473460:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7c56 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x731:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.473466:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7c56 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x731:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.473467:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480772672 00000100:00100000:0.0:1716999790.473475:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480772672 00010000:00010000:1.0:1716999790.473478:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x731:0x0].0xb0773fd (ffff88008a83f300) 00010000:00010000:1.0:1716999790.473480:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.473483:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7c56 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x731:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.473487:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7c56 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x731:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.473501:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9334 00000100:00100000:0.0:1716999790.473508:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+524:11420:x1800404480772672:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.473767:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.473822:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480772736 00000100:00100000:2.0:1716999790.473826:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480772736 00000100:00100000:0.0:1716999790.474059:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+525:11420:x1800404480772672:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 548us (732us total) trans 4294986489 rc 0/0 00000100:00100000:0.0:1716999790.474069:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9334 00000100:00100000:0.0:1716999790.474084:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9335 00000100:00100000:0.0:1716999790.474088:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+524:11419:x1800404480772736:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:3.0:1716999790.476555:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.477129:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480772864 00000100:00100000:0.0:1716999790.477136:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480772864 00000100:00100000:0.0:1716999790.477163:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9336 00000100:00100000:0.0:1716999790.477169:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+526:11420:x1800404480772864:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999790.477460:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11711, 168 off2093688 00000100:00100000:0.0:1716999790.477548:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+527:11420:x1800404480772864:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 378us (998us total) trans 4294986490 rc 0/0 00000100:00100000:0.0:1716999790.477554:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9336 00000100:00100000:3.0:1716999790.481811:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.481920:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480772992 00000100:00100000:1.0:1716999790.481927:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480772992 00000100:00100000:1.0:1716999790.481961:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45889 00000100:00100000:1.0:1716999790.481967:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+527:11420:x1800404480772992:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.482007:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.482026:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc230f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d3:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64af9 expref: 527 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.482041:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb99200/0x6d188eabd8d7c2de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d3:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f542 expref: 526 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.482052:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419f180/0x6d188eabd8d72b8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c4f8 expref: 525 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.482065:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c18c0/0x6d188eabd8d72b31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c4d5 expref: 524 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.482074:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d3:0x0].0x0 (ffff8800939c9b00) 00010000:00010000:1.0:1716999790.482082:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.482104:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c6b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482113:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482120:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482129:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7c72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0x7b2f0bbe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482133:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7c72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482137:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7c72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482219:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482228:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482233:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:1.0:1716999790.482595:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1527, 64 off105984 00000040:00080000:1.0:1716999790.482612:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11712, 184 off2093872 00010000:00010000:1.0:1716999790.482668:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c80 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482674:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482680:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c80 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482685:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c80 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482690:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c80 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482695:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c80 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482700:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482704:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.482707:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c80 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482712:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c80 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482719:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d3:0x0].0x0 (ffff8800a6ad7600) 00010000:00010000:1.0:1716999790.482721:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.482723:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c80 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482727:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c80 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482745:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482749:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c79 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482754:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482757:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.482760:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482764:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c79 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482770:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d3:0x0].0x0 (ffff8800a6ad7600) 00010000:00010000:1.0:1716999790.482771:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.482773:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c79 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482778:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c79 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6d3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482821:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482826:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c6b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482831:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482834:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.482837:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482841:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482847:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999790.482849:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.482851:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c6b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.482855:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.482861:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bcaa00 reply state ffff88009c1e5000 transno 4294986491 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7c72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.482867:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.482934:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+525:11420:x1800404480772992:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 966us (1137us total) trans 4294986491 rc 0/0 00000100:00100000:1.0:1716999790.482941:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45889 00000100:00100000:0.0:1716999790.483613:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+523:11419:x1800404480772736:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 9521us (9844us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.483621:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9335 00000100:00100000:3.0:1716999790.487934:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999790.487996:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7c72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.488005:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7c72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.488010:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7c72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.488018:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.488022:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7c72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.488027:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7c72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.488037:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x7b2f0bbe (ffff8800a6ad7c00) 00010000:00010000:2.0:1716999790.488039:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.488042:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7c72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.488046:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc7c72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0x7b2f0bbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.488132:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480773120 00000100:00100000:0.0:1716999790.488138:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480773120 00000100:00100000:0.0:1716999790.488170:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9337 00000100:00100000:0.0:1716999790.488175:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11420:x1800404480773120:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999790.488548:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11713, 168 off2094040 00000001:00080000:0.0:1716999790.488553:0:6825:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986492 00000100:00100000:0.0:1716999790.488633:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+524:11420:x1800404480773120:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 456us (705us total) trans 4294986493 rc 0/0 00000100:00100000:0.0:1716999790.488640:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9337 00000020:00080000:0.0:1716999790.488644:0:6825:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999790.490964:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.494649:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480773248 00000100:00100000:2.0:1716999790.494659:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480773248 00000100:00100000:2.0:1716999790.494707:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9338 00000100:00100000:2.0:1716999790.494713:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+524:11420:x1800404480773248:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.496472:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+525:11420:x1800404480773248:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1753us (5507us total) trans 4294986494 rc 0/0 00000100:00100000:3.0:1716999790.496482:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9338 00000100:00100000:0.0:1716999790.497436:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.497515:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.497569:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480773440 00000100:00100000:1.0:1716999790.497575:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480773440 00000100:00100000:2.0:1716999790.497580:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480773376 00000100:00100000:2.0:1716999790.497582:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480773376 00000100:00100000:2.0:1716999790.497598:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9339 00000100:00100000:1.0:1716999790.497598:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45890 00000100:00100000:2.0:1716999790.497603:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+526:11419:x1800404480773376:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.497603:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+526:11570:x1800404480773440:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:1.0:1716999790.499692:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.499710:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66237 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.499735:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66237 expref: 527 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.499745:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66237 expref: 527 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.499752:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0x0 (ffff8800908c6c00) 00010000:00010000:1.0:1716999790.499754:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.499756:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b1440, rc 0) 00000100:00100000:1.0:1716999790.499817:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+527:11570:x1800404480773440:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 2212us (2300us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.499824:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45890 00000040:00080000:2.0:1716999790.500061:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11714, 168 off2094208 00000001:00080000:2.0:1716999790.500066:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986495 00000100:00100000:2.0:1716999790.500117:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+528:11419:x1800404480773376:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2512us (2682us total) trans 4294986496 rc 0/0 00000100:00100000:2.0:1716999790.500123:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9339 00000020:00080000:2.0:1716999790.500128:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.504410:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.504442:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.504461:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480773568 00000100:00100000:2.0:1716999790.504468:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480773568 00000100:00100000:0.0:1716999790.504486:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.504532:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480773632 00000100:00100000:1.0:1716999790.504536:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480773632 00000100:00100000:1.0:1716999790.504563:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45891 00000100:00100000:1.0:1716999790.504569:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+529:11420:x1800404480773632:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.504609:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.504628:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905db3c0/0x6d188eabd8d85fcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d5:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f52500 expref: 529 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.504702:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8d7c531 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d5:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f60d expref: 528 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.504712:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8d7c50e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f5ff expref: 527 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.504723:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c574240/0x6d188eabd8d70934 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b688 expref: 526 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.504730:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d5:0x0].0x0 (ffff8800b431d700) 00010000:00010000:1.0:1716999790.504738:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999790.504811:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480773760 00000100:00100000:0.0:1716999790.504826:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9340 00000100:00100000:0.0:1716999790.504831:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+525:11570:x1800404480773568:12345-192.168.203.3@tcp:37:ll_sa.0 00000100:00100000:2.0:1716999790.504981:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480773760 00000100:00100000:2.0:1716999790.505652:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9341 00000100:00100000:2.0:1716999790.505657:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+526:11419:x1800404480773760:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:1.0:1716999790.505721:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.505731:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.505739:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.505748:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xba72bac9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.505754:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.505758:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999790.505787:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+527:11419:x1800404480773760:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 129us (1300us total) trans 4294986497 rc 0/0 00000100:00100000:2.0:1716999790.505793:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9341 00010000:00010000:1.0:1716999790.505838:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7c9c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.505843:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7c9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.505848:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7c9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:1.0:1716999790.506398:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1528, 64 off106048 00000040:00080000:1.0:1716999790.506415:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11715, 176 off2094384 00010000:00010000:1.0:1716999790.506461:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7ca3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506468:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7ca3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506474:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7ca3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506479:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7ca3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506483:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7ca3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506487:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7ca3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506491:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7ca3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506495:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2f40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.506498:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7ca3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506503:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7ca3 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506510:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d5:0x0].0x0 (ffff8800a6ad7a00) 00010000:00010000:1.0:1716999790.506513:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.506515:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7ca3 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506519:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7ca3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506534:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7c9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506538:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7c9c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506542:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7c9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506546:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.506548:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7c9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506551:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7c9c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506556:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d5:0x0].0x0 (ffff8800a6ad7a00) 00010000:00010000:1.0:1716999790.506558:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.506560:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7c9c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506564:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7c9c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6d5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506598:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506603:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c8e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.506608:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.507014:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.507020:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.507025:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.507032:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:1.0:1716999790.507034:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.507036:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.507041:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7c8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999790.507049:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131caad80 reply state ffff8801348a3000 transno 4294986498 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999790.507055:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.507183:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+529:11420:x1800404480773632:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2612us (2737us total) trans 4294986498 rc 0/0 00000100:00100000:1.0:1716999790.507189:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45891 00000100:00100000:2.0:1716999790.507693:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.507926:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480773888 00000100:00100000:1.0:1716999790.507932:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480773888 00000100:00100000:1.0:1716999790.507953:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45892 00000100:00100000:1.0:1716999790.507958:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+528:11419:x1800404480773888:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.507991:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:1.0:1716999790.508002:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215c480/0x6d188eabd8d8e0c6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6fa:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f54d71 expref: 528 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.508015:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963f600/0x6d188eabd8d7e4c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6fa:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50094 expref: 527 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.508028:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963eac0/0x6d188eabd8d7e4a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50086 expref: 526 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.508038:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69d40/0x6d188eabd8d7155f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbba expref: 525 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.508055:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fa:0x0].0x0 (ffff8800908c6a00) 00010000:00010000:1.0:1716999790.508064:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc6fec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6619d expref: 524 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.508561:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0x0 (ffff8800908c6c00) 00010000:00010000:1.0:1716999790.508565:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.508582:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.508592:0:6823:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66237 expref: 523 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.508598:0:6823:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 4/0,1 mode: --/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.508620:0:6823:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66237 expref: 523 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.508630:0:6823:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66237 expref: 523 pid: 6823 timeout: 409 lvb_type: 0 00000100:00100000:1.0:1716999790.508641:0:6823:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6823:1800404483017536:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999790.509255:0:6823:0:(client.c:2542:ptlrpc_set_wait()) set ffff880093698b40 going to sleep for 11 seconds 00010000:00010000:1.0:1716999790.509337:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.509343:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.509348:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.509352:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.509354:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.509360:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.509367:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xba72bac9 (ffff8800a6ad7f00) 00010000:00010000:1.0:1716999790.509369:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.509371:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.509374:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7c95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xba72bac9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.509467:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11570:x1800404480773568:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 4633us (5061us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.509476:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9340 00000100:00100000:1.0:1716999790.510285:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.510429:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480774016 00000100:00100000:0.0:1716999790.510433:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480774016 00000100:00100000:0.0:1716999790.510545:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9342 00000100:00100000:0.0:1716999790.510551:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11420:x1800404480774016:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999790.510871:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11716, 168 off2094552 00000001:00080000:0.0:1716999790.510876:0:14949:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986499 00000100:00100000:0.0:1716999790.510983:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+524:11420:x1800404480774016:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 431us (698us total) trans 4294986500 rc 0/0 00000100:00100000:0.0:1716999790.510989:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9342 00000020:00080000:0.0:1716999790.510992:0:14949:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1716999790.512530:0:6823:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6823:1800404483017536:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999790.512548:0:6823:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999790.513504:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.513927:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.513987:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480774208 00000100:00100000:0.0:1716999790.513992:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480774208 00010000:00010000:0.0:1716999790.514013:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66237 expref: 524 pid: 6823 timeout: 409 lvb_type: 0 00000100:00100000:0.0:1716999790.514035:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4584 00000100:00100000:0.0:1716999790.514040:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+524:1958:x1800404480774208:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999790.514051:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999790.514055:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66237 expref: 524 pid: 6823 timeout: 409 lvb_type: 0 00010000:00010000:0.0:1716999790.514071:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66237 expref: 524 pid: 6823 timeout: 409 lvb_type: 0 00010000:00010000:0.0:1716999790.514087:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc7c87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66237 expref: 524 pid: 6823 timeout: 409 lvb_type: 0 00010000:00010000:0.0:1716999790.514102:0:15839:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0x0 (ffff8800908c6c00) 00010000:00010000:0.0:1716999790.514106:0:15839:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.514112:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.514118:0:15839:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.514133:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999790.514304:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480774144 00000100:00100000:2.0:1716999790.514309:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480774144 00000100:00100000:2.0:1716999790.514338:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45893 00000100:00100000:2.0:1716999790.514342:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012feff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+524:11420:x1800404480774144:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.514376:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1716999790.514385:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bdfa80/0x6d188eabd8dc3098 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xc1d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64db5 expref: 524 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.514396:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880135bde880/0x6d188eabd8dc3013 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xc1d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d99 expref: 523 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.514405:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc2ffe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xc1d:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d92 expref: 522 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.514413:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1d:0x0].0x0 (ffff8800923b8000) 00010000:00010000:2.0:1716999790.514419:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.514438:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7cb1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.514446:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7cb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.514451:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7cb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.514460:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7cb8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.514465:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.514469:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.514545:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7cbf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xc1d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.514551:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7cbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.514557:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7cbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.514866:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+521:1958:x1800404480774208:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 822us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.514873:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4584 00000040:00080000:2.0:1716999790.515435:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1524, 64 off105792 00000040:00080000:2.0:1716999790.515456:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11717, 184 off2094736 00010000:00010000:2.0:1716999790.515510:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7cc6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.515516:0:6823:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.515517:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515522:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.515522:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.515530:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7cc6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.515534:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7ccd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f4:0x0].0x8e1e1fc5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.515535:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7cc6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515539:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7cc6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.515540:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7ccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f4:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.515544:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7cc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.515545:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7ccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f4:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.515548:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832880 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.515551:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7cc6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515556:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7cc6 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515563:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1d:0x0].0x0 (ffff880088977d00) 00010000:00010000:2.0:1716999790.515566:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.515568:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7cc6 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515573:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc7cc6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc1d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515591:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7cbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xc1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515596:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7cbf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xc1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515600:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7cbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.515602:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc7cd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6fa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.515604:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.515606:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7cbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xc1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515611:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7cbf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xc1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.515611:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc7cd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.515615:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc7cd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.515616:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc1d:0x0].0x0 (ffff880088977d00) 00010000:00010000:2.0:1716999790.515618:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.515621:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7cbf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xc1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515625:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc7cbf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xc1d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515656:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7cb1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515661:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7cb1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515664:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7cb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515668:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.515670:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7cb1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515674:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7cb1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515680:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:2.0:1716999790.515682:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.515685:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7cb1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.515689:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc7cb1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6d1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999790.515695:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012feff050 reply state ffff8800b53d7000 transno 4294986501 ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.515700:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.515848:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012feff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11420:x1800404480774144:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1503us (2344us total) trans 4294986501 rc 0/0 00000100:00100000:2.0:1716999790.515855:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45893 00000040:00080000:0.0:1716999790.515950:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1525, 64 off105856 00000040:00080000:0.0:1716999790.515960:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11718, 184 off2094920 00010000:00010000:0.0:1716999790.516186:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7cdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6fa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516192:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7cdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516197:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7cdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516201:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7cdb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516205:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7cdb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516209:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7cdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516213:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7cdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516216:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132880 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.516218:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7cdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516222:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7cdb lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516228:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fa:0x0].0x0 (ffff88008a83f700) 00010000:00010000:0.0:1716999790.516229:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.516232:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7cdb lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516235:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc7cdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6fa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516247:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc7cd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516251:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc7cd4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516256:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc7cd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516260:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.516262:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc7cd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516265:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc7cd4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516271:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fa:0x0].0x0 (ffff88008a83f700) 00010000:00010000:0.0:1716999790.516272:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.516275:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc7cd4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516279:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc7cd4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6fa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516308:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516314:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516318:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516321:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.516323:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516327:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516334:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0x0 (ffff8800908c6c00) 00010000:00010000:0.0:1716999790.516335:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.516337:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.516341:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc7caa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999790.516347:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135028e00 reply state ffff8801348a0000 transno 4294986502 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7ccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f4:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.516352:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.516983:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+523:11419:x1800404480773888:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 9020us (9287us total) trans 4294986502 rc 0/0 00000100:00100000:0.0:1716999790.516990:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45892 00010000:00010000:1.0:1716999790.519954:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7ccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f4:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.519967:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7ccd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6f4:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.519973:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7ccd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f4:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.519978:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.519981:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7ccd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f4:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.519988:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7ccd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f4:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.520001:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0x8e1e1fc5 (ffff88008a83fb00) 00010000:00010000:1.0:1716999790.520003:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.520007:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7ccd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6f4:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.520011:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc7ccd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f4:0x0].0x8e1e1fc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.520042:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7cb8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.520048:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7cb8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.520053:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7cb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.520056:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918321c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.520058:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7cb8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.520062:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7cb8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.520069:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0xa4b2186b (ffff880088977f00) 00010000:00010000:2.0:1716999790.520071:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.520073:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7cb8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.520081:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc7cb8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6d1:0x0].0xa4b2186b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.522601:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.522654:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480774336 00000100:00100000:0.0:1716999790.522661:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480774336 00000100:00100000:0.0:1716999790.522699:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9343 00000100:00100000:0.0:1716999790.522705:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+521:11419:x1800404480774336:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999790.523630:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11719, 168 off2095088 00000100:00100000:0.0:1716999790.523947:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11419:x1800404480774336:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1240us (1349us total) trans 4294986503 rc 0/0 00000100:00100000:0.0:1716999790.523954:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9343 00000100:00100000:3.0:1716999790.525083:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.525119:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.525178:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480774464 00000100:00100000:0.0:1716999790.525184:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480774464 00000100:00100000:0.0:1716999790.525219:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9344 00000100:00100000:0.0:1716999790.525224:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11420:x1800404480774464:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.525384:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480774528 00000100:00100000:1.0:1716999790.525388:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480774528 00000100:00100000:1.0:1716999790.525407:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45894 00000100:00100000:1.0:1716999790.525411:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+523:11572:x1800404480774528:12345-192.168.203.3@tcp:101:ll_sa.0 00010000:00010000:1.0:1716999790.525419:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.525432:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7ce2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x734:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6623e expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.525452:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6623e expref: 524 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.525462:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6623e expref: 524 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.525468:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x734:0x0].0x0 (ffff8800b4877400) 00010000:00010000:1.0:1716999790.525470:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.525473:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b3180, rc 0) 00000100:00100000:1.0:1716999790.526036:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+525:11572:x1800404480774528:12345-192.168.203.3@tcp:101:ll_sa.0 Request processed in 621us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.526043:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45894 00000001:00080000:0.0:1716999790.526316:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986504 00000100:00100000:0.0:1716999790.526389:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+525:11420:x1800404480774464:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1163us (1307us total) trans 4294986505 rc 0/0 00000100:00100000:0.0:1716999790.526395:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9344 00000020:00080000:0.0:1716999790.526398:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999790.526777:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.527136:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480774656 00000100:00100000:0.0:1716999790.527141:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480774656 00000100:00100000:0.0:1716999790.527170:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9345 00000100:00100000:0.0:1716999790.527175:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+525:11419:x1800404480774656:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.527280:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+526:11419:x1800404480774656:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 104us (503us total) trans 4294986506 rc 0/0 00000100:00100000:0.0:1716999790.527286:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9345 00000100:00100000:3.0:1716999790.529870:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.529965:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.530008:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480774912 00000100:00100000:3.0:1716999790.530009:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.530014:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480774912 00000100:00100000:2.0:1716999790.530039:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480774976 00000100:00100000:2.0:1716999790.530041:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480774976 00000100:00100000:2.0:1716999790.530054:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9346 00000100:00100000:2.0:1716999790.530059:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+527:11420:x1800404480774912:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.530093:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9347 00000100:00100000:0.0:1716999790.530099:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+527:11572:x1800404480774976:12345-192.168.203.3@tcp:37:ll_sa.0 00000100:00100000:1.0:1716999790.530213:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480774784 00000100:00100000:1.0:1716999790.530217:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480774784 00000100:00100000:1.0:1716999790.530235:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45895 00000100:00100000:1.0:1716999790.530239:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+528:11419:x1800404480774784:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.530259:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.530275:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009186d440/0x6d188eabd8d8d9e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f8:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f54b02 expref: 528 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.530290:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7efa80/0x6d188eabd8d7e402 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6f8:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50063 expref: 527 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.530301:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009186d200/0x6d188eabd8d7e3f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5005c expref: 526 pid: 7785 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1716999790.530305:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11720, 168 off2095256 00010000:00010000:1.0:1716999790.530309:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a1c0/0x6d188eabd8d714be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb6d expref: 525 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.530327:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f8:0x0].0x0 (ffff8800908c6b00) 00010000:00010000:1.0:1716999790.530335:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.530349:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7ce9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.530358:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7ce9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.530364:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7ce9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.530372:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7cf0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f4:0x0].0xa12eb2e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.530377:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999790.530378:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+525:11420:x1800404480774912:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 318us (412us total) trans 4294986507 rc 0/0 00010000:00010000:1.0:1716999790.530381:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999790.530384:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9346 00010000:00010000:1.0:1716999790.530445:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7cf7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6f8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.530449:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7cf7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.530453:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7cf7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999790.532344:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.532362:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480775104 00000100:00100000:2.0:1716999790.532367:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480775104 00000100:00100000:2.0:1716999790.532395:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45896 00000100:00100000:2.0:1716999790.532400:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+525:11420:x1800404480775104:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.532424:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 6 locks, starting at 0 00010000:00010000:2.0:1716999790.532438:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905d8900/0x6d188eabd8d81caa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x738:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f512ae expref: 525 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.532451:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091331b00/0x6d188eabd8d7c16b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x738:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f4bd expref: 524 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.532462:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905d8000/0x6d188eabd8d81c79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x738:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f51299 expref: 523 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.532475:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419ef40/0x6d188eabd8d72963 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x738:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c418 expref: 522 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.532482:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x738:0x0].0x0 (ffff88012e3f8300) 00010000:00010000:2.0:1716999790.532492:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009477a400/0x6d188eabd8d81708 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x734:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f510e7 expref: 521 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.532501:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8d7f416 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x734:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f505b1 expref: 520 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.532507:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x734:0x0].0x0 (ffff8800b4877400) 00010000:00010000:2.0:1716999790.532509:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.532523:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x734:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.532531:0:7785:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7ce2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6623e expref: 519 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.532537:0:7785:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 4/0,1 mode: --/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.532559:0:7785:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6623e expref: 519 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.532569:0:7785:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6623e expref: 519 pid: 6823 timeout: 409 lvb_type: 0 00000100:00100000:2.0:1716999790.532579:0:7785:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88013502b100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:7785:1800404483017600:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999790.532610:0:7785:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009c108840 going to sleep for 11 seconds 00000100:00100000:0.0:1716999790.533096:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+519:11572:x1800404480774976:12345-192.168.203.3@tcp:37:ll_sa.0 Request processed in 2995us (3085us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.533104:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9347 00000040:00080000:1.0:1716999790.533604:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1526, 64 off105920 00000040:00080000:1.0:1716999790.533621:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11721, 184 off2095440 00010000:00010000:1.0:1716999790.533679:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7d05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533687:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533698:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7d05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533703:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7d05 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533707:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7d05 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533711:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7d05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533716:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7d05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533719:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1f80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.533722:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7d05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533727:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7d05 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533734:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f8:0x0].0x0 (ffff8800a6ad7000) 00010000:00010000:1.0:1716999790.533736:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.533739:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7d05 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533743:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7d05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533759:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7cf7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533763:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7cf7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533769:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7cf7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533772:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.533774:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7cf7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533779:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7cf7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533784:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f8:0x0].0x0 (ffff8800a6ad7000) 00010000:00010000:1.0:1716999790.533785:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.533787:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7cf7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533791:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7cf7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6f8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533836:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7ce9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533842:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7ce9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533846:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7ce9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533850:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.533852:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7ce9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533856:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7ce9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533866:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0x0 (ffff8800908c6c00) 00010000:00010000:1.0:1716999790.533867:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.533869:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7ce9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.533873:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7ce9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999790.533894:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e440e00 reply state ffff8801348a0000 transno 4294986508 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999790.533900:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.533930:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+520:11419:x1800404480774784:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 3688us (4066us total) trans 4294986508 rc 0/0 00000100:00100000:1.0:1716999790.533935:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45895 00000100:00100000:0.0:1716999790.536342:0:7785:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88013502b100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:7785:1800404483017600:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999790.536363:0:7785:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.536858:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7cf0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.536866:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7cf0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.536871:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7cf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.536876:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.536891:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7cf0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.536897:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7cf0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.536908:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0xa12eb2e9 (ffff8800a6ad7a00) 00010000:00010000:3.0:1716999790.536911:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.536913:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7cf0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6f4:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999790.536918:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc7cf0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f4:0x0].0xa12eb2e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999790.537979:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.538011:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480775232 00000100:00100000:3.0:1716999790.538015:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.538016:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480775232 00000100:00100000:0.0:1716999790.538047:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9348 00000100:00100000:0.0:1716999790.538052:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+519:11419:x1800404480775232:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.538065:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480775296 00000100:00100000:1.0:1716999790.538069:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480775296 00010000:00010000:1.0:1716999790.538085:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6623e expref: 520 pid: 6823 timeout: 409 lvb_type: 0 00000100:00100000:1.0:1716999790.538102:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4585 00000100:00100000:1.0:1716999790.538106:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+520:1956:x1800404480775296:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999790.538114:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999790.538118:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7ce2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6623e expref: 520 pid: 6823 timeout: 409 lvb_type: 0 00010000:00010000:1.0:1716999790.538127:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6623e expref: 520 pid: 6823 timeout: 409 lvb_type: 0 00010000:00010000:1.0:1716999790.538143:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7ce2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6623e expref: 520 pid: 6823 timeout: 409 lvb_type: 0 00010000:00010000:1.0:1716999790.538153:0:15839:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x734:0x0].0x0 (ffff8800b4877400) 00010000:00010000:1.0:1716999790.538156:0:15839:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538163:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538168:0:15839:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538182:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999790.538207:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+519:1956:x1800404480775296:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 101us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.538213:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4585 00010000:00010000:1.0:1716999790.538266:0:7785:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538272:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538283:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7d0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x734:0x0].0xb0773fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999790.538286:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11722, 168 off2095608 00010000:00010000:1.0:1716999790.538289:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x734:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538295:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x734:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.538356:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+519:11419:x1800404480775232:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 302us (378us total) trans 4294986509 rc 0/0 00000100:00100000:0.0:1716999790.538361:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9348 00010000:00010000:1.0:1716999790.538369:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7d13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x738:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538375:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7d13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x738:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538379:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7d13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x738:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:1.0:1716999790.538745:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1527, 64 off105984 00000040:00080000:1.0:1716999790.538759:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11723, 184 off2095792 00010000:00010000:1.0:1716999790.538810:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7d1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x738:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538817:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7d1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x738:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538823:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7d1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x738:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538828:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7d1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x738:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538833:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7d1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x738:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538838:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7d1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x738:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538842:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7d1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x738:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538847:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2ac0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.538849:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7d1a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x738:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538855:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7d1a lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x738:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538861:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x738:0x0].0x0 (ffff8800a6ad7700) 00010000:00010000:1.0:1716999790.538863:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.538866:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7d1a lrc: 3/0,0 mode: --/PW res: [0x200000401:0x738:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538870:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7d1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x738:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538908:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7d13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x738:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538914:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7d13 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x738:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538918:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7d13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x738:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538922:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.538924:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7d13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x738:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538928:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7d13 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x738:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538934:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x738:0x0].0x0 (ffff8800a6ad7700) 00010000:00010000:1.0:1716999790.538936:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.538937:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7d13 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x738:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538941:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7d13 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x738:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538974:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538979:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538983:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538987:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.538989:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538993:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.538997:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x734:0x0].0x0 (ffff8800b4877400) 00010000:00010000:1.0:1716999790.538999:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.539001:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.539005:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc7cfe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.539011:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88013502b480 reply state ffff8800b53d7000 transno 4294986510 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x734:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.539015:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.539053:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+520:11420:x1800404480775104:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 6652us (6710us total) trans 4294986510 rc 0/0 00000100:00100000:1.0:1716999790.539059:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45896 00000100:00100000:1.0:1716999790.541478:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.541538:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480775424 00000100:00100000:2.0:1716999790.541545:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480775424 00000100:00100000:2.0:1716999790.541580:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9349 00000100:00100000:2.0:1716999790.541587:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+520:11419:x1800404480775424:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.541741:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+521:11419:x1800404480775424:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 153us (268us total) trans 4294986511 rc 0/0 00000100:00100000:2.0:1716999790.541748:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9349 00010000:00010000:1.0:1716999790.542118:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x734:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.542127:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7d0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x734:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.542132:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x734:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.542136:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.542139:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x734:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.542144:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7d0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x734:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.542155:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x734:0x0].0xb0773fd (ffff8800a6ad7500) 00010000:00010000:1.0:1716999790.542157:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.542160:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7d0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x734:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.542164:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7d0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x734:0x0].0xb0773fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.544375:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.544793:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.544874:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480775552 00000100:00100000:2.0:1716999790.544893:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480775552 00000100:00100000:0.0:1716999790.544896:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480775680 00000100:00100000:0.0:1716999790.544899:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480775680 00000100:00100000:0.0:1716999790.544923:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9350 00000100:00100000:0.0:1716999790.544951:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+521:11420:x1800404480775680:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.544981:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45897 00000100:00100000:3.0:1716999790.544987:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+521:11419:x1800404480775552:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.545015:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.545030:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092847840/0x6d188eabd8d8d4fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f6:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f54973 expref: 521 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.545046:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8d7e29d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6f6:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ffde expref: 520 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.545056:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963cfc0/0x6d188eabd8d7e250 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ffb4 expref: 519 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.545065:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f25440/0x6d188eabd8d7142b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb2e expref: 518 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.545072:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f6:0x0].0x0 (ffff88009a33c300) 00010000:00010000:3.0:1716999790.545079:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.545100:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7d21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545109:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7d21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545116:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7d21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545124:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7d28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f4:0x0].0xb61ad33 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545129:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545133:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545213:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7d2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6f6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545219:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7d2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545228:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7d2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000001:00080000:0.0:1716999790.545464:0:16640:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986512 00000100:00100000:0.0:1716999790.545546:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+519:11420:x1800404480775680:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 616us (757us total) trans 4294986513 rc 0/0 00000100:00100000:0.0:1716999790.545552:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9350 00000020:00080000:0.0:1716999790.545556:0:16640:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1716999790.545592:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1528, 64 off106048 00000040:00080000:3.0:1716999790.545611:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11724, 184 off2095976 00010000:00010000:3.0:1716999790.545653:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7d36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6f6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545658:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7d36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545664:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7d36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545668:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7d36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545672:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7d36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545676:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7d36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545680:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7d36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545684:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.545687:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7d36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545692:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7d36 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545697:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f6:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.545700:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.545702:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7d36 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545706:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc7d36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545718:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7d2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545722:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7d2f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545726:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7d2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545729:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.545730:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7d2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545734:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7d2f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545739:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f6:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.545741:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.545742:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7d2f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545746:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc7d2f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6f6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545778:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7d21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545783:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7d21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545788:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7d21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545791:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.545793:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7d21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545808:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7d21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545814:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0x0 (ffff8800908c6c00) 00010000:00010000:3.0:1716999790.545816:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.545818:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7d21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.545822:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc7d21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6f4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999790.545827:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a6a1c00 reply state ffff8800996ae000 transno 4294986514 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.545832:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.545870:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+520:11419:x1800404480775552:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 883us (1499us total) trans 4294986514 rc 0/0 00000100:00100000:3.0:1716999790.545875:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45897 00000100:00100000:1.0:1716999790.548054:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999790.548160:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.548169:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7d28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.548174:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.548178:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c521c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.548181:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.548186:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7d28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6f4:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.548195:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0xb61ad33 (ffff8800a5c6e200) 00010000:00010000:3.0:1716999790.548197:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.548200:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7d28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6f4:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.548204:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc7d28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6f4:0x0].0xb61ad33 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.548236:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480775808 00000100:00100000:0.0:1716999790.548243:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480775808 00000100:00100000:0.0:1716999790.548276:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9351 00000100:00100000:0.0:1716999790.548281:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+519:11420:x1800404480775808:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:0.0:1716999790.548968:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11725, 168 off2096144 00000100:00100000:0.0:1716999790.549063:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+520:11420:x1800404480775808:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 780us (1014us total) trans 4294986515 rc 0/0 00000100:00100000:0.0:1716999790.549069:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9351 00000100:00100000:0.0:1716999790.550334:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.550838:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480775872 00000100:00100000:2.0:1716999790.550844:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480775872 00000100:00100000:2.0:1716999790.550889:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9352 00000100:00100000:2.0:1716999790.550896:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+520:11419:x1800404480775872:12345-192.168.203.3@tcp:37:dbench.0 00000100:00100000:1.0:1716999790.551554:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.551599:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480776000 00000100:00100000:3.0:1716999790.551603:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480776000 00000100:00100000:3.0:1716999790.551625:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45898 00000100:00100000:3.0:1716999790.551629:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11420:x1800404480776000:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.551658:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.551675:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009477af40/0x6d188eabd8d81e0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x739:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f51325 expref: 522 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.551689:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8d7c1b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x739:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f4cb expref: 521 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.551699:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009186c000/0x6d188eabd8d81de5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x739:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f51310 expref: 520 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.551710:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920f9200/0x6d188eabd8d729be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x739:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c449 expref: 519 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.551717:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x739:0x0].0x0 (ffff880094791000) 00010000:00010000:3.0:1716999790.551725:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.551740:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7d3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x734:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.551751:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7d3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.551758:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7d3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.551766:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7d44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x734:0x0].0x155bec67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.551771:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7d44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x734:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.551776:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7d44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x734:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.551848:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7d4b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x739:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.551853:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7d4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x739:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.551857:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7d4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x739:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:3.0:1716999790.552251:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1529, 64 off106112 00000040:00080000:3.0:1716999790.552271:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11726, 184 off2096328 00010000:00010000:3.0:1716999790.552320:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7d52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x739:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552327:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7d52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x739:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552333:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7d52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x739:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552338:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7d52 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x739:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552343:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7d52 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x739:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552347:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7d52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x739:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552351:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7d52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x739:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552356:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.552359:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7d52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x739:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552365:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7d52 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x739:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552371:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x739:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999790.552373:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.552376:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7d52 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x739:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552379:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc7d52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x739:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552399:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7d4b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x739:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552403:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7d4b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x739:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552406:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7d4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x739:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552409:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.552411:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7d4b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x739:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552414:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7d4b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x739:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552419:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x739:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999790.552420:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.552422:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7d4b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x739:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552425:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc7d4b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x739:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552459:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7d3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552463:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7d3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552467:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7d3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552470:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.552473:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7d3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552476:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7d3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552481:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x734:0x0].0x0 (ffff8800b4877400) 00010000:00010000:3.0:1716999790.552483:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.552484:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7d3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.552487:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc7d3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999790.552493:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a6a0e00 reply state ffff8800996ab000 transno 4294986516 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7d44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x734:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.552498:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.552544:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+520:11420:x1800404480776000:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 912us (989us total) trans 4294986516 rc 0/0 00000100:00100000:3.0:1716999790.552550:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45898 00010000:00010000:1.0:1716999790.554487:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7d44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x734:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.554496:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7d44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x734:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.554505:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7d44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x734:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.554509:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c506c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.554511:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7d44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x734:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.554516:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7d44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x734:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.554527:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x734:0x0].0x155bec67 (ffff8800a5c6ea00) 00010000:00010000:1.0:1716999790.554529:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.554531:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7d44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x734:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.554535:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc7d44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x734:0x0].0x155bec67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.556815:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.556899:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480776128 00000100:00100000:2.0:1716999790.556906:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480776128 00000100:00100000:2.0:1716999790.556935:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9353 00000100:00100000:2.0:1716999790.556940:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+518:11420:x1800404480776128:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.557059:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+518:11419:x1800404480775872:12345-192.168.203.3@tcp:37:dbench.0 Request processed in 6162us (6725us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.557066:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9352 00000001:00080000:2.0:1716999790.558581:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986517 00000100:00100000:2.0:1716999790.558683:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+519:11420:x1800404480776128:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1740us (1884us total) trans 4294986518 rc 0/0 00000100:00100000:2.0:1716999790.558690:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9353 00000020:00080000:2.0:1716999790.558693:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1716999790.561160:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.561248:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480776256 00000100:00100000:2.0:1716999790.561254:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480776256 00000100:00100000:2.0:1716999790.561283:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9354 00000100:00100000:2.0:1716999790.561289:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+519:11420:x1800404480776256:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:2.0:1716999790.561530:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11727, 168 off2096496 00000100:00100000:2.0:1716999790.562506:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+520:11420:x1800404480776256:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1213us (1348us total) trans 4294986519 rc 0/0 00000100:00100000:2.0:1716999790.562514:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9354 00000100:00100000:3.0:1716999790.563616:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.563683:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480776384 00000100:00100000:2.0:1716999790.563689:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480776384 00000100:00100000:2.0:1716999790.564341:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9355 00000100:00100000:2.0:1716999790.564348:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+520:11419:x1800404480776384:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.564933:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000040:00080000:2.0:1716999790.565127:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11728, 168 off2096664 00000001:00080000:2.0:1716999790.565132:0:6824:0:(tgt_lastrcvd.c:2104:tgt_txn_stop_cb()) More than one transaction 4294986520 00000100:00100000:3.0:1716999790.565241:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480776512 00000100:00100000:3.0:1716999790.565246:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480776512 00000100:00100000:3.0:1716999790.565267:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45899 00000100:00100000:3.0:1716999790.565271:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+523:11420:x1800404480776512:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:3.0:1716999790.565293:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.565309:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf61c0/0x6d188eabd8d81954 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x736:0x0].0x0 bits 0xc/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5119d expref: 523 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.565331:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091331f80/0x6d188eabd8d7c141 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x736:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f4af expref: 522 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.565340:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf58c0/0x6d188eabd8d8191c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x736:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5118f expref: 521 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.565348:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ed8c0/0x6d188eabd8d728c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x736:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3d2 expref: 520 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.565356:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x736:0x0].0x0 (ffff8800941a3800) 00010000:00010000:3.0:1716999790.565363:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.565380:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7d59 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x734:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565389:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7d59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565396:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7d59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565404:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7d60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x734:0x0].0x41c358e5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565408:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7d60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x734:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565412:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7d60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x734:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565473:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7d67 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x736:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565482:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7d67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x736:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565488:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7d67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x736:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:3.0:1716999790.565794:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1529, 64 off106112 00000040:00080000:3.0:1716999790.565818:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11729, 184 off2096848 00010000:00010000:3.0:1716999790.565858:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7d6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x736:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565865:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7d6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x736:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565870:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7d6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x736:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565876:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7d6e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x736:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565899:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7d6e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x736:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565903:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7d6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x736:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565908:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7d6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x736:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565912:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c533c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.565915:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7d6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x736:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565920:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7d6e lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x736:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565926:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x736:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999790.565928:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.565930:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7d6e lrc: 3/0,0 mode: --/PW res: [0x200000401:0x736:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565934:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc7d6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x736:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565946:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7d67 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x736:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565950:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7d67 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x736:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565955:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7d67 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x736:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565958:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.565960:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7d67 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x736:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565964:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7d67 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x736:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565968:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x736:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999790.565969:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.565971:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7d67 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x736:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.565974:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc7d67 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x736:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.566003:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7d59 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.566007:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7d59 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.566011:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7d59 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.566014:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.566016:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7d59 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.566019:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7d59 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.566023:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x734:0x0].0x0 (ffff8800b4877400) 00010000:00010000:3.0:1716999790.566024:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.566026:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7d59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.566029:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc7d59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x734:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999790.566034:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131cab800 reply state ffff8800996aa000 transno 4294986522 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7d60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x734:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.566038:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.566187:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+521:11419:x1800404480776384:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1838us (2571us total) trans 4294986521 rc 0/0 00000100:00100000:2.0:1716999790.566193:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9355 00000020:00080000:2.0:1716999790.566197:0:6824:0:(tgt_main.c:804:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1716999790.567730:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+520:11420:x1800404480776512:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2453us (2793us total) trans 4294986522 rc 0/0 00000100:00100000:3.0:1716999790.567738:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45899 00010000:00010000:0.0:1716999790.569551:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7d60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x734:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.569561:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7d60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x734:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.569567:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7d60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x734:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.569571:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.569575:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7d60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x734:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.569580:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7d60 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x734:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.569592:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x734:0x0].0x41c358e5 (ffff8800a5c6e700) 00010000:00010000:0.0:1716999790.569595:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.569598:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7d60 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x734:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.569601:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7d60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x734:0x0].0x41c358e5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.569767:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.569913:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480776640 00000100:00100000:0.0:1716999790.569919:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480776640 00000100:00100000:0.0:1716999790.569949:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9356 00000100:00100000:0.0:1716999790.569955:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+519:11419:x1800404480776640:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.570110:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+520:11419:x1800404480776640:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 155us (345us total) trans 4294986523 rc 0/0 00000100:00100000:0.0:1716999790.570117:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9356 00000100:00100000:3.0:1716999790.571492:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.572236:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480776768 00000100:00100000:0.0:1716999790.572242:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480776768 00000100:00100000:0.0:1716999790.572281:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45900 00000100:00100000:0.0:1716999790.572287:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+520:11419:x1800404480776768:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.572319:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 5 locks, starting at 0 00010000:00010000:0.0:1716999790.572336:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092847cc0/0x6d188eabd8d8ef13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x72f:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f55217 expref: 520 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.572350:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012bbf4900/0x6d188eabd8d81293 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72f:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50f97 expref: 519 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.572360:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800905da880/0x6d188eabd8d81190 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72f:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50f4a expref: 518 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.572370:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8903840/0x6d188eabd8d72645 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c2f9 expref: 517 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.572378:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72f:0x0].0x0 (ffff880131c40800) 00010000:00010000:0.0:1716999790.572389:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68480/0x6d188eabd8dc7008 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f661a4 expref: 516 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.572403:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72e:0x0].0x0 (ffff8800939bad00) 00010000:00010000:0.0:1716999790.572406:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.572425:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc7d75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x72e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.572433:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc7d75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x72e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.572441:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc7d75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x72e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.572449:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7d7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x72e:0x0].0x1da15914 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.572453:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72e:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.572459:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72e:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.572543:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7d83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x72f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.572548:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7d83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.572553:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7d83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999790.573000:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1530, 64 off106176 00000040:00080000:0.0:1716999790.573019:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11730, 184 off2097032 00010000:00010000:0.0:1716999790.573067:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7d8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x72f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573074:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7d8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573083:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7d8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573088:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7d8a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x72f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573093:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7d8a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x72f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573098:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7d8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x72f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573102:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7d8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x72f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573106:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131200 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.573109:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7d8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x72f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573114:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7d8a lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x72f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573120:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72f:0x0].0x0 (ffff88008a83fb00) 00010000:00010000:0.0:1716999790.573122:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.573124:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7d8a lrc: 3/0,0 mode: --/PW res: [0x200000401:0x72f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573128:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc7d8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x72f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573145:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7d83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573149:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7d83 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x72f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573153:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7d83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573156:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.573159:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7d83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573163:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7d83 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x72f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573168:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72f:0x0].0x0 (ffff88008a83fb00) 00010000:00010000:0.0:1716999790.573169:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.573171:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7d83 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x72f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573174:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc7d83 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x72f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573206:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc7d75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x72e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573210:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc7d75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x72e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573214:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc7d75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x72e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573218:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1333c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.573220:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc7d75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x72e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573224:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc7d75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x72e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573233:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72e:0x0].0x0 (ffff8800939bad00) 00010000:00010000:0.0:1716999790.573235:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.573238:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc7d75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x72e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.573241:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc7d75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x72e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999790.573248:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e442300 reply state ffff880089b49000 transno 4294986524 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72e:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.573253:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.573315:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+517:11419:x1800404480776768:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1026us (1823us total) trans 4294986524 rc 0/0 00000100:00100000:0.0:1716999790.573321:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45900 00000100:00100000:1.0:1716999790.576063:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.576127:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480776896 00000100:00100000:1.0:1716999790.576134:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480776896 00000100:00100000:1.0:1716999790.576160:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9357 00000100:00100000:1.0:1716999790.576166:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+517:11420:x1800404480776896:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.576338:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+518:11420:x1800404480776896:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 170us (280us total) trans 4294986525 rc 0/0 00000100:00100000:1.0:1716999790.576402:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9357 00000100:00100000:3.0:1716999790.576678:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999790.576729:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7d7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x72e:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.576737:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7d7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x72e:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.576743:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7d7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x72e:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.576747:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.576750:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7d7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x72e:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.576756:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7d7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x72e:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.576766:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72e:0x0].0x1da15914 (ffff88008a83f600) 00010000:00010000:0.0:1716999790.576769:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.576772:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7d7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x72e:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.576776:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc7d7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x72e:0x0].0x1da15914 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.576809:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480777024 00000100:00100000:0.0:1716999790.576812:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480777024 00000100:00100000:0.0:1716999790.576836:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9358 00000100:00100000:0.0:1716999790.576841:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+518:11419:x1800404480777024:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.576947:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+519:11419:x1800404480777024:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 104us (268us total) trans 4294986526 rc 0/0 00000100:00100000:0.0:1716999790.576952:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9358 00000100:00100000:3.0:1716999790.578303:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.578374:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480777152 00000100:00100000:2.0:1716999790.578379:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480777152 00000100:00100000:2.0:1716999790.578402:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45901 00000100:00100000:2.0:1716999790.578406:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+518:11420:x1800404480777152:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:2.0:1716999790.578435:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1716999790.578450:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216ef40/0x6d188eabd8d7af6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6bf:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4eeff expref: 518 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.578464:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013541b840/0x6d188eabd8d7aebe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6bf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4eec7 expref: 517 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.578472:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8c480/0x6d188eabd8d7010e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6bf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b371 expref: 516 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.578479:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6bf:0x0].0x0 (ffff880092a37200) 00010000:00010000:2.0:1716999790.578485:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.578505:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7d91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.578513:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7d91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.578520:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7d91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.578530:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7d98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171ed56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.578534:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.578538:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.578618:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7d9f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6bf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.578625:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.578630:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:2.0:1716999790.579363:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1530, 64 off106176 00000040:00080000:2.0:1716999790.579412:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xa:0x0].11732, 184 off2097336 00010000:00010000:2.0:1716999790.579464:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7da6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6bf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579472:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579478:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579482:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7da6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579486:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7da6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579490:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7da6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579495:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7da6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579499:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830000 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.579502:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7da6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579507:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7da6 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579514:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6bf:0x0].0x0 (ffff880088977900) 00010000:00010000:2.0:1716999790.579517:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.579519:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7da6 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579524:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7da6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6bf:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579540:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7d9f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579545:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7d9f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579549:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7d9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579552:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918306c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.579555:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7d9f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579559:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7d9f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579565:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6bf:0x0].0x0 (ffff880088977900) 00010000:00010000:2.0:1716999790.579566:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.579568:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7d9f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579572:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7d9f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6bf:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579609:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7d91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579614:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7d91 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579618:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7d91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579622:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.579624:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7d91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579631:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7d91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999790.579715:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.579747:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480777280 00000100:00100000:0.0:1716999790.579752:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480777280 00010000:00010000:2.0:1716999790.579762:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x0 (ffff880099d1be00) 00010000:00010000:2.0:1716999790.579764:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.579767:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7d91 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999790.579771:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7d91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999790.579779:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e441f80 reply state ffff8800b53d2000 transno 4294986527 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.579780:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45902 00000100:00100000:2.0:1716999790.579784:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.579785:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+517:11419:x1800404480777280:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.579815:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999790.579825:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf52400/0x6d188eabd8d7a6bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b8:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ec58 expref: 518 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.579837:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215fa80/0x6d188eabd8d7a698 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ec4a expref: 517 pid: 11055 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999790.579845:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+516:11420:x1800404480777152:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1438us (1544us total) trans 4294986527 rc 0/0 00010000:00010000:0.0:1716999790.579847:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920f8000/0x6d188eabd8d6fec9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b267 expref: 516 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999790.579850:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45901 00010000:00010000:0.0:1716999790.579852:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b8:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:0.0:1716999790.579857:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.579867:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7dad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.579874:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7dad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.579895:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7dad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.579904:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7db4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171ea56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.580092:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7db4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.580099:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7db4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.580155:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7dbb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.580161:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7dbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.580166:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7dbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999790.580519:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1531, 64 off106240 00000004:00080000:0.0:1716999790.580524:0:7785:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 309779643421ns, next at 310779642222ns, rc = 0 00000040:00080000:0.0:1716999790.580531:0:7785:0:(llog_cat.c:591:llog_cat_add_rec()) llog_write_rec -28: lh=ffff8800990abc00 00000040:00080000:0.0:1716999790.580610:0:7785:0:(llog_osd.c:233:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1716999790.580665:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1716999790.580733:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].1, 184 off8376 00010000:00010000:0.0:1716999790.580785:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7dc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.580792:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581215:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581221:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7dc2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6b8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581225:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7dc2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6b8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581229:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7dc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581234:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7dc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581238:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.581240:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7dc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581244:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7dc2 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6b8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581250:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b8:0x0].0x0 (ffff88008a83f400) 00010000:00010000:0.0:1716999790.581252:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.581254:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7dc2 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6b8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581258:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc7dc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581276:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7dbb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581280:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7dbb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581284:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7dbb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581287:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.581288:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7dbb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581292:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7dbb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581296:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b8:0x0].0x0 (ffff88008a83f400) 00010000:00010000:0.0:1716999790.581297:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.581299:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7dbb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581304:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc7dbb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581330:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7dad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581333:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7dad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581337:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7dad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581341:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1321c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.581343:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7dad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581351:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7dad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581356:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x0 (ffff880099d1bf00) 00010000:00010000:0.0:1716999790.581358:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.581359:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7dad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.581363:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc7dad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999790.581370:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a6a0a80 reply state ffff880089b4e000 transno 4294986528 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7db4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.581375:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.581415:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+516:11419:x1800404480777280:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 1627us (1699us total) trans 4294986528 rc 0/0 00000100:00100000:0.0:1716999790.581420:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45902 00010000:00010000:0.0:1716999790.581988:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7d98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.581995:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7d98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.581999:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7d98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.582003:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.582006:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7d98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.582011:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7d98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.582019:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x8171ed56 (ffff880088977000) 00010000:00010000:0.0:1716999790.582021:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.582024:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7d98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.582028:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc7d98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171ed56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.582344:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999790.582423:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7db4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.582432:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7db4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.582437:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7db4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.582441:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.582443:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7db4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.582448:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7db4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.582455:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x8171ea56 (ffff88008a83f700) 00010000:00010000:1.0:1716999790.582457:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.582460:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7db4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.582512:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7db4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.582533:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480777408 00000100:00100000:1.0:1716999790.582538:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480777408 00000100:00100000:1.0:1716999790.582703:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9359 00000100:00100000:1.0:1716999790.582708:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+514:11420:x1800404480777408:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.583078:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+515:11420:x1800404480777408:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 367us (734us total) trans 4294986529 rc 0/0 00000100:00100000:1.0:1716999790.583084:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9359 00000100:00100000:3.0:1716999790.585700:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.585732:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.585783:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480777536 00000100:00100000:0.0:1716999790.585790:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480777536 00000100:00100000:1.0:1716999790.585931:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480777664 00000100:00100000:1.0:1716999790.585935:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480777664 00000100:00100000:1.0:1716999790.585955:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9360 00000100:00100000:1.0:1716999790.585960:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+516:11419:x1800404480777664:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.586114:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+517:11419:x1800404480777664:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 152us (379us total) trans 4294986530 rc 0/0 00000100:00100000:1.0:1716999790.586120:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9360 00000100:00100000:0.0:1716999790.586169:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45903 00000100:00100000:0.0:1716999790.586174:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+516:11420:x1800404480777536:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.586194:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999790.586209:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216d200/0x6d188eabd8d7a740 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b9:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ec74 expref: 516 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.586221:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf50480/0x6d188eabd8d7a71d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ec66 expref: 515 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.586230:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012faccd80/0x6d188eabd8d6ff1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b28a expref: 514 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.586237:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b9:0x0].0x0 (ffff88009ab4ab00) 00010000:00010000:0.0:1716999790.586243:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.586258:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7dc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586267:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7dc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586274:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7dc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586282:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7dd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171ea56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586286:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586291:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586353:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7dd7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586358:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7dd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586362:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7dd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999790.586707:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1531, 64 off106240 00000040:00080000:0.0:1716999790.586724:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].2, 184 off8560 00010000:00010000:0.0:1716999790.586767:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7dde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586773:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7dde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586779:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7dde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586784:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7dde lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586791:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7dde lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586807:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7dde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586813:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7dde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586817:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.586820:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7dde lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586825:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7dde lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.586831:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b9:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.586833:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.587668:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7dde lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587676:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7dde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587695:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7dd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587700:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7dd7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587704:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7dd7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587708:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.587710:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7dd7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587714:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7dd7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587721:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b9:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.587723:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.587725:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7dd7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587729:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7dd7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b9:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587766:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7dc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587769:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7dc9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587773:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7dc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587777:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.587779:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7dc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587783:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7dc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587788:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x0 (ffff880099d1be00) 00010000:00010000:0.0:1716999790.587789:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.587791:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7dc9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.587827:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7dc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999790.587835:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e440380 reply state ffff880093232000 transno 4294986531 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.587840:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.588240:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+515:11420:x1800404480777536:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2061us (2542us total) trans 4294986531 rc 0/0 00000100:00100000:0.0:1716999790.588246:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45903 00000100:00100000:3.0:1716999790.590656:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999790.590733:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.590740:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7dd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.590746:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7dd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.590749:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.590752:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7dd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.590758:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7dd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.590768:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x8171ea56 (ffff88008a83f200) 00010000:00010000:0.0:1716999790.590770:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.590773:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7dd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.590777:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7dd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171ea56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.591133:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480777792 00000100:00100000:1.0:1716999790.591141:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480777792 00000100:00100000:1.0:1716999790.591420:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45904 00000100:00100000:1.0:1716999790.591426:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+514:11419:x1800404480777792:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.591466:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1716999790.591479:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef3600/0x6d188eabd8d7ab30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6bc:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ed9a expref: 514 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.591492:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f26d00/0x6d188eabd8d7aa73 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6bc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ed54 expref: 513 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.591508:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920f98c0/0x6d188eabd8d7000b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6bc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2fa expref: 512 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.591515:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6bc:0x0].0x0 (ffff880099d1bb00) 00010000:00010000:1.0:1716999790.591520:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.591539:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7de5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.591548:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7de5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.591555:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7de5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.591568:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7dec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171ec56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.591573:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.591577:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.591660:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7df3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6bc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.591666:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7df3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.591672:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7df3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.591856:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.592095:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480777920 00000100:00100000:3.0:1716999790.592098:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480777920 00000100:00100000:3.0:1716999790.592117:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9361 00000100:00100000:3.0:1716999790.592121:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+512:11420:x1800404480777920:12345-192.168.203.3@tcp:35:dbench.0 00000040:00080000:1.0:1716999790.592147:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1532, 64 off106304 00000040:00080000:1.0:1716999790.592164:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].3, 184 off8744 00010000:00010000:1.0:1716999790.592213:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7dfa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6bc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592219:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7dfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592224:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7dfa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592229:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7dfa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592233:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7dfa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.592237:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+514:11420:x1800404480777920:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 114us (381us total) trans 4294986533 rc 0/0 00010000:00010000:1.0:1716999790.592241:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7dfa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.592243:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9361 00010000:00010000:1.0:1716999790.592245:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7dfa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592249:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.592251:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7dfa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592256:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7dfa lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592262:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6bc:0x0].0x0 (ffff8800a6ad7c00) 00010000:00010000:1.0:1716999790.592264:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.592266:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7dfa lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592270:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc7dfa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6bc:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592283:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7df3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592287:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7df3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592291:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7df3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592295:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.592297:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7df3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592304:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7df3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592310:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6bc:0x0].0x0 (ffff8800a6ad7c00) 00010000:00010000:1.0:1716999790.592312:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.592314:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7df3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592318:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc7df3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6bc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592350:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7de5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592355:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7de5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592358:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7de5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592362:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.592364:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7de5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592368:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7de5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592373:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x0 (ffff880099d1bf00) 00010000:00010000:1.0:1716999790.592375:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.592377:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7de5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.592380:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc7de5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.592386:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e443800 reply state ffff8801348a5000 transno 4294986532 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.592391:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.592417:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+514:11419:x1800404480777792:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 991us (1766us total) trans 4294986532 rc 0/0 00000100:00100000:1.0:1716999790.592422:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45904 00000100:00100000:2.0:1716999790.594419:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.594477:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480778048 00000100:00100000:0.0:1716999790.594483:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480778048 00000100:00100000:0.0:1716999790.594514:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45905 00000100:00100000:0.0:1716999790.594519:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+514:11420:x1800404480778048:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.594550:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999790.594565:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013541a640/0x6d188eabd8d7ac9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6bd:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ee0a expref: 514 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.594580:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb998c0/0x6d188eabd8d7abed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6bd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4edd2 expref: 513 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.594590:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012faceac0/0x6d188eabd8d7006d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6bd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b324 expref: 512 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.594596:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6bd:0x0].0x0 (ffff88009a3b6b00) 00010000:00010000:0.0:1716999790.594603:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.594618:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7e01 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.594627:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7e01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.594633:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7e01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.594641:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7e08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171ec56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.594646:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7e08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.594651:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7e08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.594721:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7e0f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6bd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.594727:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7e0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.594732:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7e0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.595123:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.595129:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7dec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.595133:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7dec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.595137:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.595140:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7dec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.595144:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7dec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.595152:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x8171ec56 (ffff8800a6ad7200) 00010000:00010000:1.0:1716999790.595154:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.595157:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7dec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.595161:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc7dec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999790.596314:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1532, 64 off106304 00000040:00080000:0.0:1716999790.596334:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].4, 184 off8928 00010000:00010000:0.0:1716999790.596392:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7e16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6bd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596400:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596406:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7e16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596410:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7e16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596414:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7e16 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596418:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7e16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596422:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7e16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596429:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.596432:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7e16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596436:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7e16 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596443:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6bd:0x0].0x0 (ffff88008a83f400) 00010000:00010000:0.0:1716999790.596445:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.596448:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7e16 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596452:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7e16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6bd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596474:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7e0f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596479:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7e0f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596483:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7e0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596487:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.596489:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7e0f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596493:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7e0f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596499:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6bd:0x0].0x0 (ffff88008a83f400) 00010000:00010000:0.0:1716999790.596501:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.596503:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7e0f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596507:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7e0f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6bd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596551:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7e01 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.596555:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999790.596556:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7e01 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596560:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7e01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596563:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.596565:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7e01 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596570:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7e01 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596576:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x0 (ffff880099d1be00) 00010000:00010000:0.0:1716999790.596577:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.596580:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7e01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.596584:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7e01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999790.596590:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135028700 reply state ffff880093230000 transno 4294986534 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7e08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.596595:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.596622:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480778176 00000100:00100000:1.0:1716999790.596628:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480778176 00000100:00100000:0.0:1716999790.596653:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+513:11420:x1800404480778048:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2133us (2238us total) trans 4294986534 rc 0/0 00000100:00100000:1.0:1716999790.596657:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9362 00000100:00100000:0.0:1716999790.596660:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45905 00000100:00100000:1.0:1716999790.596661:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+513:11419:x1800404480778176:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.596761:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+513:11419:x1800404480778176:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 98us (207us total) trans 4294986535 rc 0/0 00000100:00100000:1.0:1716999790.596766:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9362 00010000:00010000:0.0:1716999790.599188:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7e08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.599198:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7e08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.599204:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7e08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.599208:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.599211:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7e08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.599217:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7e08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.599228:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x8171ec56 (ffff88008a83f100) 00010000:00010000:0.0:1716999790.599230:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.599233:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7e08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.599237:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7e08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171ec56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.600323:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.600357:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.600462:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480778304 00000100:00100000:0.0:1716999790.600470:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480778304 00000100:00100000:0.0:1716999790.600509:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45906 00000100:00100000:0.0:1716999790.600516:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+512:11419:x1800404480778304:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.600555:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:3.0:1716999790.600567:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480778432 00000100:00100000:3.0:1716999790.600570:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480778432 00010000:00010000:0.0:1716999790.600571:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb9b600/0x6d188eabd8d7a812 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ba:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ecb3 expref: 512 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.600584:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215cfc0/0x6d188eabd8d7a77f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ba:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ec89 expref: 512 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.600594:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012facd440/0x6d188eabd8d6ff86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ba:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2bb expref: 511 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999790.600599:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9363 00010000:00010000:0.0:1716999790.600601:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ba:0x0].0x0 (ffff88009ab4a100) 00000100:00100000:3.0:1716999790.600603:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+510:11420:x1800404480778432:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:0.0:1716999790.600606:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.600625:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7e1d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.600634:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7e1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.600640:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7e1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.600648:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7e24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171eb56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.600652:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7e24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.600656:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7e24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.600727:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7e2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6ba:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.600733:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7e2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.600734:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+511:11420:x1800404480778432:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 130us (376us total) trans 4294986536 rc 0/0 00000100:00100000:3.0:1716999790.600740:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9363 00010000:00010000:0.0:1716999790.600741:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7e2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999790.601148:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1533, 64 off106368 00000040:00080000:0.0:1716999790.601166:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].5, 184 off9112 00010000:00010000:0.0:1716999790.601213:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7e32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ba:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601221:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601226:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601231:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7e32 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601235:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7e32 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601240:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7e32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601244:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7e32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601248:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.601250:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7e32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601254:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7e32 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601259:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ba:0x0].0x0 (ffff88008a83ff00) 00010000:00010000:0.0:1716999790.601262:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.601264:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7e32 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601268:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7e32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ba:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601286:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7e2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601290:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7e2b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601294:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7e2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601297:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.601299:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7e2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601304:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7e2b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601309:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ba:0x0].0x0 (ffff88008a83ff00) 00010000:00010000:0.0:1716999790.601311:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.601313:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7e2b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601318:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7e2b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6ba:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601350:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7e1d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601354:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7e1d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601359:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7e1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601362:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.601364:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7e1d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601368:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7e1d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601372:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x0 (ffff880099d1bf00) 00010000:00010000:0.0:1716999790.601374:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.601376:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7e1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.601379:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7e1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999790.601384:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880135029880 reply state ffff88008f5ec000 transno 4294986537 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7e24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.601388:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.601427:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+512:11419:x1800404480778304:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 910us (1106us total) trans 4294986537 rc 0/0 00000100:00100000:0.0:1716999790.601432:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45906 00000100:00100000:2.0:1716999790.602955:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.603035:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480778560 00000100:00100000:0.0:1716999790.603041:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480778560 00000100:00100000:0.0:1716999790.603076:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45907 00000100:00100000:0.0:1716999790.603082:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+512:11420:x1800404480778560:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:0.0:1716999790.603115:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1716999790.603129:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216f600/0x6d188eabd8d7a9bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6bb:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ed23 expref: 512 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.603142:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf50b40/0x6d188eabd8d7a8b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6bb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ecd6 expref: 511 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.603151:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012faccb40/0x6d188eabd8d6ffbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6bb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2d7 expref: 510 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.603157:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6bb:0x0].0x0 (ffff88009ab4ae00) 00010000:00010000:0.0:1716999790.603163:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.603179:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7e39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.603185:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7e39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.603191:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7e39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.603199:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7e40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171eb56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.603203:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7e40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.603208:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7e40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.603272:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7e47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6bb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.603277:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7e47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.603282:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7e47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:0.0:1716999790.604805:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1533, 64 off106368 00000040:00080000:0.0:1716999790.604826:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].6, 184 off9296 00010000:00010000:1.0:1716999790.604836:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7e24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.604843:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7e24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.604848:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7e24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.604853:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.604856:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7e24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.604861:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7e24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.604870:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x8171eb56 (ffff88008a83fa00) 00010000:00010000:1.0:1716999790.604873:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.604875:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7e24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.604899:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7e24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b4:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604906:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7e4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6bb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604913:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6bb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604919:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6bb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604924:0:7785:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7e4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6bb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604928:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7e4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6bb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604932:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7e4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6bb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604936:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7e4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6bb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604939:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132f40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.604942:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7e4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6bb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604946:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7e4e lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6bb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604951:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6bb:0x0].0x0 (ffff88008a83f600) 00010000:00010000:0.0:1716999790.604954:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.604956:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7e4e lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6bb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604960:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7e4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6bb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604979:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7e47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604984:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7e47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604988:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7e47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.604992:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.604998:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7e47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.605002:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7e47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.605008:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6bb:0x0].0x0 (ffff88008a83f600) 00010000:00010000:0.0:1716999790.605010:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.605012:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7e47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.605017:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7e47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6bb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.605140:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7e39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.605145:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7e39 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.605150:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7e39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.605154:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.605155:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7e39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.605160:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7e39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.605165:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x0 (ffff880099d1be00) 00010000:00010000:0.0:1716999790.605167:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.605169:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7e39 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.605172:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7e39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:0.0:1716999790.605178:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88013502a680 reply state ffff88008f5eb000 transno 4294986538 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7e40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.605183:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.605236:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+511:11420:x1800404480778560:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 2152us (2281us total) trans 4294986538 rc 0/0 00000100:00100000:0.0:1716999790.605243:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45907 00000100:00100000:2.0:1716999790.608536:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.608644:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480778688 00000100:00100000:1.0:1716999790.608650:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480778688 00000100:00100000:1.0:1716999790.608692:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45908 00000100:00100000:1.0:1716999790.608698:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+510:11419:x1800404480778688:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.608737:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.608755:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695dd40/0x6d188eabd8d7a27e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ead7 expref: 510 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.608769:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb99440/0x6d188eabd8d7a262 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ead0 expref: 509 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.608778:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8c900/0x6d188eabd8d6fc8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b1b1 expref: 508 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.608785:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff880092a37600) 00010000:00010000:1.0:1716999790.608805:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fb840/0x6d188eabd8d6ff01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b283 expref: 507 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.608811:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1ba00) 00010000:00010000:1.0:1716999790.608815:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.608838:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7e55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.608846:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7e55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.608853:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7e55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.608861:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7e5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.608866:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.608871:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.608935:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7e40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.608942:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7e40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.608946:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7e40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.608950:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.608953:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7e40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.608958:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7e40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.608965:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x8171eb56 (ffff88008a83f700) 00010000:00010000:0.0:1716999790.608967:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.608970:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7e40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.608973:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7e40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b5:0x0].0x8171eb56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609052:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7e63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609059:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7e63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609064:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7e63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609178:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7e63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609184:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7e63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609188:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7e63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609192:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.609194:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7e63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609198:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7e63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609203:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a6ad7600) 00010000:00010000:1.0:1716999790.609204:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.609206:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7e63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609210:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc7e63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609219:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7e55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609224:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7e55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609227:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7e55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609231:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.609233:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7e55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609237:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7e55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609242:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff8800a6ad7500) 00010000:00010000:1.0:1716999790.609244:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.609245:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7e55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609250:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc7e55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609257:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609261:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7e5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609265:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7e5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609269:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.609271:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7e5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609275:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7e5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609280:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x65dce0d1 (ffff8800a6ad7a00) 00010000:00010000:1.0:1716999790.609282:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.609284:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7e5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.609288:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc7e5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.609337:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+505:11419:x1800404480778688:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 638us (806us total) trans 0 rc -39/-39 00000100:00100000:1.0:1716999790.609343:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45908 00000100:00100000:3.0:1716999790.611523:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.612201:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480778752 00000100:00100000:1.0:1716999790.612208:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480778752 00000100:00100000:2.0:1716999790.612300:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.612388:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45909 00000100:00100000:1.0:1716999790.612394:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+505:11420:x1800404480778752:12345-192.168.203.3@tcp:101:dbench.0 00010000:00010000:1.0:1716999790.612409:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.612423:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7e6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66245 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.612463:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7e71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612472:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7e71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612478:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7e71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612485:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7e78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612489:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612493:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612566:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc7e7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612570:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc7e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612574:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc7e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:1.0:1716999790.612600:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6b3:0x0]: returning size 11776 00000004:00200000:1.0:1716999790.612603:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999790.612614:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc7e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612620:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7e71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612625:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7e71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612630:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7e71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612635:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.612638:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7e71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612645:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7e71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612653:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff8800a6ad7f00) 00010000:00010000:1.0:1716999790.612655:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.612658:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7e71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612662:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc7e71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612670:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612674:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7e78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612679:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612682:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.612684:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612688:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7e78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612693:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x65dce0d1 (ffff8800a6ad7e00) 00010000:00010000:1.0:1716999790.612695:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.612696:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7e78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612700:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7e78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.612720:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7e6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66245 expref: 507 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.612729:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc7e7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66245 expref: 506 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.612735:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a6ad7200) 00010000:00010000:1.0:1716999790.612737:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999790.612738:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b2d00, rc 0) 00000100:00100000:1.0:1716999790.612771:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+506:11420:x1800404480778752:12345-192.168.203.3@tcp:101:dbench.0 Request processed in 378us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.613042:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480778880 00000100:00100000:0.0:1716999790.613047:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480778880 00000100:00100000:0.0:1716999790.613076:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9364 00000100:00100000:0.0:1716999790.613080:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+507:11419:x1800404480778880:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.614398:0:14949:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x71e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1716999790.614423:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45909 00000040:00080000:0.0:1716999790.614444:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1534, 64 off106432 00000040:00080000:0.0:1716999790.614460:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].7, 168 off9464 00010000:00010000:0.0:1716999790.614515:0:14949:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7e86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x71e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.614524:0:14949:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7e86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.614531:0:14949:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7e86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.614540:0:14949:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7e86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.614544:0:14949:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7e86 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.614547:0:14949:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7e86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x71e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.614550:0:14949:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7e86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x71e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.614552:0:14949:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1306c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.614554:0:14949:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7e86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x71e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.614557:0:14949:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7e86 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x71e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.614562:0:14949:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71e:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.614564:0:14949:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.614565:0:14949:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7e86 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x71e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.614568:0:14949:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7e86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x71e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00000100:00100000:0.0:1716999790.614641:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+507:11419:x1800404480778880:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1560us (2341us total) trans 4294986539 rc 0/0 00000100:00100000:0.0:1716999790.614646:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9364 00000100:00100000:2.0:1716999790.617325:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.617402:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480779008 00000100:00100000:1.0:1716999790.617409:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480779008 00000100:00100000:1.0:1716999790.617445:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45910 00000100:00100000:1.0:1716999790.617451:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+507:11420:x1800404480779008:12345-192.168.203.3@tcp:36:dbench.0 00010000:00010000:1.0:1716999790.617488:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999790.617505:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc7e7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66245 expref: 507 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.617518:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a6ad7200) 00010000:00010000:1.0:1716999790.617526:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.617546:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7e8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617554:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7e8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617564:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7e8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617571:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7e94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617575:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617579:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617650:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7e9b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617654:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617658:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617707:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7e9b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617712:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7e9b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617716:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7e9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617720:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b18c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.617723:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7e9b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617731:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7e9b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617736:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a6ad7c00) 00010000:00010000:1.0:1716999790.617738:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.617741:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7e9b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617745:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7e9b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617755:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7e8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617759:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7e8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617763:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7e8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617767:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.617769:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7e8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617773:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7e8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617779:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff8800a6ad7700) 00010000:00010000:1.0:1716999790.617780:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.617782:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7e8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617785:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7e8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617793:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7e94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617806:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7e94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617809:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7e94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617812:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.617814:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7e94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617818:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7e94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617824:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x65dce0d1 (ffff8800a6ad7000) 00010000:00010000:1.0:1716999790.617826:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.617827:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7e94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.617832:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7e94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.617913:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+506:11420:x1800404480779008:12345-192.168.203.3@tcp:36:dbench.0 Request processed in 461us (593us total) trans 0 rc -39/-39 00000100:00100000:1.0:1716999790.617919:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45910 00000100:00100000:3.0:1716999790.619104:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.619370:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480779136 00000100:00100000:0.0:1716999790.619375:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480779136 00000100:00100000:0.0:1716999790.619410:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9365 00000100:00100000:0.0:1716999790.619415:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+506:11419:x1800404480779136:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.619787:0:14949:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x720:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.619848:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1535, 64 off106496 00000040:00080000:0.0:1716999790.619866:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].8, 168 off9632 00010000:00010000:0.0:1716999790.620183:0:14949:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc7ea2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x720:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.620198:0:14949:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc7ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x720:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.620206:0:14949:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc7ea2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x720:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.620212:0:14949:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc7ea2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x720:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.620217:0:14949:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc7ea2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x720:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.620221:0:14949:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc7ea2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x720:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.620226:0:14949:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc7ea2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x720:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.620231:0:14949:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132400 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.620234:0:14949:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc7ea2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x720:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.620238:0:14949:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc7ea2 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x720:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.620246:0:14949:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x720:0x0].0x0 (ffff88008a83f500) 00010000:00010000:0.0:1716999790.620249:0:14949:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.620252:0:14949:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc7ea2 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x720:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.620256:0:14949:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc7ea2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x720:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00000100:00100000:0.0:1716999790.620395:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+507:11419:x1800404480779136:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 978us (1291us total) trans 4294986540 rc 0/0 00000100:00100000:0.0:1716999790.620402:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9365 00000100:00100000:2.0:1716999790.621968:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.621986:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480779264 00000100:00100000:0.0:1716999790.621993:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480779264 00000100:00100000:2.0:1716999790.621994:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.622009:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480779392 00000100:00100000:2.0:1716999790.622011:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480779392 00000100:00100000:0.0:1716999790.622024:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9366 00000100:00100000:0.0:1716999790.622030:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+508:11420:x1800404480779264:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.622475:0:14949:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x71f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.622520:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1534, 64 off106432 00000040:00080000:0.0:1716999790.622534:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].9, 168 off9800 00000100:00100000:2.0:1716999790.622535:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9367 00000100:00100000:2.0:1716999790.622541:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+508:11419:x1800404480779392:12345-192.168.203.3@tcp:35:dbench.0 00010000:00010000:0.0:1716999790.622583:0:14949:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7ea9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x71f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.622593:0:14949:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.622600:0:14949:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7ea9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.622606:0:14949:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7ea9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.622611:0:14949:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7ea9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.622618:0:14949:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7ea9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x71f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.622623:0:14949:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7ea9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x71f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.622627:0:14949:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1306c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.622630:0:14949:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7ea9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x71f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.622635:0:14949:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7ea9 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x71f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.622642:0:14949:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71f:0x0].0x0 (ffff88008a83f400) 00010000:00010000:0.0:1716999790.622645:0:14949:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.622648:0:14949:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7ea9 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x71f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.622652:0:14949:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc7ea9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x71f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00000100:00100000:0.0:1716999790.622734:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+509:11420:x1800404480779264:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 703us (769us total) trans 4294986541 rc 0/0 00000100:00100000:0.0:1716999790.622741:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9366 00000004:00080000:2.0:1716999790.622755:0:16640:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x722:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:3.0:1716999790.624486:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.624546:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480779520 00000100:00100000:0.0:1716999790.624553:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480779520 00000100:00100000:0.0:1716999790.624574:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9368 00000100:00100000:0.0:1716999790.624579:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+509:11420:x1800404480779520:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.624876:0:14949:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x721:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.624937:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1535, 64 off106496 00000040:00080000:0.0:1716999790.624953:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].10, 168 off9968 00010000:00010000:0.0:1716999790.625003:0:14949:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7eb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x721:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.625013:0:14949:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x721:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.625019:0:14949:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7eb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x721:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.625025:0:14949:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7eb0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x721:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.625029:0:14949:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7eb0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x721:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.625033:0:14949:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7eb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x721:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.625038:0:14949:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7eb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x721:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.625042:0:14949:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133600 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.625044:0:14949:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7eb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x721:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.625050:0:14949:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7eb0 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x721:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.625057:0:14949:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x721:0x0].0x0 (ffff88008a83ff00) 00010000:00010000:0.0:1716999790.625060:0:14949:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.625063:0:14949:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7eb0 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x721:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.625067:0:14949:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc7eb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x721:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00000100:00100000:0.0:1716999790.625144:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec25c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+510:11420:x1800404480779520:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 564us (661us total) trans 4294986542 rc 0/0 00000100:00100000:0.0:1716999790.625151:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9368 00000040:00080000:2.0:1716999790.625710:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1536, 64 off106560 00000040:00080000:2.0:1716999790.625724:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].11, 168 off10136 00010000:00010000:2.0:1716999790.625771:0:16640:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7eb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x722:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16640 initiator: MDT0 00010000:00010000:2.0:1716999790.625778:0:16640:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x722:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 16640 initiator: MDT0 00010000:00010000:2.0:1716999790.625783:0:16640:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7eb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x722:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16640 initiator: MDT0 00010000:00010000:2.0:1716999790.625787:0:16640:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7eb7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x722:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16640 initiator: MDT0 00010000:00010000:2.0:1716999790.625791:0:16640:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7eb7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x722:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16640 initiator: MDT0 00010000:00010000:2.0:1716999790.625808:0:16640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7eb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x722:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16640 initiator: MDT0 00010000:00010000:2.0:1716999790.625813:0:16640:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7eb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x722:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16640 initiator: MDT0 00010000:00010000:2.0:1716999790.625816:0:16640:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.625818:0:16640:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7eb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x722:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16640 initiator: MDT0 00010000:00010000:2.0:1716999790.625822:0:16640:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7eb7 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x722:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16640 initiator: MDT0 00010000:00010000:2.0:1716999790.625829:0:16640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x722:0x0].0x0 (ffff880088977200) 00010000:00010000:2.0:1716999790.625831:0:16640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.625834:0:16640:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7eb7 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x722:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16640 initiator: MDT0 00010000:00010000:2.0:1716999790.625838:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc7eb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x722:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16640 initiator: MDT0 00000100:00100000:2.0:1716999790.625927:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+510:11419:x1800404480779392:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 3384us (3930us total) trans 4294986543 rc 0/0 00000100:00100000:2.0:1716999790.625933:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9367 00000100:00100000:3.0:1716999790.628752:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.629085:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480779648 00000100:00100000:1.0:1716999790.629092:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480779648 00000100:00100000:3.0:1716999790.629115:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.629578:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480779776 00000100:00100000:1.0:1716999790.629582:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480779776 00000100:00100000:0.0:1716999790.629585:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9369 00000100:00100000:0.0:1716999790.629592:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+511:11419:x1800404480779648:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.629598:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9370 00000100:00100000:1.0:1716999790.629601:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+511:11420:x1800404480779776:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.630037:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x724:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.630083:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1537, 64 off106624 00000040:00080000:0.0:1716999790.630099:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].12, 168 off10304 00010000:00010000:0.0:1716999790.630152:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7ebe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x724:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.630162:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x724:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.630170:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x724:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.630176:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7ebe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x724:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.630181:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7ebe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x724:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.630185:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x724:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.630190:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7ebe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x724:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.630194:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1318c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.630197:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7ebe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x724:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.630203:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7ebe lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x724:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.630211:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x724:0x0].0x0 (ffff88008a83f100) 00010000:00010000:0.0:1716999790.630214:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.630216:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7ebe lrc: 3/0,0 mode: --/PW res: [0x200000401:0x724:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.630220:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc7ebe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x724:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:0.0:1716999790.630316:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+512:11419:x1800404480779648:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 723us (1569us total) trans 4294986544 rc 0/0 00000100:00100000:0.0:1716999790.630323:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9369 00000004:00080000:1.0:1716999790.630616:0:6824:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x723:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1716999790.630685:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1536, 64 off106560 00000040:00080000:1.0:1716999790.630698:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].13, 168 off10472 00010000:00010000:1.0:1716999790.630743:0:6824:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7ec5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x723:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.630751:0:6824:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x723:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.630757:0:6824:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7ec5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x723:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.630761:0:6824:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7ec5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x723:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.630765:0:6824:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7ec5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x723:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.630768:0:6824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7ec5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x723:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.630772:0:6824:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7ec5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x723:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.630776:0:6824:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2400 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.630777:0:6824:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7ec5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x723:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.630782:0:6824:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7ec5 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x723:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.630787:0:6824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x723:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.630790:0:6824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.630792:0:6824:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7ec5 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x723:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.630806:0:6824:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7ec5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x723:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00000100:00100000:1.0:1716999790.630898:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+512:11420:x1800404480779776:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1276us (1763us total) trans 4294986545 rc 0/0 00000100:00100000:1.0:1716999790.630903:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9370 00000100:00100000:3.0:1716999790.632935:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.633278:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480779904 00000100:00100000:1.0:1716999790.633308:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480779904 00000100:00100000:1.0:1716999790.633343:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9371 00000100:00100000:1.0:1716999790.633348:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+512:11419:x1800404480779904:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.633464:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.633522:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480780032 00000100:00100000:0.0:1716999790.633526:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480780032 00000100:00100000:0.0:1716999790.633718:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9372 00000100:00100000:0.0:1716999790.633723:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+513:11420:x1800404480780032:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:1.0:1716999790.633745:0:6824:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x726:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1716999790.633788:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1538, 64 off106688 00000040:00080000:1.0:1716999790.633817:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].14, 168 off10640 00010000:00010000:1.0:1716999790.633871:0:6824:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7ecc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x726:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.633897:0:6824:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7ecc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x726:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.633905:0:6824:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7ecc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x726:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.633912:0:6824:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7ecc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x726:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.633917:0:6824:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7ecc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x726:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.633921:0:6824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7ecc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x726:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.633927:0:6824:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7ecc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x726:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.633931:0:6824:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.633934:0:6824:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7ecc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x726:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.633939:0:6824:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7ecc lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x726:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.633959:0:6824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x726:0x0].0x0 (ffff880099d1b300) 00010000:00010000:1.0:1716999790.633962:0:6824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.633964:0:6824:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7ecc lrc: 3/0,0 mode: --/PW res: [0x200000401:0x726:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.633969:0:6824:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7ecc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x726:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00000004:00080000:0.0:1716999790.633970:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x725:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.634003:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1537, 64 off106624 00000040:00080000:0.0:1716999790.634012:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].15, 168 off10808 00010000:00010000:0.0:1716999790.634047:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7ed3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x725:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00000100:00100000:1.0:1716999790.634051:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+515:11419:x1800404480779904:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 702us (1121us total) trans 4294986546 rc 0/0 00010000:00010000:0.0:1716999790.634054:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x725:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00000100:00100000:1.0:1716999790.634057:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9371 00010000:00010000:0.0:1716999790.634059:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7ed3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x725:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.634067:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7ed3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x725:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.634071:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7ed3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x725:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.634075:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7ed3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x725:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.634079:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7ed3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x725:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.634446:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132d00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.634451:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7ed3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x725:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.634456:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7ed3 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x725:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.634463:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x725:0x0].0x0 (ffff88008a83fa00) 00010000:00010000:0.0:1716999790.634465:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.634467:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7ed3 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x725:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.634470:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc7ed3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x725:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:0.0:1716999790.634529:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+514:11420:x1800404480780032:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 805us (1064us total) trans 4294986547 rc 0/0 00000100:00100000:0.0:1716999790.634535:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9372 00000100:00100000:3.0:1716999790.635875:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.635993:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480780160 00000100:00100000:0.0:1716999790.635999:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480780160 00000100:00100000:0.0:1716999790.636032:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9373 00000100:00100000:0.0:1716999790.636038:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+514:11419:x1800404480780160:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.636135:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000004:00080000:0.0:1716999790.636339:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x70e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.636384:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1538, 64 off106688 00000040:00080000:0.0:1716999790.636399:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].16, 168 off10976 00010000:00010000:0.0:1716999790.636450:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7eda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x70e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.636460:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.636467:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7eda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.636473:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7eda lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.636477:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7eda lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.636482:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7eda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x70e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.636487:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7eda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.636491:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133a80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.636493:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7eda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.636498:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7eda lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x70e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.636506:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70e:0x0].0x0 (ffff88008a83f700) 00010000:00010000:0.0:1716999790.636508:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.636511:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7eda lrc: 3/0,0 mode: --/PW res: [0x200000401:0x70e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.636515:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc7eda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x70e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:0.0:1716999790.636585:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+515:11419:x1800404480780160:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 546us (711us total) trans 4294986548 rc 0/0 00000100:00100000:0.0:1716999790.636591:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9373 00000100:00100000:0.0:1716999790.636602:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480780288 00000100:00100000:0.0:1716999790.636604:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480780288 00000100:00100000:0.0:1716999790.636632:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9374 00000100:00100000:0.0:1716999790.636636:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+515:11420:x1800404480780288:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.636933:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x727:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.636967:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1539, 64 off106752 00000040:00080000:0.0:1716999790.636978:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].17, 168 off11144 00010000:00010000:0.0:1716999790.637015:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7ee1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x727:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.637023:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x727:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.637028:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7ee1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x727:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.637033:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7ee1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x727:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.637037:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7ee1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x727:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.637041:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7ee1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x727:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.637046:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7ee1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x727:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.637050:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132f40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.637052:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7ee1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x727:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.637056:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7ee1 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x727:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.637062:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x727:0x0].0x0 (ffff88008a83f600) 00010000:00010000:0.0:1716999790.637064:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.637067:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7ee1 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x727:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.637071:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc7ee1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x727:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:0.0:1716999790.637136:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec25850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+516:11420:x1800404480780288:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 497us (999us total) trans 4294986549 rc 0/0 00000100:00100000:0.0:1716999790.637141:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9374 00000100:00100000:3.0:1716999790.638627:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.639944:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480780416 00000100:00100000:0.0:1716999790.639951:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480780416 00000100:00100000:0.0:1716999790.639988:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9375 00000100:00100000:0.0:1716999790.639995:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+516:11419:x1800404480780416:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.640316:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x710:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.640358:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1539, 64 off106752 00000040:00080000:0.0:1716999790.640372:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].18, 168 off11312 00010000:00010000:0.0:1716999790.640424:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7ee8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x710:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.640434:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x710:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.640442:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x710:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.640448:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7ee8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x710:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.640453:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7ee8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x710:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.640457:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x710:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.640462:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7ee8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x710:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.640467:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130b40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.640470:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7ee8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x710:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.640475:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7ee8 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x710:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.640483:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x710:0x0].0x0 (ffff88008a83f400) 00010000:00010000:0.0:1716999790.640485:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.640487:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7ee8 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x710:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.640492:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc7ee8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x710:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:0.0:1716999790.640581:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+517:11419:x1800404480780416:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 585us (1955us total) trans 4294986550 rc 0/0 00000100:00100000:0.0:1716999790.640588:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9375 00000100:00100000:3.0:1716999790.640715:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.640962:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480780544 00000100:00100000:1.0:1716999790.640966:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480780544 00000100:00100000:1.0:1716999790.640998:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9376 00000100:00100000:1.0:1716999790.641003:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+517:11420:x1800404480780544:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:1.0:1716999790.641248:0:6824:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x70f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1716999790.641282:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1540, 64 off106816 00000040:00080000:1.0:1716999790.641293:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].19, 168 off11480 00010000:00010000:1.0:1716999790.641336:0:6824:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7eef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x70f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.641343:0:6824:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7eef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.641349:0:6824:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7eef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.641354:0:6824:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7eef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.641358:0:6824:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7eef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.641361:0:6824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7eef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x70f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.641365:0:6824:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7eef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.641368:0:6824:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.641370:0:6824:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7eef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.641374:0:6824:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7eef lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x70f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.641381:0:6824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70f:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.641383:0:6824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.641385:0:6824:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7eef lrc: 3/0,0 mode: --/PW res: [0x200000401:0x70f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.641390:0:6824:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7eef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x70f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00000100:00100000:1.0:1716999790.641454:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+518:11420:x1800404480780544:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 449us (738us total) trans 4294986551 rc 0/0 00000100:00100000:1.0:1716999790.641461:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9376 00000100:00100000:3.0:1716999790.643569:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.643630:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480780672 00000100:00100000:0.0:1716999790.643636:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480780672 00000100:00100000:0.0:1716999790.643670:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9377 00000100:00100000:0.0:1716999790.643676:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+518:11419:x1800404480780672:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.644739:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x713:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.644782:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1540, 64 off106816 00000040:00080000:0.0:1716999790.644806:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].20, 168 off11648 00010000:00010000:0.0:1716999790.644858:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7ef6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x713:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.644867:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x713:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.644875:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7ef6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x713:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.644907:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7ef6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x713:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00000100:00100000:3.0:1716999790.645131:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.645168:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480780800 00000100:00100000:1.0:1716999790.645173:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480780800 00000100:00100000:1.0:1716999790.645202:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9378 00000100:00100000:1.0:1716999790.645208:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+520:11420:x1800404480780800:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:1.0:1716999790.645459:0:6824:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x711:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1716999790.645489:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1541, 64 off106880 00000040:00080000:1.0:1716999790.645501:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].21, 168 off11816 00010000:00010000:0.0:1716999790.645507:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7ef6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x713:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.645512:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7ef6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x713:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.645517:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7ef6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x713:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.645521:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.645524:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7ef6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x713:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.645530:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7ef6 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x713:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.645538:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x713:0x0].0x0 (ffff88008a83f200) 00010000:00010000:1.0:1716999790.645539:0:6824:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7efd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x711:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.645541:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.645543:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7ef6 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x713:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.645545:0:6824:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x711:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.645548:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc7ef6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x713:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.645550:0:6824:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7efd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x711:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.645554:0:6824:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7efd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x711:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.645558:0:6824:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7efd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x711:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.645561:0:6824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7efd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x711:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.645565:0:6824:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7efd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x711:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.645568:0:6824:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b33c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.645570:0:6824:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7efd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x711:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.645575:0:6824:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7efd lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x711:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.645580:0:6824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x711:0x0].0x0 (ffff880099d1b000) 00010000:00010000:1.0:1716999790.645582:0:6824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.645583:0:6824:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7efd lrc: 3/0,0 mode: --/PW res: [0x200000401:0x711:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.645587:0:6824:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7efd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x711:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00000100:00100000:0.0:1716999790.646378:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+521:11419:x1800404480780672:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2700us (2813us total) trans 4294986552 rc 0/0 00000100:00100000:0.0:1716999790.646385:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9377 00000100:00100000:1.0:1716999790.646427:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+520:11420:x1800404480780800:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1219us (1296us total) trans 4294986553 rc 0/0 00000100:00100000:1.0:1716999790.646433:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9378 00000100:00100000:3.0:1716999790.648664:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.648750:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480780928 00000100:00100000:1.0:1716999790.648756:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480780928 00000100:00100000:1.0:1716999790.649064:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9379 00000100:00100000:1.0:1716999790.649071:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+520:11419:x1800404480780928:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:1.0:1716999790.649400:0:6824:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x714:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1716999790.649442:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1541, 64 off106880 00000040:00080000:1.0:1716999790.649457:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].22, 168 off11984 00010000:00010000:1.0:1716999790.649510:0:6824:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x714:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.649520:0:6824:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x714:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.649528:0:6824:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x714:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.649538:0:6824:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f04 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x714:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.649543:0:6824:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f04 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x714:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.649547:0:6824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x714:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.649553:0:6824:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x714:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.649558:0:6824:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3600 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.649560:0:6824:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x714:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.649566:0:6824:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f04 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x714:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.649573:0:6824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x714:0x0].0x0 (ffff880099d1ba00) 00010000:00010000:1.0:1716999790.649576:0:6824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.649578:0:6824:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f04 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x714:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.649583:0:6824:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x714:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00000100:00100000:1.0:1716999790.651270:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+521:11419:x1800404480780928:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2193us (2605us total) trans 4294986554 rc 0/0 00000100:00100000:1.0:1716999790.651278:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9379 00000100:00100000:3.0:1716999790.651947:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.652104:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480781056 00000100:00100000:0.0:1716999790.652110:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480781056 00000100:00100000:0.0:1716999790.652145:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9380 00000100:00100000:0.0:1716999790.652151:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec25450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+521:11420:x1800404480781056:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.652492:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x712:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.652535:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1542, 64 off106944 00000040:00080000:0.0:1716999790.652550:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].23, 168 off12152 00010000:00010000:0.0:1716999790.652603:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7f0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x712:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.652613:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.652622:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7f0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.652631:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7f0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.652635:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7f0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.652639:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7f0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.652644:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7f0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.652649:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.652651:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7f0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.652656:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7f0b lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.652664:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x712:0x0].0x0 (ffff88008a83ff00) 00010000:00010000:0.0:1716999790.652666:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.652669:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7f0b lrc: 3/0,0 mode: --/PW res: [0x200000401:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.652674:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc7f0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x712:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:0.0:1716999790.652750:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec25450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11420:x1800404480781056:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 598us (804us total) trans 4294986555 rc 0/0 00000100:00100000:0.0:1716999790.652756:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9380 00000100:00100000:3.0:1716999790.658064:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.658116:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.658165:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480781184 00000100:00100000:1.0:1716999790.658172:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480781184 00000100:00100000:1.0:1716999790.658195:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480781312 00000100:00100000:1.0:1716999790.658196:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480781312 00000100:00100000:1.0:1716999790.658206:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9381 00000100:00100000:1.0:1716999790.658212:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+523:11419:x1800404480781184:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:1.0:1716999790.658531:0:6824:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x716:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1716999790.658576:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1543, 64 off107008 00000040:00080000:1.0:1716999790.658592:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].24, 168 off12320 00010000:00010000:1.0:1716999790.658650:0:6824:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x716:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.658661:0:6824:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x716:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.658669:0:6824:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x716:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.658675:0:6824:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x716:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.658680:0:6824:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f12 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x716:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.658684:0:6824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x716:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.658689:0:6824:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x716:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.658694:0:6824:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.658697:0:6824:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f12 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x716:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.658702:0:6824:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f12 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x716:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.658710:0:6824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x716:0x0].0x0 (ffff880099d1bb00) 00010000:00010000:1.0:1716999790.658712:0:6824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.658715:0:6824:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f12 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x716:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.658720:0:6824:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x716:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00000100:00100000:0.0:1716999790.658866:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9382 00000100:00100000:0.0:1716999790.658872:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+524:11420:x1800404480781312:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.659352:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x715:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.659387:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1542, 64 off106944 00000040:00080000:0.0:1716999790.659398:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].25, 168 off12488 00010000:00010000:0.0:1716999790.659439:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7f19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x715:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.659446:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7f19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x715:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.659452:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7f19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x715:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.659457:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7f19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x715:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.659462:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7f19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x715:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.659466:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7f19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x715:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.659471:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7f19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x715:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.659475:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132ac0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.659477:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7f19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x715:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.659481:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7f19 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x715:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.659487:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x715:0x0].0x0 (ffff88008a83fb00) 00010000:00010000:0.0:1716999790.659489:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.659492:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7f19 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x715:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.659496:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc7f19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x715:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:1.0:1716999790.660322:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+525:11419:x1800404480781184:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2108us (2260us total) trans 4294986556 rc 0/0 00000100:00100000:1.0:1716999790.660330:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9381 00000100:00100000:0.0:1716999790.660415:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+524:11420:x1800404480781312:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1542us (2298us total) trans 4294986557 rc 0/0 00000100:00100000:0.0:1716999790.660421:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9382 00000100:00100000:3.0:1716999790.664312:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.664355:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.664417:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480781440 00000100:00100000:0.0:1716999790.664424:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480781440 00000100:00100000:0.0:1716999790.664450:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480781568 00000100:00100000:0.0:1716999790.664452:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480781568 00000100:00100000:0.0:1716999790.664463:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9383 00000100:00100000:0.0:1716999790.664469:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+525:11420:x1800404480781440:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:2.0:1716999790.664600:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9384 00000100:00100000:2.0:1716999790.664606:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+525:11419:x1800404480781568:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.665008:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x717:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.665055:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1543, 64 off107008 00000040:00080000:0.0:1716999790.665072:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].26, 168 off12656 00010000:00010000:0.0:1716999790.665132:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7f20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x717:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.665144:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.665152:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.665158:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7f20 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.665163:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7f20 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.665170:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.665175:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7f20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.665179:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130900 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.665182:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7f20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.665188:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7f20 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.665196:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x717:0x0].0x0 (ffff88008a83ff00) 00010000:00010000:0.0:1716999790.665198:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.665201:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7f20 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.665206:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc7f20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x717:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000004:00080000:2.0:1716999790.665239:0:6824:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x718:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1716999790.665271:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1544, 64 off107072 00000040:00080000:2.0:1716999790.665281:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].27, 168 off12824 00010000:00010000:2.0:1716999790.665320:0:6824:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7f27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x718:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.665327:0:6824:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7f27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.665332:0:6824:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7f27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.665336:0:6824:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7f27 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.665340:0:6824:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7f27 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.665347:0:6824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7f27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.665351:0:6824:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7f27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.665355:0:6824:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918306c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.665356:0:6824:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7f27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.665360:0:6824:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7f27 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.665365:0:6824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x718:0x0].0x0 (ffff880088977400) 00010000:00010000:2.0:1716999790.665367:0:6824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.665368:0:6824:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7f27 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.665372:0:6824:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc7f27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x718:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00000100:00100000:0.0:1716999790.665818:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+527:11420:x1800404480781440:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1347us (1510us total) trans 4294986558 rc 0/0 00000100:00100000:0.0:1716999790.665825:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9383 00000100:00100000:2.0:1716999790.666148:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+526:11419:x1800404480781568:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1541us (1791us total) trans 4294986559 rc 0/0 00000100:00100000:2.0:1716999790.666159:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9384 00000100:00100000:3.0:1716999790.668048:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.668127:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.668215:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480781696 00000100:00100000:2.0:1716999790.668221:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480781696 00000100:00100000:0.0:1716999790.668366:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480781824 00000100:00100000:2.0:1716999790.668370:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9385 00000100:00100000:0.0:1716999790.668370:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480781824 00000100:00100000:2.0:1716999790.668375:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+527:11420:x1800404480781696:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.668384:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9386 00000100:00100000:0.0:1716999790.668387:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec25050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+527:11419:x1800404480781824:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:2.0:1716999790.668719:0:14949:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x719:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000004:00080000:0.0:1716999790.668734:0:6824:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x71c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1716999790.668766:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1544, 64 off107072 00000040:00080000:0.0:1716999790.668772:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1545, 64 off107136 00000040:00080000:2.0:1716999790.668782:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].28, 168 off12992 00000040:00080000:0.0:1716999790.668788:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].29, 168 off13160 00010000:00010000:2.0:1716999790.668851:0:14949:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7f35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x719:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.668851:0:6824:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7f2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x71c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.668861:0:14949:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x719:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.668861:0:6824:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7f2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.668869:0:14949:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x719:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.668869:0:6824:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7f2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.668875:0:14949:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7f35 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x719:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.668875:0:6824:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7f2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:2.0:1716999790.668898:0:14949:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7f35 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x719:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.668903:0:14949:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7f35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x719:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.668907:0:14949:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7f35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x719:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.668922:0:14949:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830000 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.668924:0:14949:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7f35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x719:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.668929:0:14949:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7f35 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x719:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.668937:0:14949:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x719:0x0].0x0 (ffff880088977600) 00010000:00010000:2.0:1716999790.668939:0:14949:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.668941:0:14949:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7f35 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x719:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.668946:0:14949:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc7f35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x719:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:0.0:1716999790.669423:0:6824:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7f2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.669429:0:6824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7f2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x71c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.669433:0:6824:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7f2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x71c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.669437:0:6824:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.669439:0:6824:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7f2e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x71c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.669443:0:6824:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7f2e lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x71c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.669502:0:6824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71c:0x0].0x0 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.669505:0:6824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.669508:0:6824:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7f2e lrc: 3/0,0 mode: --/PW res: [0x200000401:0x71c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.669512:0:6824:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc7f2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x71c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00000100:00100000:2.0:1716999790.669562:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+529:11420:x1800404480781696:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1184us (1516us total) trans 4294986560 rc 0/0 00000100:00100000:2.0:1716999790.669569:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9385 00000100:00100000:0.0:1716999790.669790:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec25050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+528:11419:x1800404480781824:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1400us (1662us total) trans 4294986561 rc 0/0 00000100:00100000:0.0:1716999790.669804:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9386 00000100:00100000:3.0:1716999790.671932:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.671961:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.672015:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480782016 00000100:00100000:0.0:1716999790.672022:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480782016 00000100:00100000:0.0:1716999790.672051:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480782080 00000100:00100000:0.0:1716999790.672053:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480782080 00000100:00100000:0.0:1716999790.672062:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9387 00000100:00100000:0.0:1716999790.672067:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+529:11420:x1800404480782016:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.672181:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9388 00000100:00100000:1.0:1716999790.672186:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+529:11419:x1800404480782080:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.672560:0:6824:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x71d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000004:00080000:1.0:1716999790.672575:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x71a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.672603:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1545, 64 off107136 00000040:00080000:1.0:1716999790.672604:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1546, 64 off107200 00000040:00080000:1.0:1716999790.672619:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].30, 168 off13328 00000040:00080000:0.0:1716999790.672625:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].31, 168 off13496 00010000:00010000:1.0:1716999790.672677:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x71a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.672677:0:6824:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7f43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x71d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.672687:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.672687:0:6824:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7f43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.672695:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.672695:0:6824:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7f43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.672701:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.672701:0:6824:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7f43 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.672706:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f3c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.672706:0:6824:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7f43 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.672710:0:6824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7f43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x71d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.672714:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x71a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.672715:0:6824:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7f43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x71d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.672718:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x71a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.672720:0:6824:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.672721:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.672723:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x71a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.672723:0:6824:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7f43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x71d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.672728:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f3c lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x71a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.672728:0:6824:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7f43 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x71d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.672735:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71a:0x0].0x0 (ffff880099d1bb00) 00010000:00010000:0.0:1716999790.672735:0:6824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71d:0x0].0x0 (ffff88008a83f600) 00010000:00010000:1.0:1716999790.672737:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.672737:0:6824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.672740:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f3c lrc: 3/0,0 mode: --/PW res: [0x200000401:0x71a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.672740:0:6824:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7f43 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x71d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.672744:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc7f3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x71a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.672744:0:6824:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc7f43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x71d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00000100:00100000:0.0:1716999790.673001:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+531:11420:x1800404480782016:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 932us (1072us total) trans 4294986563 rc 0/0 00000100:00100000:0.0:1716999790.673008:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9387 00000100:00100000:1.0:1716999790.673025:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+531:11419:x1800404480782080:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 838us (1063us total) trans 4294986562 rc 0/0 00000100:00100000:1.0:1716999790.673031:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9388 00000100:00100000:3.0:1716999790.674486:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.674970:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480782208 00000100:00100000:0.0:1716999790.674977:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480782208 00000100:00100000:0.0:1716999790.675008:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9389 00000100:00100000:0.0:1716999790.675013:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+530:11419:x1800404480782208:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.677288:0:6824:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0xc52:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.677335:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1546, 64 off107200 00000040:00080000:0.0:1716999790.677353:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].32, 168 off13664 00000100:00100000:3.0:1716999790.677517:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999790.677588:0:6824:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7f4a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.677599:0:6824:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7f4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.677608:0:6824:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7f4a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.677614:0:6824:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7f4a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.677619:0:6824:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7f4a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.677623:0:6824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7f4a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.677628:0:6824:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7f4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.677633:0:6824:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130000 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.677635:0:6824:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7f4a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00000100:00100000:1.0:1716999790.677738:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480782336 00000100:00100000:1.0:1716999790.677745:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480782336 00010000:00010000:0.0:1716999790.677783:0:6824:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7f4a lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.677792:0:6824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc52:0x0].0x0 (ffff88008a83f700) 00010000:00010000:0.0:1716999790.677802:0:6824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.677805:0:6824:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7f4a lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.677810:0:6824:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc7f4a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00000100:00100000:2.0:1716999790.677973:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9390 00000100:00100000:2.0:1716999790.677979:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480782336:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:2.0:1716999790.678449:0:14949:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x71b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1716999790.678479:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1547, 64 off107264 00000040:00080000:2.0:1716999790.678491:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].33, 168 off13832 00010000:00010000:2.0:1716999790.678531:0:14949:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7f51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x71b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.678538:0:14949:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.678543:0:14949:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7f51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x71b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.678548:0:14949:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7f51 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.678552:0:14949:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7f51 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x71b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.678556:0:14949:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7f51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x71b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.678560:0:14949:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7f51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x71b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.678564:0:14949:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831f80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.678566:0:14949:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7f51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x71b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.678571:0:14949:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7f51 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x71b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.678577:0:14949:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x71b:0x0].0x0 (ffff880088977e00) 00010000:00010000:2.0:1716999790.678579:0:14949:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.678581:0:14949:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7f51 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x71b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.678585:0:14949:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc7f51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x71b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00000100:00100000:0.0:1716999790.678690:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480782208:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 3675us (4205us total) trans 4294986564 rc 0/0 00000100:00100000:0.0:1716999790.678697:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9389 00000100:00100000:2.0:1716999790.680232:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11420:x1800404480782336:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2249us (2714us total) trans 4294986565 rc 0/0 00000100:00100000:2.0:1716999790.680239:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9390 00000100:00100000:3.0:1716999790.684136:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.684208:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.684257:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480782464 00000100:00100000:2.0:1716999790.684263:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480782464 00000100:00100000:2.0:1716999790.684296:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480782592 00000100:00100000:2.0:1716999790.684298:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480782592 00000100:00100000:2.0:1716999790.684310:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9391 00000100:00100000:2.0:1716999790.684315:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11419:x1800404480782464:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:1.0:1716999790.684325:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9392 00000100:00100000:1.0:1716999790.684329:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+533:11420:x1800404480782592:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:2.0:1716999790.685337:0:14949:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x707:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1716999790.685385:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1548, 64 off107328 00000040:00080000:2.0:1716999790.685402:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].34, 168 off14000 00010000:00010000:2.0:1716999790.685455:0:14949:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7f58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x707:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.685466:0:14949:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7f58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x707:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.685477:0:14949:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7f58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x707:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.685482:0:14949:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7f58 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x707:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.685487:0:14949:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7f58 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x707:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.685491:0:14949:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7f58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x707:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.685496:0:14949:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7f58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x707:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.685501:0:14949:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.685503:0:14949:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7f58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x707:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.685508:0:14949:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7f58 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x707:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.685516:0:14949:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x707:0x0].0x0 (ffff880088977d00) 00010000:00010000:2.0:1716999790.685519:0:14949:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.685521:0:14949:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7f58 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x707:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.685526:0:14949:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc7f58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x707:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00000004:00080000:1.0:1716999790.685669:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0xc54:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1716999790.685699:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1549, 64 off107392 00000040:00080000:1.0:1716999790.685710:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].35, 168 off14168 00010000:00010000:1.0:1716999790.685754:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.685760:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.685765:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.685769:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f5f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.685773:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f5f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.685777:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.685781:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.685784:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3600 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.685786:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f5f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.685790:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f5f lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.685803:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc54:0x0].0x0 (ffff880099d1b000) 00010000:00010000:1.0:1716999790.685805:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.685807:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f5f lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.685811:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc7f5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc54:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:2.0:1716999790.685984:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480782464:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1564us (1750us total) trans 4294986566 rc 0/0 00000100:00100000:2.0:1716999790.685991:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9391 00000100:00100000:1.0:1716999790.686258:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec24c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+534:11420:x1800404480782592:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1926us (2047us total) trans 4294986567 rc 0/0 00000100:00100000:1.0:1716999790.686264:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9392 00000100:00100000:3.0:1716999790.689557:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.689599:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.689709:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480782720 00000100:00100000:1.0:1716999790.689716:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480782720 00000100:00100000:2.0:1716999790.689754:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480782848 00000100:00100000:2.0:1716999790.689757:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480782848 00000100:00100000:2.0:1716999790.689837:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9393 00000100:00100000:2.0:1716999790.689843:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11420:x1800404480782720:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.689845:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9394 00000100:00100000:3.0:1716999790.689849:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+535:11419:x1800404480782848:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:2.0:1716999790.691612:0:14949:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x706:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1716999790.691659:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1547, 64 off107264 00000040:00080000:2.0:1716999790.691675:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].36, 168 off14336 00010000:00010000:2.0:1716999790.691732:0:14949:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7f66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x706:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.691743:0:14949:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7f66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x706:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.691750:0:14949:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7f66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x706:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.691756:0:14949:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7f66 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x706:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.691761:0:14949:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7f66 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x706:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.691765:0:14949:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7f66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x706:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.691770:0:14949:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7f66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x706:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.691774:0:14949:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918318c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.691777:0:14949:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7f66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x706:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.691783:0:14949:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7f66 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x706:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.691791:0:14949:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x706:0x0].0x0 (ffff880088977f00) 00010000:00010000:2.0:1716999790.691805:0:14949:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.691809:0:14949:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7f66 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x706:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.691813:0:14949:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc7f66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x706:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00000100:00100000:2.0:1716999790.691928:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11420:x1800404480782720:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2082us (2374us total) trans 4294986568 rc 0/0 00000100:00100000:2.0:1716999790.691936:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9393 00000004:00080000:3.0:1716999790.695106:0:16640:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x709:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1716999790.695163:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1550, 64 off107456 00000040:00080000:3.0:1716999790.695180:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].37, 168 off14504 00010000:00010000:3.0:1716999790.695246:0:16640:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7f6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x709:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16640 initiator: MDT0 00010000:00010000:3.0:1716999790.695257:0:16640:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x709:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 16640 initiator: MDT0 00010000:00010000:3.0:1716999790.695267:0:16640:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x709:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16640 initiator: MDT0 00010000:00010000:3.0:1716999790.695277:0:16640:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7f6d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x709:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16640 initiator: MDT0 00010000:00010000:3.0:1716999790.695281:0:16640:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7f6d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x709:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16640 initiator: MDT0 00010000:00010000:3.0:1716999790.695285:0:16640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7f6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x709:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16640 initiator: MDT0 00010000:00010000:3.0:1716999790.695289:0:16640:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7f6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x709:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16640 initiator: MDT0 00010000:00010000:3.0:1716999790.695293:0:16640:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.695296:0:16640:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7f6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x709:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16640 initiator: MDT0 00010000:00010000:3.0:1716999790.695301:0:16640:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7f6d lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x709:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16640 initiator: MDT0 00010000:00010000:3.0:1716999790.695309:0:16640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x709:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999790.695311:0:16640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.695313:0:16640:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7f6d lrc: 3/0,0 mode: --/PW res: [0x200000401:0x709:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16640 initiator: MDT0 00010000:00010000:3.0:1716999790.695318:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7f6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x709:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16640 initiator: MDT0 00000100:00100000:3.0:1716999790.695429:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+536:11419:x1800404480782848:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 5575us (5826us total) trans 4294986569 rc 0/0 00000100:00100000:3.0:1716999790.695438:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9394 00000100:00100000:3.0:1716999790.700332:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.700375:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.700375:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480782976 00000100:00100000:0.0:1716999790.700382:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480782976 00000100:00100000:0.0:1716999790.701247:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480783104 00000100:00100000:0.0:1716999790.701251:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480783104 00000100:00100000:2.0:1716999790.701257:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9395 00000100:00100000:2.0:1716999790.701265:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11420:x1800404480782976:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.701268:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9396 00000100:00100000:0.0:1716999790.701271:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+537:11419:x1800404480783104:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.701935:0:16640:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x70a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000004:00080000:2.0:1716999790.701962:0:14949:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x708:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.701980:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1548, 64 off107328 00000040:00080000:2.0:1716999790.701988:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1549, 64 off107392 00000040:00080000:0.0:1716999790.701996:0:16640:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].38, 168 off14672 00000040:00080000:2.0:1716999790.702259:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].39, 168 off14840 00010000:00010000:2.0:1716999790.702316:0:14949:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7f74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x708:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.702327:0:14949:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7f74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x708:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.702336:0:14949:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7f74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x708:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.702343:0:14949:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7f74 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x708:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.702347:0:14949:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7f74 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x708:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.702356:0:14949:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7f74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x708:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.702362:0:14949:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7f74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x708:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.702366:0:14949:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830b40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.702369:0:14949:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7f74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x708:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.702374:0:14949:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7f74 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x708:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.702382:0:14949:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x708:0x0].0x0 (ffff880088977200) 00010000:00010000:2.0:1716999790.702384:0:14949:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.702388:0:14949:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7f74 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x708:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.702392:0:14949:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc7f74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x708:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00000100:00100000:2.0:1716999790.702488:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+538:11420:x1800404480782976:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1221us (2160us total) trans 4294986570 rc 0/0 00000100:00100000:2.0:1716999790.702495:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9395 00010000:00010000:0.0:1716999790.702691:0:16640:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7f7b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x70a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16640 initiator: MDT0 00010000:00010000:0.0:1716999790.702697:0:16640:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 16640 initiator: MDT0 00010000:00010000:0.0:1716999790.702703:0:16640:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7f7b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16640 initiator: MDT0 00010000:00010000:0.0:1716999790.702707:0:16640:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7f7b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 16640 initiator: MDT0 00010000:00010000:0.0:1716999790.702711:0:16640:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7f7b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16640 initiator: MDT0 00010000:00010000:0.0:1716999790.702715:0:16640:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7f7b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x70a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 16640 initiator: MDT0 00010000:00010000:0.0:1716999790.702719:0:16640:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7f7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16640 initiator: MDT0 00010000:00010000:0.0:1716999790.702723:0:16640:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.702725:0:16640:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7f7b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 16640 initiator: MDT0 00010000:00010000:0.0:1716999790.702733:0:16640:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7f7b lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x70a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 16640 initiator: MDT0 00010000:00010000:0.0:1716999790.702738:0:16640:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70a:0x0].0x0 (ffff88008a83f200) 00010000:00010000:0.0:1716999790.702740:0:16640:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.702742:0:16640:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7f7b lrc: 3/0,0 mode: --/PW res: [0x200000401:0x70a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16640 initiator: MDT0 00010000:00010000:0.0:1716999790.702747:0:16640:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc7f7b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x70a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 16640 initiator: MDT0 00000100:00100000:0.0:1716999790.702828:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+538:11419:x1800404480783104:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1555us (2452us total) trans 4294986571 rc 0/0 00000100:00100000:0.0:1716999790.702834:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9396 00000100:00100000:2.0:1716999790.705200:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.705273:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.705293:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480783232 00000100:00100000:2.0:1716999790.705299:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480783232 00000100:00100000:2.0:1716999790.705323:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480783360 00000100:00100000:2.0:1716999790.705324:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480783360 00000100:00100000:2.0:1716999790.705334:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9397 00000100:00100000:2.0:1716999790.705340:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+539:11420:x1800404480783232:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:2.0:1716999790.705679:0:14949:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x70b:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1716999790.705726:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1551, 64 off107520 00000040:00080000:2.0:1716999790.705743:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].40, 168 off15008 00010000:00010000:2.0:1716999790.705792:0:14949:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7f82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x70b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.705812:0:14949:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.705820:0:14949:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.705825:0:14949:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7f82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.705829:0:14949:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7f82 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.705833:0:14949:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7f82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x70b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.705837:0:14949:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7f82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.705842:0:14949:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833a80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999790.705844:0:14949:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7f82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.705848:0:14949:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7f82 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x70b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.705856:0:14949:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70b:0x0].0x0 (ffff880088977700) 00010000:00010000:2.0:1716999790.705859:0:14949:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999790.705861:0:14949:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7f82 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x70b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:2.0:1716999790.705864:0:14949:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc7f82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x70b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00000100:00100000:1.0:1716999790.706147:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9398 00000100:00100000:1.0:1716999790.706154:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+540:11419:x1800404480783360:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:1.0:1716999790.706906:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x70c:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1716999790.706942:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1550, 64 off107456 00000040:00080000:1.0:1716999790.706954:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].41, 168 off15176 00010000:00010000:1.0:1716999790.707004:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7f89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x70c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.707011:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7f89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.707017:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7f89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.707022:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7f89 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.707026:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7f89 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.707029:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7f89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x70c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.707033:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7f89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.707041:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b33c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.707043:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7f89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.707048:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7f89 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x70c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.707055:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70c:0x0].0x0 (ffff880099d1b300) 00010000:00010000:1.0:1716999790.707057:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.707059:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7f89 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x70c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.707063:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc7f89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x70c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:2.0:1716999790.708225:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+541:11420:x1800404480783232:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2880us (3024us total) trans 4294986572 rc 0/0 00000100:00100000:2.0:1716999790.708235:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9397 00000100:00100000:1.0:1716999790.709375:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec24850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+540:11419:x1800404480783360:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 3217us (4098us total) trans 4294986573 rc 0/0 00000100:00100000:1.0:1716999790.709383:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9398 00000100:00100000:3.0:1716999790.709998:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.710091:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480783488 00000100:00100000:1.0:1716999790.710096:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480783488 00000100:00100000:1.0:1716999790.710130:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9399 00000100:00100000:1.0:1716999790.710135:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+540:11420:x1800404480783488:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:1.0:1716999790.710708:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0x70d:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1716999790.710752:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1552, 64 off107584 00000040:00080000:1.0:1716999790.710768:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].42, 168 off15344 00010000:00010000:1.0:1716999790.710833:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7f90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x70d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.710844:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7f90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.710853:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7f90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x70d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.710858:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7f90 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.710863:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7f90 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x70d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.710867:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7f90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x70d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.710872:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7f90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.710876:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.710894:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7f90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x70d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.710900:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7f90 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x70d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.710908:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x70d:0x0].0x0 (ffff880099d1b000) 00010000:00010000:1.0:1716999790.710910:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.710913:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7f90 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x70d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.710918:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc7f90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x70d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:1.0:1716999790.712226:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+541:11420:x1800404480783488:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 2084us (2227us total) trans 4294986574 rc 0/0 00000100:00100000:1.0:1716999790.712236:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9399 00000100:00100000:2.0:1716999790.715085:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.715178:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480783616 00000100:00100000:1.0:1716999790.715185:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480783616 00000100:00100000:2.0:1716999790.715227:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.715308:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480783744 00000100:00100000:1.0:1716999790.715311:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480783744 00000100:00100000:1.0:1716999790.715329:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9400 00000100:00100000:1.0:1716999790.715334:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+542:11419:x1800404480783616:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.715379:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9401 00000100:00100000:0.0:1716999790.715384:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+542:11420:x1800404480783744:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.715990:0:6824:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0xc41:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.716037:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1551, 64 off107520 00000040:00080000:0.0:1716999790.716054:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].43, 168 off15512 00000004:00080000:1.0:1716999790.716120:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0xc3f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:0.0:1716999790.716133:0:6824:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7f97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.716145:0:6824:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6824 initiator: MDT0 00000040:00080000:1.0:1716999790.716147:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1552, 64 off107584 00010000:00010000:0.0:1716999790.716153:0:6824:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00000040:00080000:1.0:1716999790.716156:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].44, 168 off15680 00010000:00010000:0.0:1716999790.716160:0:6824:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7f97 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.716168:0:6824:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7f97 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.716172:0:6824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.716177:0:6824:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7f97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.716181:0:6824:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133840 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.716184:0:6824:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7f97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.716190:0:6824:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7f97 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.716193:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7f9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.716198:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7f9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.716198:0:6824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc41:0x0].0x0 (ffff88008a83fb00) 00010000:00010000:0.0:1716999790.716201:0:6824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.716203:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7f9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.716204:0:6824:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7f97 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.716207:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7f9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:0.0:1716999790.716208:0:6824:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc7f97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:1.0:1716999790.716211:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7f9e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.716215:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7f9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.716219:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7f9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.716222:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.716224:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7f9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.716230:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7f9e lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.716235:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc3f:0x0].0x0 (ffff880099d1bb00) 00010000:00010000:1.0:1716999790.716236:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.716238:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7f9e lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.716242:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc7f9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:1.0:1716999790.716295:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+544:11419:x1800404480783616:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 960us (1221us total) trans 4294986576 rc 0/0 00000100:00100000:0.0:1716999790.716295:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+544:11420:x1800404480783744:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 910us (1068us total) trans 4294986575 rc 0/0 00000100:00100000:0.0:1716999790.716302:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9401 00000100:00100000:1.0:1716999790.716304:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9400 00000100:00100000:2.0:1716999790.717826:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.717908:0:6824:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480783872 00000100:00100000:0.0:1716999790.717913:0:6824:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480783872 00000100:00100000:0.0:1716999790.717940:0:6824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9402 00000100:00100000:0.0:1716999790.717946:0:6824:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+543:11420:x1800404480783872:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:0.0:1716999790.718255:0:6824:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0xc56:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1716999790.718296:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1553, 64 off107648 00000040:00080000:0.0:1716999790.718310:0:6824:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].45, 168 off15848 00010000:00010000:0.0:1716999790.718368:0:6824:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7fa5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc56:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.718377:0:6824:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.718384:0:6824:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7fa5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.718390:0:6824:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7fa5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.718395:0:6824:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7fa5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.718399:0:6824:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7fa5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.718404:0:6824:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7fa5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.718408:0:6824:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999790.718410:0:6824:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7fa5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.718415:0:6824:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7fa5 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.718422:0:6824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc56:0x0].0x0 (ffff88008a83f100) 00010000:00010000:0.0:1716999790.718424:0:6824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1716999790.718427:0:6824:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7fa5 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00010000:00010000:0.0:1716999790.718431:0:6824:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc7fa5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc56:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6824 initiator: MDT0 00000100:00100000:0.0:1716999790.718600:0:6824:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:107d663a-2216-406b-94c6-b2fcb1558728+544:11420:x1800404480783872:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 653us (774us total) trans 4294986577 rc 0/0 00000100:00100000:0.0:1716999790.718606:0:6824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9402 00000100:00100000:3.0:1716999790.719272:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.719503:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480784000 00000100:00100000:1.0:1716999790.719508:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480784000 00000100:00100000:1.0:1716999790.719554:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9403 00000100:00100000:1.0:1716999790.719560:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+544:11419:x1800404480784000:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:1.0:1716999790.719907:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0xc53:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1716999790.720096:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1553, 64 off107648 00000040:00080000:1.0:1716999790.720111:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].46, 168 off16016 00010000:00010000:1.0:1716999790.720160:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7fac lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.720168:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.720175:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7fac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.720182:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7fac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.720186:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7fac lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.720190:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7fac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.720194:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7fac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.720198:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2400 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.720200:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7fac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.720204:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7fac lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.720211:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc53:0x0].0x0 (ffff880099d1ba00) 00010000:00010000:1.0:1716999790.720213:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.720215:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7fac lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.720219:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc7fac lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:1.0:1716999790.720409:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+545:11419:x1800404480784000:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 770us (1059us total) trans 4294986578 rc 0/0 00000100:00100000:1.0:1716999790.720417:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9403 00000100:00100000:2.0:1716999790.722688:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.722764:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.722827:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480784128 00000100:00100000:1.0:1716999790.722833:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480784128 00000100:00100000:1.0:1716999790.722859:0:6825:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480784256 00000100:00100000:1.0:1716999790.722861:0:6825:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480784256 00000100:00100000:1.0:1716999790.722871:0:6825:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9404 00000100:00100000:1.0:1716999790.722876:0:6825:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec24450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+546:11420:x1800404480784128:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:3.0:1716999790.723245:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9405 00000100:00100000:3.0:1716999790.723251:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+546:11419:x1800404480784256:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:1.0:1716999790.723256:0:6825:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0xc57:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1716999790.723301:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1554, 64 off107712 00000040:00080000:1.0:1716999790.723317:0:6825:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].47, 168 off16184 00010000:00010000:1.0:1716999790.723371:0:6825:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7fb3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.723381:0:6825:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.723389:0:6825:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.723395:0:6825:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7fb3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.723400:0:6825:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7fb3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.723404:0:6825:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.723409:0:6825:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7fb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.723413:0:6825:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999790.723416:0:6825:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7fb3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.723422:0:6825:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7fb3 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.723431:0:6825:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc57:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.723433:0:6825:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999790.723435:0:6825:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7fb3 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00010000:00010000:1.0:1716999790.723440:0:6825:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc7fb3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6825 initiator: MDT0 00000100:00100000:1.0:1716999790.723524:0:6825:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec24450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:107d663a-2216-406b-94c6-b2fcb1558728+547:11420:x1800404480784128:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 646us (840us total) trans 4294986579 rc 0/0 00000100:00100000:1.0:1716999790.723530:0:6825:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9404 00000004:00080000:3.0:1716999790.723856:0:14949:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0xc55:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1716999790.723909:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1555, 64 off107776 00000040:00080000:3.0:1716999790.723920:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].48, 168 off16352 00010000:00010000:3.0:1716999790.723960:0:14949:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7fba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.723967:0:14949:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.723973:0:14949:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.723978:0:14949:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7fba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.723982:0:14949:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7fba lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.723986:0:14949:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7fba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.723990:0:14949:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7fba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.723993:0:14949:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.723995:0:14949:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7fba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.724000:0:14949:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7fba lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.724006:0:14949:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc55:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999790.724008:0:14949:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.724010:0:14949:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7fba lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.724014:0:14949:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7fba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00000100:00100000:3.0:1716999790.724564:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+547:11419:x1800404480784256:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 1311us (1798us total) trans 4294986580 rc 0/0 00000100:00100000:3.0:1716999790.724571:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9405 00000100:00100000:2.0:1716999790.726238:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.726301:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480784384 00000100:00100000:3.0:1716999790.726307:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480784384 00000100:00100000:3.0:1716999790.726331:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9406 00000100:00100000:3.0:1716999790.726337:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+547:11419:x1800404480784384:12345-192.168.203.3@tcp:35:dbench.0 00000004:00080000:3.0:1716999790.726705:0:14949:0:(mdd_object.c:3936:mdd_close()) Object [0x200000401:0xc4f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1716999790.726755:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1556, 64 off107840 00000040:00080000:3.0:1716999790.726820:0:14949:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].50, 168 off16552 00010000:00010000:3.0:1716999790.726876:0:14949:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7fc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xc4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.726986:0:14949:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.726995:0:14949:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7fc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xc4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.727004:0:14949:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7fc1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.727008:0:14949:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7fc1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xc4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.727011:0:14949:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7fc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xc4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.727016:0:14949:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7fc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.727020:0:14949:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c518c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999790.727022:0:14949:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7fc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xc4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.727028:0:14949:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7fc1 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0xc4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.727036:0:14949:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xc4f:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.727038:0:14949:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999790.727041:0:14949:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7fc1 lrc: 3/0,0 mode: --/PW res: [0x200000401:0xc4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00010000:00010000:3.0:1716999790.727046:0:14949:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7fc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xc4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 14949 initiator: MDT0 00000100:00100000:3.0:1716999790.727138:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+548:11419:x1800404480784384:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 800us (902us total) trans 4294986581 rc 0/0 00000100:00100000:3.0:1716999790.727145:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9406 00000100:00100000:2.0:1716999790.731170:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.731268:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480784512 00000100:00100000:0.0:1716999790.731276:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480784512 00000100:00100000:0.0:1716999790.731311:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9407 00000100:00100000:0.0:1716999790.731318:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+548:11418:x1800404480784512:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.732105:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+549:11418:x1800404480784512:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 363us (518us total) trans 4294986582 rc 0/0 00000100:00100000:0.0:1716999790.732115:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9407 00000100:00100000:2.0:1716999790.735149:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.735327:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480784640 00000100:00100000:0.0:1716999790.735334:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480784640 00000100:00100000:0.0:1716999790.735361:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9408 00000100:00100000:0.0:1716999790.735367:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+549:11418:x1800404480784640:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.735543:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+550:11418:x1800404480784640:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 175us (398us total) trans 4294986583 rc 0/0 00000100:00100000:0.0:1716999790.735550:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9408 00000100:00100000:2.0:1716999790.738667:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.738784:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480784768 00000100:00100000:0.0:1716999790.738792:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480784768 00000100:00100000:0.0:1716999790.738841:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9409 00000100:00100000:0.0:1716999790.738848:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+550:11418:x1800404480784768:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.739087:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+551:11418:x1800404480784768:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 238us (425us total) trans 4294986584 rc 0/0 00000100:00100000:0.0:1716999790.739094:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9409 00000100:00100000:3.0:1716999790.740279:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.740316:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480784896 00000100:00100000:0.0:1716999790.740321:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480784896 00000100:00100000:0.0:1716999790.740347:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9410 00000100:00100000:0.0:1716999790.740352:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec24050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+551:11418:x1800404480784896:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.740450:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec24050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+552:11418:x1800404480784896:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 96us (172us total) trans 4294986585 rc 0/0 00000100:00100000:0.0:1716999790.740465:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9410 00000100:00100000:2.0:1716999790.743259:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.743539:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480785024 00000100:00100000:0.0:1716999790.743546:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480785024 00000100:00100000:0.0:1716999790.743579:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9411 00000100:00100000:0.0:1716999790.743586:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+552:11418:x1800404480785024:12345-192.168.203.3@tcp:35:dbench.0 00000100:00100000:0.0:1716999790.743986:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+553:11418:x1800404480785024:12345-192.168.203.3@tcp:35:dbench.0 Request processed in 399us (733us total) trans 4294986586 rc 0/0 00000100:00100000:0.0:1716999790.743993:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9411 00000100:00100000:2.0:1716999790.750147:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.750468:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480785088 00000100:00100000:1.0:1716999790.750476:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480785088 00000100:00100000:1.0:1716999790.750575:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45911 00000100:00100000:1.0:1716999790.750582:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+553:11576:x1800404480785088:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1716999790.750601:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.750619:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7fc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6624c expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.750663:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7fcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.750672:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.750681:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:1.0:1716999790.750734:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6ac:0x0]: returning size 11776 00000004:00200000:1.0:1716999790.750737:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999790.750748:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.750765:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc7fc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6624c expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.751092:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6624c expref: 554 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.751099:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.751102:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1716999790.751104:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b18c0, rc 0) 00000100:00100000:1.0:1716999790.751333:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11576:x1800404480785088:12345-192.168.203.3@tcp:101:bash.0 Request processed in 750us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.751342:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45911 00000100:00100000:3.0:1716999790.754306:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.754457:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480785152 00000100:00100000:1.0:1716999790.754464:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480785152 00000100:00100000:1.0:1716999790.754493:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45912 00000100:00100000:1.0:1716999790.754499:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11576:x1800404480785152:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1716999790.754523:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.754538:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc7fd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66253 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.754583:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7fdd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754593:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7fdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754600:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7fdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754611:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7fe4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65746164 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754616:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65746164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754621:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65746164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754680:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7fdd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754686:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7fdd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754691:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7fdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754696:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b06c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.754699:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7fdd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754705:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7fdd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754713:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.754715:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.754718:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7fdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754722:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc7fdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754730:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7fe4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65746164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754735:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7fe4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65746164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754739:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65746164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754742:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.754744:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7fe4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65746164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754748:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7fe4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65746164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754753:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x65746164 (ffff880099d1bb00) 00010000:00010000:1.0:1716999790.754755:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.754756:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7fe4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65746164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754761:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc7fe4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65746164 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.754790:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc7fd6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66253 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.754811:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc7fd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66253 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.754818:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b2d00, rc 0) 00000100:00100000:1.0:1716999790.754850:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11576:x1800404480785152:12345-192.168.203.3@tcp:101:bash.0 Request processed in 351us (555us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999790.754859:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45912 00000100:00100000:2.0:1716999790.758327:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.758696:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480785216 00000100:00100000:3.0:1716999790.758704:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480785216 00000100:00100000:3.0:1716999790.758780:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45913 00000100:00100000:3.0:1716999790.758786:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11577:x1800404480785216:12345-192.168.203.3@tcp:101:date.0 00010000:00010000:3.0:1716999790.758811:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.758825:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7feb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6625a expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.758868:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7ff2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.758949:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7ff2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.758960:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7ff2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.758972:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ff9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x736c74 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.758978:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.758983:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759034:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7ff2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759038:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7ff2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759041:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7ff2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759045:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.759047:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7ff2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759051:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7ff2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759056:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:3.0:1716999790.759058:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.759060:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7ff2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759062:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50900/0x6d188eabd8dc7ff2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759079:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759087:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ff9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759091:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759095:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.759097:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759101:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759106:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x736c74 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.759108:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.759110:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ff9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759114:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc7ff9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x736c74 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.759146:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7feb lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6625a expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.759151:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc7feb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6625a expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.759157:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c518c0, rc 0) 00000100:00100000:3.0:1716999790.759197:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11577:x1800404480785216:12345-192.168.203.3@tcp:101:date.0 Request processed in 410us (875us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999790.759202:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45913 00000100:00100000:1.0:1716999790.760409:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.760448:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480785280 00000100:00100000:3.0:1716999790.760453:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480785280 00000100:00100000:3.0:1716999790.760482:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45914 00000100:00100000:3.0:1716999790.760487:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11577:x1800404480785280:12345-192.168.203.3@tcp:101:date.0 00010000:00010000:3.0:1716999790.760497:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.760508:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8000 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66261 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.760538:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8007 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760544:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8007 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760550:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8007 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760560:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc800e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x5f366cae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760564:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc800e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760568:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc800e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760604:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8007 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760609:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8007 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760613:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8007 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760618:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.760620:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8007 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760625:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8007 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760632:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:3.0:1716999790.760633:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.760635:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8007 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760639:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8007 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760645:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc800e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760649:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc800e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760652:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc800e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760656:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c533c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.760658:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc800e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760662:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc800e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760666:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x5f366cae (ffff8800a5c6e700) 00010000:00010000:3.0:1716999790.760668:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.760670:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc800e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760673:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc800e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x5f366cae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.760699:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8000 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66261 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.760705:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8000 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66261 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.760710:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50fc0, rc 0) 00000100:00100000:3.0:1716999790.760747:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11577:x1800404480785280:12345-192.168.203.3@tcp:101:date.0 Request processed in 259us (340us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999790.760755:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45914 00000100:00100000:0.0:1716999790.761919:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.761964:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480785408 00000100:00100000:1.0:1716999790.761970:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480785408 00000100:00100000:1.0:1716999790.762003:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45915 00000100:00100000:1.0:1716999790.762009:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11577:x1800404480785408:12345-192.168.203.3@tcp:101:date.0 00010000:00010000:1.0:1716999790.762019:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.762029:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc8015 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66268 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.762085:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc801c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762093:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc801c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762100:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc801c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762108:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8023 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x2060c1a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762112:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762117:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762140:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc801c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762144:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc801c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762147:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc801c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762150:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.762151:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc801c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762154:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc801c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762159:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.762160:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.762162:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc801c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762164:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc801c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762179:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762183:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8023 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762187:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8023 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762191:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.762192:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8023 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762196:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8023 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762202:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x2060c1a3 (ffff880099d1b000) 00010000:00010000:1.0:1716999790.762204:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.762206:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8023 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762210:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8023 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.762228:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc8015 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66268 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.762235:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc8015 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66268 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.762240:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b0900, rc 0) 00000100:00100000:1.0:1716999790.762268:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11577:x1800404480785408:12345-192.168.203.3@tcp:101:date.0 Request processed in 260us (352us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999790.762274:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45915 00000100:00100000:2.0:1716999790.766089:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.766171:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480785472 00000100:00100000:1.0:1716999790.766178:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480785472 00000100:00100000:1.0:1716999790.766226:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45916 00000100:00100000:1.0:1716999790.766232:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11392:x1800404480785472:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:1.0:1716999790.766247:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.766262:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc802a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6626f expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.766356:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8031 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766369:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8031 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766377:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8031 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766386:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8038 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x7370 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766392:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7370 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766396:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7370 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766457:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8031 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766464:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8031 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766469:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8031 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766473:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.766475:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8031 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766480:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8031 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766489:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.766491:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.766495:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8031 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766499:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8031 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766507:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8038 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7370 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766512:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8038 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7370 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766516:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7370 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766520:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.766522:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8038 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7370 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766526:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8038 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7370 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766532:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x7370 (ffff880099d1b300) 00010000:00010000:1.0:1716999790.766533:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.766535:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8038 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x7370 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766539:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8038 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x7370 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.766569:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc802a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6626f expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.766576:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc802a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6626f expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.766583:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b1f80, rc 0) 00000100:00100000:1.0:1716999790.766632:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11392:x1800404480785472:12345-192.168.203.3@tcp:101:bash.0 Request processed in 399us (550us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999790.766638:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45916 00000100:00100000:2.0:1716999790.771996:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.772079:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480785600 00000100:00100000:1.0:1716999790.772086:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480785600 00000100:00100000:1.0:1716999790.772190:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45917 00000100:00100000:1.0:1716999790.772196:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480785600:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:1.0:1716999790.772212:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.772226:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc803f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66276 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.772312:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc8046 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772323:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc8046 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772332:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc8046 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772342:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc804d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x56680273 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772346:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc804d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x56680273 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772351:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc804d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x56680273 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772389:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc8046 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772394:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc8046 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772399:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc8046 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772404:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.772406:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc8046 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772412:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc8046 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772420:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.772423:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.772426:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc8046 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772430:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc8046 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772439:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc804d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x56680273 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772443:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc804d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x56680273 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772448:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc804d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x56680273 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772455:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.772457:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc804d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x56680273 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772462:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc804d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x56680273 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772468:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x56680273 (ffff880099d1bb00) 00010000:00010000:1.0:1716999790.772469:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.772471:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc804d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x56680273 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772475:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc804d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x56680273 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.772499:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc803f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66276 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.772505:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc803f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66276 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.772512:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b2ac0, rc 0) 00000100:00100000:1.0:1716999790.772726:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480785600:12345-192.168.203.3@tcp:101:ps.0 Request processed in 528us (734us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999790.772732:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45917 00000100:00100000:0.0:1716999790.774492:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.774560:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480785728 00000100:00100000:1.0:1716999790.774566:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480785728 00000100:00100000:1.0:1716999790.774599:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45918 00000100:00100000:1.0:1716999790.774604:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480785728:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:1.0:1716999790.774614:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.774624:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc8054 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6627d expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.774682:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc805b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774688:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc805b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774692:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc805b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774698:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc8062 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x12ec56ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774701:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc8062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x12ec56ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774706:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc8062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x12ec56ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774736:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc805b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774742:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc805b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774746:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc805b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774751:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.774754:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc805b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774760:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc805b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774768:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.774770:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.774773:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc805b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774777:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc805b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774786:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc8062 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x12ec56ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774790:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc8062 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x12ec56ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774803:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc8062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x12ec56ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774806:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.774808:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc8062 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x12ec56ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774812:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc8062 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x12ec56ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774818:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x12ec56ed (ffff880099d1ba00) 00010000:00010000:1.0:1716999790.774821:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.774822:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc8062 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x12ec56ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774826:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc8062 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x12ec56ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.774850:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc8054 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6627d expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.774856:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc8054 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6627d expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.774863:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b1680, rc 0) 00000100:00100000:1.0:1716999790.774930:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480785728:12345-192.168.203.3@tcp:101:ps.0 Request processed in 324us (440us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999790.774935:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45918 00000100:00100000:2.0:1716999790.776407:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.776595:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480785856 00000100:00100000:3.0:1716999790.776601:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480785856 00000100:00100000:3.0:1716999790.776637:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45919 00000100:00100000:3.0:1716999790.776643:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480785856:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:3.0:1716999790.776654:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.776665:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8069 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66284 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.776728:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8070 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776737:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8070 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776743:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8070 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776753:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8077 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x728288c9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776758:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x728288c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776763:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x728288c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776804:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8070 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776809:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8070 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776814:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8070 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776818:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c533c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.776820:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8070 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776826:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8070 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776833:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:3.0:1716999790.776835:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.776838:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8070 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776842:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8070 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776863:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8077 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x728288c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776868:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8077 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x728288c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776872:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8077 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x728288c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776876:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.776901:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8077 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x728288c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776907:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8077 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x728288c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776914:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x728288c9 (ffff8800a5c6e700) 00010000:00010000:3.0:1716999790.776916:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.776918:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8077 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x728288c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776922:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8077 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x728288c9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.776943:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8069 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66284 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.776949:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8069 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66284 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.776955:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50fc0, rc 0) 00000100:00100000:3.0:1716999790.776986:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480785856:12345-192.168.203.3@tcp:101:ps.0 Request processed in 343us (581us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999790.776992:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45919 00000100:00100000:0.0:1716999790.779192:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.779259:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480785984 00000100:00100000:1.0:1716999790.779265:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480785984 00000100:00100000:1.0:1716999790.779328:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45920 00000100:00100000:1.0:1716999790.779333:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480785984:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:1.0:1716999790.779344:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.779354:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc807e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6628b expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.779419:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc8085 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779425:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc8085 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779431:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc8085 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779438:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc808c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x8b49d6a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779441:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc808c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8b49d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779444:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc808c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8b49d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779465:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc8085 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779468:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc8085 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779472:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc8085 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779475:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b21c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.779477:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc8085 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779480:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc8085 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779485:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.779487:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.779488:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc8085 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779491:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc8085 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779495:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc808c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8b49d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779498:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc808c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8b49d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779501:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc808c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8b49d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779503:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.779504:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc808c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8b49d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779507:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc808c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8b49d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779509:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x8b49d6a7 (ffff880099d1b300) 00010000:00010000:1.0:1716999790.779510:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.779512:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc808c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x8b49d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779514:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc808c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x8b49d6a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.779528:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc807e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6628b expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.779532:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc807e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6628b expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.779535:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b1d40, rc 0) 00000100:00100000:1.0:1716999790.779570:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480785984:12345-192.168.203.3@tcp:101:ps.0 Request processed in 237us (383us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999790.779575:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45920 00000100:00100000:2.0:1716999790.781219:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.781302:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480786112 00000100:00100000:0.0:1716999790.781308:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480786112 00000100:00100000:0.0:1716999790.781345:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45921 00000100:00100000:0.0:1716999790.781350:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786112:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:0.0:1716999790.781361:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999790.781373:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc8093 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66292 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.781440:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc809a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781449:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc809a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781457:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc809a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781466:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc80a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x7a60c1a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781471:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc80a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7a60c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781476:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc80a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7a60c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781506:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc809a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781511:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc809a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781515:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc809a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781518:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.781521:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc809a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781525:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc809a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781533:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:0.0:1716999790.781535:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.781537:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc809a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781541:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc809a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781551:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc80a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7a60c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781554:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc80a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7a60c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781558:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc80a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7a60c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781561:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.781563:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc80a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7a60c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781567:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc80a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7a60c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781572:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x7a60c1a3 (ffff88008a83fb00) 00010000:00010000:0.0:1716999790.781574:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.781575:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc80a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x7a60c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781579:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc80a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x7a60c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.781597:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc8093 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66292 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.781603:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc8093 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66292 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.781610:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c1321c0, rc 0) 00000100:00100000:0.0:1716999790.781637:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786112:12345-192.168.203.3@tcp:101:ps.0 Request processed in 287us (422us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999790.781641:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45921 00000100:00100000:2.0:1716999790.783248:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.783302:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480786240 00000100:00100000:1.0:1716999790.783307:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480786240 00000100:00100000:1.0:1716999790.783331:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45922 00000100:00100000:1.0:1716999790.783337:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786240:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:1.0:1716999790.783348:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.783359:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc80a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66299 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.783414:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc80af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783422:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc80af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783428:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc80af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783435:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc80b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xf0828812 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783439:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc80b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf0828812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783442:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc80b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf0828812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783463:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc80af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783466:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc80af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783469:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc80af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783472:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.783474:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc80af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783477:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc80af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783483:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.783484:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.783486:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc80af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783488:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc80af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783493:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc80b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf0828812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783496:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc80b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf0828812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783498:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc80b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf0828812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783500:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.783502:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc80b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf0828812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783504:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc80b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf0828812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783507:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0xf0828812 (ffff880099d1b200) 00010000:00010000:1.0:1716999790.783508:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.783509:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc80b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xf0828812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783514:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc80b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xf0828812 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.783527:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc80a8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66299 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.783531:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc80a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66299 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.783535:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b3840, rc 0) 00000100:00100000:1.0:1716999790.783615:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786240:12345-192.168.203.3@tcp:101:ps.0 Request processed in 278us (370us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999790.783618:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45922 00000100:00100000:0.0:1716999790.784776:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.784855:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480786368 00000100:00100000:1.0:1716999790.784860:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480786368 00000100:00100000:1.0:1716999790.784909:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45923 00000100:00100000:1.0:1716999790.784915:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786368:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:1.0:1716999790.784924:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.784932:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc80bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662a0 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.784984:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc80c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.784991:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc80c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.784998:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc80c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785009:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc80cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x638a2b41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785014:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc80cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x638a2b41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785019:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc80cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x638a2b41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785046:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc80c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785051:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc80c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785055:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc80c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785059:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.785061:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc80c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785065:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc80c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785072:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.785074:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.785076:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc80c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785080:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc80c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785086:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc80cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x638a2b41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785091:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc80cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x638a2b41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785095:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc80cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x638a2b41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785099:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.785101:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc80cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x638a2b41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785105:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc80cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x638a2b41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785111:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x638a2b41 (ffff880099d1ba00) 00010000:00010000:1.0:1716999790.785112:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.785114:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc80cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x638a2b41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785118:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc80cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x638a2b41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.785136:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc80bd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662a0 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.785142:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc80bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662a0 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.785147:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b2880, rc 0) 00000100:00100000:1.0:1716999790.785184:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786368:12345-192.168.203.3@tcp:101:ps.0 Request processed in 268us (408us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999790.785190:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45923 00000100:00100000:2.0:1716999790.790165:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.790283:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480786496 00000100:00100000:1.0:1716999790.790291:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480786496 00000100:00100000:1.0:1716999790.790325:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45924 00000100:00100000:1.0:1716999790.790332:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786496:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:1.0:1716999790.790347:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.790361:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc80d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662a7 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.790448:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc80d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790459:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc80d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790468:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc80d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790477:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc80e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xa610fd8d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790482:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc80e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xa610fd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790487:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc80e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xa610fd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790523:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc80d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790528:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc80d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790533:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc80d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790538:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b06c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.790541:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc80d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790547:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc80d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790556:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.790559:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.790562:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc80d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790567:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc80d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790576:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc80e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xa610fd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790580:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc80e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xa610fd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790585:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc80e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xa610fd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790589:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.790592:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc80e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xa610fd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790596:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc80e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xa610fd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790602:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0xa610fd8d (ffff880099d1b000) 00010000:00010000:1.0:1716999790.790604:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.790606:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc80e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xa610fd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790610:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc80e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xa610fd8d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.790633:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc80d2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662a7 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.790640:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc80d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662a7 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.790647:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b1b00, rc 0) 00000100:00100000:1.0:1716999790.790684:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786496:12345-192.168.203.3@tcp:101:ps.0 Request processed in 352us (526us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999790.790690:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45924 00000100:00100000:2.0:1716999790.795861:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.795967:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480786624 00000100:00100000:0.0:1716999790.795974:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480786624 00000100:00100000:0.0:1716999790.796012:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45925 00000100:00100000:0.0:1716999790.796018:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786624:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:0.0:1716999790.796033:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999790.796047:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc80e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662ae expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.796129:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc80ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796139:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc80ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796148:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc80ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796157:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc80f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xdc46bb88 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796161:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc80f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdc46bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796166:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc80f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdc46bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796197:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc80ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796201:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc80ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796206:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc80ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796210:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1333c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.796213:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc80ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796218:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc80ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796226:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:0.0:1716999790.796228:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.796231:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc80ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796235:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc80ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796262:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc80f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdc46bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796268:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc80f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdc46bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796272:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc80f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdc46bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796277:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.796279:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc80f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdc46bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796283:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc80f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdc46bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796289:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0xdc46bb88 (ffff88008a83f200) 00010000:00010000:0.0:1716999790.796291:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.796293:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc80f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xdc46bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796297:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc80f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xdc46bb88 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999790.796319:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc80e7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662ae expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.796325:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc80e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662ae expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.796331:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c131f80, rc 0) 00000100:00100000:0.0:1716999790.796367:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786624:12345-192.168.203.3@tcp:101:ps.0 Request processed in 349us (513us total) trans 0 rc 301/301 00000100:00100000:0.0:1716999790.796373:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45925 00000100:00100000:1.0:1716999790.798839:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.799368:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480786752 00000100:00100000:2.0:1716999790.799375:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480786752 00000100:00100000:2.0:1716999790.799438:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45926 00000100:00100000:2.0:1716999790.799444:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786752:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:2.0:1716999790.799460:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.799475:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc80fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662b5 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.799559:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8103 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.799569:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8103 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.799577:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8103 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.799587:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc810a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65f19ed bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.799592:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc810a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65f19ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.799597:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc810a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65f19ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.799629:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8103 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.799634:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8103 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.799639:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8103 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.799643:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.799646:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8103 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.799651:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8103 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.799660:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:2.0:1716999790.799662:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.799665:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8103 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.799669:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8103 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.800611:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc810a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65f19ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.800618:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc810a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65f19ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.800623:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc810a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65f19ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.800627:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.800629:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc810a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65f19ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.800634:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc810a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65f19ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.800642:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x65f19ed (ffff880088977800) 00010000:00010000:2.0:1716999790.800644:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.800646:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc810a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65f19ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.800650:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc810a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65f19ed bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.800678:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc80fc lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662b5 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.800684:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc80fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662b5 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.800691:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091830fc0, rc 0) 00000100:00100000:3.0:1716999790.800804:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786752:12345-192.168.203.3@tcp:101:ps.0 Request processed in 1349us (1961us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999790.800811:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45926 00000100:00100000:1.0:1716999790.802762:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.802836:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480786880 00000100:00100000:3.0:1716999790.802843:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480786880 00000100:00100000:3.0:1716999790.802870:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45927 00000100:00100000:3.0:1716999790.802875:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786880:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:3.0:1716999790.803197:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.803211:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8111 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662bc expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.803291:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8118 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803301:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8118 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803309:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8118 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803317:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc811f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x61572890 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803322:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc811f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x61572890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803326:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc811f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x61572890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803355:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8118 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803359:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8118 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803363:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8118 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803368:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.803371:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8118 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803375:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8118 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803386:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:3.0:1716999790.803388:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.803390:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8118 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803394:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8118 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803412:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc811f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x61572890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803416:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc811f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x61572890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803420:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc811f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x61572890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803423:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c533c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.803424:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc811f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x61572890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803428:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc811f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x61572890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803432:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x61572890 (ffff8800a5c6e200) 00010000:00010000:3.0:1716999790.803434:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.803436:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc811f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x61572890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803439:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc811f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x61572890 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.803458:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8111 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662bc expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.803465:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8111 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662bc expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.803470:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c50fc0, rc 0) 00000100:00100000:3.0:1716999790.803504:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480786880:12345-192.168.203.3@tcp:101:ps.0 Request processed in 628us (747us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999790.803509:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45927 00000100:00100000:0.0:1716999790.805682:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.805745:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480787008 00000100:00100000:3.0:1716999790.805750:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480787008 00000100:00100000:3.0:1716999790.805780:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45928 00000100:00100000:3.0:1716999790.805785:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787008:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:3.0:1716999790.805802:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.805813:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc8126 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662c3 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.805871:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc812d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.805903:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc812d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806724:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc812d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806739:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc8134 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x44d42401 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806745:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc8134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x44d42401 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806754:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc8134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x44d42401 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806814:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc812d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806823:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc812d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806829:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc812d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806833:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.806835:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc812d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806840:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc812d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806849:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:3.0:1716999790.806851:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.806854:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc812d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806858:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52640/0x6d188eabd8dc812d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806866:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc8134 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x44d42401 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806871:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc8134 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x44d42401 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806875:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc8134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x44d42401 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806905:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c506c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.806908:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc8134 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x44d42401 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806912:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc8134 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x44d42401 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806919:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x44d42401 (ffff8800a5c6ea00) 00010000:00010000:3.0:1716999790.806921:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.806923:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc8134 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x44d42401 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806927:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c506c0/0x6d188eabd8dc8134 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x44d42401 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.806953:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc8126 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662c3 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.806959:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c518c0/0x6d188eabd8dc8126 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662c3 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.806965:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c518c0, rc 0) 00000100:00100000:3.0:1716999790.807080:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787008:12345-192.168.203.3@tcp:101:ps.0 Request processed in 1293us (1401us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999790.807086:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45928 00000100:00100000:1.0:1716999790.809869:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.809974:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480787136 00000100:00100000:3.0:1716999790.809982:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480787136 00000100:00100000:3.0:1716999790.810023:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45929 00000100:00100000:3.0:1716999790.810029:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787136:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:3.0:1716999790.810044:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.810057:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc813b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662ca expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.810478:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc8142 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810489:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc8142 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810498:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc8142 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810507:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8149 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x7282882c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810512:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7282882c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810516:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7282882c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810550:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc8142 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810555:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc8142 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810560:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc8142 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810565:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.810568:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc8142 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810574:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc8142 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810582:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:3.0:1716999790.810585:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.810588:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc8142 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810593:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50b40/0x6d188eabd8dc8142 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810601:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8149 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7282882c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810605:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8149 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7282882c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810609:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7282882c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810613:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.810615:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8149 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7282882c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810619:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8149 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x7282882c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810624:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x7282882c (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999790.810626:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.810628:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8149 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x7282882c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810631:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8149 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x7282882c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.810656:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc813b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662ca expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.810662:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc813b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662ca expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.810669:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c52400, rc 0) 00000100:00100000:3.0:1716999790.811041:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787136:12345-192.168.203.3@tcp:101:ps.0 Request processed in 1010us (1177us total) trans 0 rc 301/301 00000100:00100000:3.0:1716999790.812520:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45929 00000100:00100000:2.0:1716999790.814720:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.815396:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480787264 00000100:00100000:3.0:1716999790.815404:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480787264 00000100:00100000:1.0:1716999790.815837:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45930 00000100:00100000:1.0:1716999790.815845:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787264:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:1.0:1716999790.815860:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.815874:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc8150 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662d1 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.816109:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc8157 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816120:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc8157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816129:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc8157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816139:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc815e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xdf3fa6a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816144:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc815e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdf3fa6a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816149:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc815e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdf3fa6a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816181:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc8157 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816186:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc8157 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816190:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc8157 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816195:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.816199:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc8157 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816204:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc8157 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816213:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.816215:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.816218:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc8157 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816223:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc8157 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816547:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc815e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdf3fa6a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816553:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc815e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdf3fa6a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816558:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc815e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdf3fa6a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816562:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.816564:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc815e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdf3fa6a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816569:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc815e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xdf3fa6a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816575:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0xdf3fa6a9 (ffff8800a6d5ff00) 00010000:00010000:1.0:1716999790.816578:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.816580:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc815e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xdf3fa6a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816584:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc815e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xdf3fa6a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.816608:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc8150 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662d1 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.816615:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc8150 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662d1 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.816621:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b0480, rc 0) 00000100:00100000:1.0:1716999790.816842:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787264:12345-192.168.203.3@tcp:101:ps.0 Request processed in 996us (2124us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999790.816848:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45930 00000100:00100000:0.0:1716999790.819348:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.819438:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480787392 00000100:00100000:1.0:1716999790.819445:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480787392 00000100:00100000:1.0:1716999790.819484:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45931 00000100:00100000:1.0:1716999790.819489:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787392:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:1.0:1716999790.819502:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.819514:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8165 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662d8 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.819584:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc816c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819595:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc816c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819602:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc816c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819611:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc8173 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xf7d9f3b4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819616:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc8173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf7d9f3b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819621:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc8173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf7d9f3b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819650:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc816c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819655:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc816c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819661:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc816c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819665:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b33c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.819668:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc816c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819673:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc816c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819680:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999790.819683:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.819685:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc816c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819689:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc816c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819697:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc8173 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf7d9f3b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819702:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc8173 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf7d9f3b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819707:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc8173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf7d9f3b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819710:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.819712:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc8173 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf7d9f3b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819716:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc8173 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xf7d9f3b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819722:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0xf7d9f3b4 (ffff8800a6d5fb00) 00010000:00010000:1.0:1716999790.819724:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.819726:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc8173 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xf7d9f3b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819730:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc8173 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xf7d9f3b4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999790.819747:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8165 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662d8 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.819754:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8165 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662d8 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.819760:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b0240, rc 0) 00000100:00100000:1.0:1716999790.819807:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787392:12345-192.168.203.3@tcp:101:ps.0 Request processed in 317us (464us total) trans 0 rc 301/301 00000100:00100000:1.0:1716999790.819813:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45931 00000100:00100000:1.0:1716999790.822302:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.822378:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480787520 00000100:00100000:2.0:1716999790.822385:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480787520 00000100:00100000:2.0:1716999790.822417:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45932 00000100:00100000:2.0:1716999790.822422:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787520:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:2.0:1716999790.822435:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.822446:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc817a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662df expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.822520:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc8181 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822535:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc8181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822542:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc8181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822555:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8188 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x3faa3c56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822560:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x3faa3c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822564:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x3faa3c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822595:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc8181 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822599:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc8181 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822604:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc8181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822609:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.822612:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc8181 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822617:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc8181 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822625:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:2.0:1716999790.822627:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.822630:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc8181 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822635:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc8181 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822656:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x3faa3c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822661:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8188 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x3faa3c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822665:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x3faa3c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822668:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.822670:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x3faa3c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822675:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8188 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x3faa3c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822680:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x3faa3c56 (ffff880088977000) 00010000:00010000:2.0:1716999790.822681:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.822683:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8188 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x3faa3c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822687:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8188 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x3faa3c56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.822706:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc817a lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662df expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.822713:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc817a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662df expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.822718:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091831680, rc 0) 00000100:00100000:2.0:1716999790.822759:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787520:12345-192.168.203.3@tcp:101:ps.0 Request processed in 335us (462us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999790.822764:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45932 00000100:00100000:0.0:1716999790.824062:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.824123:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480787648 00000100:00100000:2.0:1716999790.824128:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480787648 00000100:00100000:2.0:1716999790.824156:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45933 00000100:00100000:2.0:1716999790.824161:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787648:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:2.0:1716999790.824170:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.824179:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc818f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662e6 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.824234:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc8196 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824242:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc8196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824249:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc8196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824258:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc819d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xc63529be bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824263:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc819d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xc63529be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824267:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc819d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xc63529be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824296:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc8196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824300:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc8196 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824305:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc8196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824309:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.824311:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc8196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824317:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc8196 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824324:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:2.0:1716999790.824326:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.824328:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc8196 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824332:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc8196 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824340:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc819d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xc63529be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824344:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc819d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xc63529be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824349:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc819d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xc63529be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824352:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.824354:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc819d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xc63529be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824357:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc819d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xc63529be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824361:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0xc63529be (ffff880088977900) 00010000:00010000:2.0:1716999790.824364:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.824365:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc819d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xc63529be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824369:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc819d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xc63529be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.824384:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc818f lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662e6 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.824389:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc818f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662e6 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.824395:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091830480, rc 0) 00000100:00100000:2.0:1716999790.824421:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787648:12345-192.168.203.3@tcp:101:ps.0 Request processed in 260us (361us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999790.824426:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45933 00000100:00100000:0.0:1716999790.825692:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.825738:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480787776 00000100:00100000:2.0:1716999790.825744:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480787776 00000100:00100000:2.0:1716999790.825776:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45934 00000100:00100000:2.0:1716999790.825782:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787776:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:2.0:1716999790.825790:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.825811:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc81a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662ed expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.825859:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc81ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825868:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc81ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825894:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc81ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825905:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc81b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x9d487d0a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825911:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc81b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x9d487d0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825916:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc81b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x9d487d0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825944:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc81ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825949:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc81ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825953:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc81ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825958:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.825960:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc81ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825965:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc81ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825973:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:2.0:1716999790.825975:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.825977:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc81ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825982:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc81ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825989:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc81b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x9d487d0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825993:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc81b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x9d487d0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.825997:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc81b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x9d487d0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.826001:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.826003:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc81b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x9d487d0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.826006:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc81b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x9d487d0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.826010:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x9d487d0a (ffff880088977200) 00010000:00010000:2.0:1716999790.826011:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.826012:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc81b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x9d487d0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.826015:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc81b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x9d487d0a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.826028:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc81a4 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662ed expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.826032:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc81a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662ed expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.826035:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091833600, rc 0) 00000100:00100000:2.0:1716999790.826062:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787776:12345-192.168.203.3@tcp:101:ps.0 Request processed in 279us (372us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999790.826067:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45934 00000100:00100000:0.0:1716999790.827692:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.827727:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480787904 00000100:00100000:2.0:1716999790.827732:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480787904 00000100:00100000:2.0:1716999790.827750:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45935 00000100:00100000:2.0:1716999790.827755:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787904:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:2.0:1716999790.827763:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.827771:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc81b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662f4 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.827844:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc81c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827852:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc81c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827857:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc81c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827865:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc81c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xef60c19f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827868:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc81c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xef60c19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827872:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc81c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xef60c19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827917:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc81c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827922:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc81c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827926:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc81c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827930:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.827932:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc81c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827937:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc81c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827945:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:2.0:1716999790.827946:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.827949:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc81c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827952:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc81c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827959:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc81c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xef60c19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827963:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc81c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xef60c19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827967:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc81c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xef60c19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827971:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.827973:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc81c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xef60c19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827976:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc81c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0xef60c19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827982:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0xef60c19f (ffff880088977300) 00010000:00010000:2.0:1716999790.827983:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.827985:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc81c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xef60c19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.827988:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc81c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0xef60c19f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.828007:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc81b9 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662f4 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.828013:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc81b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662f4 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.828018:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091833180, rc 0) 00000100:00100000:2.0:1716999790.828040:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480787904:12345-192.168.203.3@tcp:101:ps.0 Request processed in 284us (350us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999790.828045:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45935 00000100:00100000:0.0:1716999790.829241:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.829284:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788032 00000100:00100000:2.0:1716999790.829292:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788032 00000100:00100000:2.0:1716999790.829333:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45936 00000100:00100000:2.0:1716999790.829338:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480788032:12345-192.168.203.3@tcp:101:ps.0 00010000:00010000:2.0:1716999790.829347:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.829355:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc81ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f662fb expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.829400:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc81d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829411:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc81d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829417:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc81d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829426:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc81dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x8246a988 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829430:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc81dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8246a988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829435:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc81dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8246a988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829463:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc81d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829468:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc81d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829473:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc81d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829477:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.829479:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc81d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829484:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc81d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829491:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:2.0:1716999790.829493:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.829496:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc81d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829500:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc81d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829508:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc81dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8246a988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829512:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc81dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8246a988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829516:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc81dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8246a988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829519:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.829521:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc81dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8246a988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829524:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc81dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x8246a988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829528:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x8246a988 (ffff880088977e00) 00010000:00010000:2.0:1716999790.829530:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.829531:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc81dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x8246a988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829534:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc81dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x8246a988 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.829550:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc81ce lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662fb expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.829556:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc81ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f662fb expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.829562:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091830b40, rc 0) 00000100:00100000:2.0:1716999790.829594:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11578:x1800404480788032:12345-192.168.203.3@tcp:101:ps.0 Request processed in 255us (355us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999790.829599:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45936 00000100:00100000:0.0:1716999790.845338:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.845442:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788096 00000100:00100000:2.0:1716999790.845450:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788096 00000100:00100000:2.0:1716999790.845500:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45937 00000100:00100000:2.0:1716999790.845506:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+554:11392:x1800404480788096:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1716999790.845522:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.845536:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc81e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66302 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.845581:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc81ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845591:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc81ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845599:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc81ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845609:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc81f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845614:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc81f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845619:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc81f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845763:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc81f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845769:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc81f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845781:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc81f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:2.0:1716999790.845829:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6ac:0x0]: returning size 11776 00000004:00200000:2.0:1716999790.845833:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999790.845846:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc81f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845854:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc81ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845858:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc81ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845863:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc81ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845868:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.845871:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc81ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845875:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc81ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845911:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099d1b100) 00010000:00010000:2.0:1716999790.845913:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.845916:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc81ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845921:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc81ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845946:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc81f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845951:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc81f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845956:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc81f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845959:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918306c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.845962:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc81f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845966:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc81f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845972:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7bcb6391 (ffff880088977600) 00010000:00010000:2.0:1716999790.845974:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.845976:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc81f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.845980:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc81f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.846000:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc81e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66302 expref: 556 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.846052:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc81f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66302 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.846064:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:2.0:1716999790.846065:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1716999790.846067:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091833cc0, rc 0) 00000100:00100000:2.0:1716999790.846114:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+555:11392:x1800404480788096:12345-192.168.203.3@tcp:101:bash.0 Request processed in 608us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.846120:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45937 00000100:00100000:0.0:1716999790.849019:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.849302:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788160 00000100:00100000:2.0:1716999790.849309:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788160 00000100:00100000:2.0:1716999790.849338:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45938 00000100:00100000:2.0:1716999790.849344:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+555:11392:x1800404480788160:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:2.0:1716999790.849358:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.849371:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc81ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66309 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.849412:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc8206 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849422:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc8206 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849430:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc8206 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849440:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc820d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x6d72 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849446:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc820d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x6d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849451:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc820d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x6d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849505:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc8206 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849510:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc8206 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849515:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc8206 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849520:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.849523:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc8206 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849528:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc8206 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849536:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:2.0:1716999790.849539:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.849541:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc8206 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849546:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc8206 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849553:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc820d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x6d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849557:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc820d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x6d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849561:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc820d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x6d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849565:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.849567:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc820d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x6d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849572:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc820d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x6d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849577:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x6d72 (ffff880088977400) 00010000:00010000:2.0:1716999790.849578:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.849581:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc820d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x6d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849585:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc820d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x6d72 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.849613:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc81ff lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66309 expref: 556 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.849620:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc81ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66309 expref: 556 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.849627:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091830d80, rc 0) 00000100:00100000:2.0:1716999790.850299:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+555:11392:x1800404480788160:12345-192.168.203.3@tcp:101:bash.0 Request processed in 952us (1283us total) trans 0 rc 301/301 00000100:00100000:2.0:1716999790.850306:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45938 00000100:00100000:0.0:1716999790.853771:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.853913:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788224 00000100:00100000:3.0:1716999790.853921:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788224 00000100:00100000:3.0:1716999790.854050:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45939 00000100:00100000:3.0:1716999790.854056:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+555:11584:x1800404480788224:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:3.0:1716999790.854072:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.854088:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8214 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66310 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.854132:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc821b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854143:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc821b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854151:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc821b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854164:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8222 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854169:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854173:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854256:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8229 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854261:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854266:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:3.0:1716999790.854297:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6b3:0x0]: returning size 11776 00000004:00200000:3.0:1716999790.854299:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999790.854310:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8229 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854316:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc821b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854321:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc821b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854326:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc821b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854330:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.854333:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc821b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854339:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc821b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854347:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:3.0:1716999790.854350:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.854353:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc821b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854358:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc821b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854382:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854387:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8222 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854391:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854394:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.854396:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854400:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854405:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x65dce0d1 (ffff8800a5c6e100) 00010000:00010000:3.0:1716999790.854407:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.854409:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8222 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854413:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8222 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.854434:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8214 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66310 expref: 557 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.854442:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8229 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66310 expref: 556 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.854448:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:3.0:1716999790.854449:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1716999790.854451:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c51680, rc 0) 00000100:00100000:3.0:1716999790.854491:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+556:11584:x1800404480788224:12345-192.168.203.3@tcp:101:rm.0 Request processed in 435us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.854497:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45939 00000100:00100000:0.0:1716999790.855782:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.855830:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.855898:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788352 00000100:00100000:3.0:1716999790.855904:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788352 00000100:00100000:1.0:1716999790.855909:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788416 00000100:00100000:1.0:1716999790.855914:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788416 00000100:00100000:3.0:1716999790.855964:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45940 00000100:00100000:3.0:1716999790.855970:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11584:x1800404480788352:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:3.0:1716999790.855981:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.855990:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8230 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66317 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999790.856038:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45941 00000100:00100000:1.0:1716999790.856043:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+558:11585:x1800404480788416:12345-192.168.203.3@tcp:501:chlg_load_threa.0 00000004:00200000:3.0:1716999790.856057:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6b3:0x0]: returning size 11776 00000100:00100000:1.0:1716999790.856136:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480788416:12345-192.168.203.3@tcp:501:chlg_load_threa.0 Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.856142:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45941 00010000:00010000:3.0:1716999790.856145:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8230 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66317 expref: 559 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.856152:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8230 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66317 expref: 558 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.856164:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c52f40, rc 0) 00000100:00100000:3.0:1716999790.856264:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11584:x1800404480788352:12345-192.168.203.3@tcp:101:rm.0 Request processed in 293us (482us total) trans 4294986587 rc 301/301 00000100:00100000:3.0:1716999790.856270:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45940 00000100:00100000:0.0:1716999790.857436:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.857488:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788480 00000100:00100000:3.0:1716999790.857493:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788480 00000100:00100000:3.0:1716999790.857971:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45942 00000100:00100000:3.0:1716999790.857977:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480788480:12345-192.168.203.3@tcp:503:chlg_load_threa.0 00000100:00100000:3.0:1716999790.858198:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480788480:12345-192.168.203.3@tcp:503:chlg_load_threa.0 Request processed in 219us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.858206:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45942 00000100:00100000:0.0:1716999790.858242:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.858291:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788544 00000100:00100000:3.0:1716999790.858295:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788544 00000100:00100000:3.0:1716999790.858325:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9412 00000100:00100000:3.0:1716999790.858330:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11584:x1800404480788544:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:2.0:1716999790.859102:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.859513:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788608 00000100:00100000:3.0:1716999790.859518:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788608 00000100:00100000:3.0:1716999790.859543:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45943 00000100:00100000:3.0:1716999790.859546:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480788608:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999790.859665:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480788608:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 116us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.859671:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45943 00000100:00100000:3.0:1716999790.860663:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11584:x1800404480788544:12345-192.168.203.3@tcp:37:rm.0 Request processed in 2331us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.860673:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9412 00000100:00100000:0.0:1716999790.860834:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.860982:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788672 00000100:00100000:3.0:1716999790.860986:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788672 00000100:00100000:3.0:1716999790.861015:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45944 00000100:00100000:3.0:1716999790.861020:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480788672:12345-192.168.203.3@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1716999790.861053:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480788672:12345-192.168.203.3@tcp:501:chlg_load_threa.0 Request processed in 33us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.861058:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45944 00000100:00100000:0.0:1716999790.862590:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.862630:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.862696:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788736 00000100:00100000:2.0:1716999790.862701:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788736 00000100:00100000:2.0:1716999790.862722:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45945 00000100:00100000:2.0:1716999790.862727:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480788736:12345-192.168.203.3@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1716999790.862836:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480788736:12345-192.168.203.3@tcp:503:chlg_load_threa.0 Request processed in 107us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.862842:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45945 00000100:00100000:3.0:1716999790.862895:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788864 00000100:00100000:3.0:1716999790.862898:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788864 00000100:00100000:3.0:1716999790.862914:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9413 00000100:00100000:3.0:1716999790.862918:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11584:x1800404480788864:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999790.863209:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+558:11584:x1800404480788864:12345-192.168.203.3@tcp:35:rm.0 Request processed in 289us (578us total) trans 4294986588 rc 0/0 00000100:00100000:3.0:1716999790.863215:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9413 00000100:00100000:0.0:1716999790.864396:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.864427:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.864443:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480788992 00000100:00100000:2.0:1716999790.864452:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480788992 00000100:00100000:2.0:1716999790.864470:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789056 00000100:00100000:2.0:1716999790.864472:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789056 00000100:00100000:2.0:1716999790.864485:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45946 00000100:00100000:2.0:1716999790.864490:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+559:11584:x1800404480788992:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:2.0:1716999790.864501:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999790.864514:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc823e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6631e expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999790.864551:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45947 00000100:00100000:0.0:1716999790.864557:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+560:11585:x1800404480789056:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00010000:00010000:2.0:1716999790.864586:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc8245 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.864597:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc8245 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.864605:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc8245 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00200000:2.0:1716999790.864613:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6b3:0x0]: returning size 11776 00000100:00100000:0.0:1716999790.864667:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+561:11585:x1800404480789056:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 109us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.864673:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45947 00010000:00010000:2.0:1716999790.864683:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc823e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6631e expref: 561 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.866311:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc8245 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6631e expref: 560 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.866319:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:2.0:1716999790.866321:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1716999790.866324:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091831200, rc 0) 00000100:00100000:2.0:1716999790.866350:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+560:11584:x1800404480788992:12345-192.168.203.3@tcp:101:rm.0 Request processed in 1860us (1956us total) trans 4294986589 rc 0/0 00000100:00100000:2.0:1716999790.866356:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45946 00000100:00100000:0.0:1716999790.866489:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.866685:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789120 00000100:00100000:2.0:1716999790.866690:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789120 00000100:00100000:2.0:1716999790.866708:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45948 00000100:00100000:2.0:1716999790.866713:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+560:11585:x1800404480789120:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.867373:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+560:11585:x1800404480789120:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 657us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.867380:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45948 00000100:00100000:0.0:1716999790.868538:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.868568:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.868738:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.869130:0:6826:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789248 00000100:00100000:2.0:1716999790.869136:0:6826:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789248 00000100:00100000:3.0:1716999790.869137:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789184 00000100:00100000:3.0:1716999790.869139:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789184 00000100:00100000:2.0:1716999790.869165:0:6826:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:2.0:1716999790.869170:0:6826:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:107d663a-2216-406b-94c6-b2fcb1558728+561:1956:x1800404480789248:12345-192.168.203.3@tcp:63:ll_sa.0 00000100:00100000:3.0:1716999790.869177:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789312 00000100:00100000:3.0:1716999790.869179:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789312 00000100:00100000:3.0:1716999790.869191:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45949 00010000:00010000:2.0:1716999790.869193:0:6826:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1716999790.869194:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+562:11584:x1800404480789184:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:3.0:1716999790.869200:0:11055:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1716999790.869205:0:11055:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc825a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66325 expref: -99 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.869206:0:6826:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8253 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6632c expref: -99 pid: 6826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.869236:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8268 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.869236:0:6826:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc8261 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.869246:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.869246:0:6826:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc8261 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6826 initiator: MDT0 00010000:00010000:3.0:1716999790.869254:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.869254:0:6826:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc8261 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869263:0:6826:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc826f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869268:0:6826:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc826f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869272:0:6826:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc826f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6826 initiator: MDT0 00000004:00200000:3.0:1716999790.869302:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6b5:0x0]: returning size 11776 00000004:00200000:3.0:1716999790.869305:0:11055:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999790.869316:0:11055:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8268 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999790.869330:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc825a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66325 expref: 565 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.869342:0:11055:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8268 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b5:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66325 expref: 564 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.869347:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x0 (ffff880099d1be00) 00010000:00010000:3.0:1716999790.869350:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1716999790.869352:0:11055:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c521c0, rc 0) 00010000:00010000:2.0:1716999790.869355:0:6826:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc8276 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869361:0:6826:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc8276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869365:0:6826:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc8276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6826 initiator: MDT0 00000100:00100000:3.0:1716999790.869379:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+564:11584:x1800404480789184:12345-192.168.203.3@tcp:101:rm.0 Request processed in 184us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.869384:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45949 00000004:00200000:2.0:1716999790.869386:0:6826:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6b4:0x0]: returning size 11776 00000004:00200000:2.0:1716999790.869387:0:6826:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1716999790.869395:0:6826:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc8276 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6826 initiator: MDT0 00000100:00100000:3.0:1716999790.869396:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45950 00000100:00100000:3.0:1716999790.869400:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480789312:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00010000:00010000:2.0:1716999790.869401:0:6826:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc8261 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869405:0:6826:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc8261 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869410:0:6826:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc8261 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869414:0:6826:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.869417:0:6826:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc8261 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869422:0:6826:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc8261 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869430:0:6826:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:2.0:1716999790.869431:0:6826:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.869434:0:6826:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc8261 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869437:0:6826:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832880/0x6d188eabd8dc8261 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869444:0:6826:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc826f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869448:0:6826:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc826f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869452:0:6826:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc826f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869455:0:6826:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.869457:0:6826:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc826f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869462:0:6826:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc826f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869466:0:6826:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x6599e0d1 (ffff880088977200) 00010000:00010000:2.0:1716999790.869468:0:6826:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.869470:0:6826:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc826f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6826 initiator: MDT0 00010000:00010000:2.0:1716999790.869473:0:6826:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830d80/0x6d188eabd8dc826f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6826 initiator: MDT0 00000100:00100000:3.0:1716999790.869481:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480789312:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 80us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.869486:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45950 00010000:00010000:2.0:1716999790.869488:0:6826:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8253 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6632c expref: 564 pid: 6826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.869496:0:6826:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc8276 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6632c expref: 562 pid: 6826 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.869501:0:6826:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x0 (ffff880099d1bf00) 00010000:00010000:2.0:1716999790.869502:0:6826:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1716999790.869504:0:6826:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091832f40, rc 0) 00000100:00100000:2.0:1716999790.869521:0:6826:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e601880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:107d663a-2216-406b-94c6-b2fcb1558728+562:1956:x1800404480789248:12345-192.168.203.3@tcp:63:ll_sa.0 Request processed in 350us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.869526:0:6826:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 15 00000100:00100000:0.0:1716999790.872679:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.873409:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.873482:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789440 00000100:00100000:2.0:1716999790.873489:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789440 00000100:00100000:2.0:1716999790.873530:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9414 00000100:00100000:2.0:1716999790.873536:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+562:11584:x1800404480789440:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:1.0:1716999790.874317:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789376 00000100:00100000:1.0:1716999790.874322:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789376 00000100:00100000:1.0:1716999790.874349:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45951 00000100:00100000:1.0:1716999790.874354:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480789376:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.874492:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480789376:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 136us (1818us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.874499:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45951 00000100:00100000:0.0:1716999790.875928:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.876227:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789504 00000100:00100000:2.0:1716999790.876232:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789504 00000100:00100000:2.0:1716999790.876262:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45952 00000100:00100000:2.0:1716999790.876267:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+564:11585:x1800404480789504:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.876360:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+564:11585:x1800404480789504:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 92us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.876366:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45952 00000100:00100000:3.0:1716999790.878069:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+562:11584:x1800404480789440:12345-192.168.203.3@tcp:37:rm.0 Request processed in 4529us (4657us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.878077:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9414 00000100:00100000:0.0:1716999790.878962:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.879044:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789568 00000100:00100000:1.0:1716999790.879050:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789568 00000100:00100000:1.0:1716999790.879137:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45953 00000100:00100000:1.0:1716999790.879143:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480789568:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.879252:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480789568:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 108us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.879258:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45953 00000100:00100000:0.0:1716999790.880921:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.881049:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.881152:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789632 00000100:00100000:2.0:1716999790.881157:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789632 00000100:00100000:2.0:1716999790.881181:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45954 00000100:00100000:2.0:1716999790.881185:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480789632:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.881282:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480789632:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.881288:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45954 00000100:00100000:3.0:1716999790.881343:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789696 00000100:00100000:3.0:1716999790.881347:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789696 00000100:00100000:3.0:1716999790.881365:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9415 00000100:00100000:3.0:1716999790.881369:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+562:11584:x1800404480789696:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999790.883405:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.883519:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec23c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+562:11584:x1800404480789696:12345-192.168.203.3@tcp:37:rm.0 Request processed in 2146us (2468us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.883528:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9415 00000100:00100000:1.0:1716999790.883543:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789760 00000100:00100000:1.0:1716999790.883548:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789760 00000100:00100000:1.0:1716999790.883580:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45955 00000100:00100000:1.0:1716999790.883585:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480789760:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.883927:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480789760:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 341us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.883934:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45955 00000100:00100000:0.0:1716999790.885574:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.885643:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789824 00000100:00100000:1.0:1716999790.885649:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789824 00000100:00100000:1.0:1716999790.885788:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45956 00000100:00100000:1.0:1716999790.885802:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+562:11584:x1800404480789824:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:1.0:1716999790.885814:0:6823:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999790.885829:0:6823:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc827d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66333 expref: -99 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.885868:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8284 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.885900:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8284 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.885908:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8284 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.885918:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc828b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.885923:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc828b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.885928:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc828b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886007:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc8292 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886014:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc8292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886020:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc8292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000004:00200000:1.0:1716999790.886048:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6fc:0x0]: returning size 11776 00000004:00200000:1.0:1716999790.886050:0:6823:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999790.886061:0:6823:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc8292 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886067:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8284 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886072:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8284 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886076:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886081:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.886083:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8284 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886088:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8284 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886095:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:1.0:1716999790.886097:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.886100:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8284 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886103:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8284 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886125:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc828b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886129:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc828b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886132:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc828b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886135:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.886137:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc828b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886144:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc828b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886149:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x4d50 (ffff8800a6d5f500) 00010000:00010000:1.0:1716999790.886150:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.886152:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc828b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886155:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc828b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.886172:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc827d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66333 expref: 564 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.886179:0:6823:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc8292 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66333 expref: 563 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.886184:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x0 (ffff88012ca38d00) 00010000:00010000:1.0:1716999790.886185:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999790.886187:0:6823:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b33c0, rc 0) 00000100:00100000:1.0:1716999790.886213:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+563:11584:x1800404480789824:12345-192.168.203.3@tcp:101:rm.0 Request processed in 420us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.886218:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45956 00000100:00100000:0.0:1716999790.887041:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.887106:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789888 00000100:00100000:2.0:1716999790.887111:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789888 00000100:00100000:2.0:1716999790.887141:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45957 00000100:00100000:2.0:1716999790.887146:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480789888:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.887241:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480789888:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 94us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.887247:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45957 00000100:00100000:0.0:1716999790.891280:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.891935:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.892133:0:6826:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790080 00000100:00100000:2.0:1716999790.892140:0:6826:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790080 00000100:00100000:3.0:1716999790.892477:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480789952 00000100:00100000:3.0:1716999790.892481:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480789952 00000100:00100000:3.0:1716999790.892502:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45958 00000100:00100000:3.0:1716999790.892508:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+564:11585:x1800404480789952:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999790.892645:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+564:11585:x1800404480789952:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 136us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.892652:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45958 00000100:00100000:1.0:1716999790.892724:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.893091:0:4523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:0.0:1716999790.893097:0:4523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+563:1959:x1800404480790080:12345-192.168.203.3@tcp:63:ll_sa.0 00010000:00010000:0.0:1716999790.893119:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999790.893131:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc8299 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6633a expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.893163:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc82a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893172:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc82a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893180:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc82a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893188:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc82a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893192:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc82a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893197:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc82a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893278:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc82ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893286:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc82ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00000100:00100000:3.0:1716999790.893291:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790016 00010000:00010000:0.0:1716999790.893292:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc82ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000100:00100000:3.0:1716999790.893295:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790016 00000004:00200000:0.0:1716999790.893321:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6f5:0x0]: returning size 11776 00000100:00100000:3.0:1716999790.893322:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9416 00000004:00200000:0.0:1716999790.893323:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:3.0:1716999790.893327:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+565:11584:x1800404480790016:12345-192.168.203.3@tcp:37:rm.0 00000004:00010000:0.0:1716999790.893335:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc82ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893341:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc82a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893345:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc82a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893350:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc82a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893354:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.893357:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc82a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893362:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc82a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893369:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:0.0:1716999790.893371:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.893374:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc82a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893377:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130240/0x6d188eabd8dc82a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893398:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc82a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893403:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc82a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893407:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc82a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893410:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.893413:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc82a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893416:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc82a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893422:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x44a1a1a7 (ffff88008a83f300) 00010000:00010000:0.0:1716999790.893424:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.893427:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc82a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.893430:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131b00/0x6d188eabd8dc82a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.894533:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131200/0x6d188eabd8dc8299 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6633a expref: 567 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.894545:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc82ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6633a expref: 566 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.894551:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0x0 (ffff8800910ce400) 00010000:00010000:0.0:1716999790.894553:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1716999790.894556:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132880, rc 0) 00010000:00010000:0.0:1716999790.894559:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999790.894567:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc82b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66341 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.894634:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc82bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.894641:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc82bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00000100:00100000:1.0:1716999790.894741:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.894866:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790144 00000100:00100000:2.0:1716999790.894871:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790144 00000100:00100000:2.0:1716999790.894905:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45959 00000100:00100000:2.0:1716999790.894910:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+568:11585:x1800404480790144:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.895026:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+568:11585:x1800404480790144:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 115us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.895033:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45959 00010000:00010000:0.0:1716999790.895093:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc82bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895107:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc82c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895113:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc82c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895119:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc82c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895182:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc82ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895190:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc82ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895196:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc82ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:0.0:1716999790.895221:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6cb:0x0]: returning size 11776 00000004:00200000:0.0:1716999790.895224:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999790.895235:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc82ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895241:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc82bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895245:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc82bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895249:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc82bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895253:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.895255:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc82bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895261:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc82bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895268:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:0.0:1716999790.895269:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.895272:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc82bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895275:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131d40/0x6d188eabd8dc82bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895283:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc82c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895288:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc82c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895291:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc82c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895298:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1333c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.895300:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc82c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895304:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc82c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895309:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x45435891 (ffff88008a83f400) 00010000:00010000:0.0:1716999790.895311:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.895313:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc82c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895316:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1333c0/0x6d188eabd8dc82c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895333:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131f80/0x6d188eabd8dc82b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66341 expref: 568 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.895340:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc82ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66341 expref: 567 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.895345:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x0 (ffff8800a660c800) 00010000:00010000:0.0:1716999790.895347:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1716999790.895349:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c1321c0, rc 0) 00010000:00010000:0.0:1716999790.895352:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999790.895357:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc82d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66348 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.895371:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc82d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895380:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc82d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895385:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc82d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895392:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc82df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895396:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc82df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895400:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc82df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895441:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc82e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x730:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895447:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc82e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895452:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc82e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:0.0:1716999790.895473:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x730:0x0]: returning size 11776 00000004:00200000:0.0:1716999790.895475:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999790.895481:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc82e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895486:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc82d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895489:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc82d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895496:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc82d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895500:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c131440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.895502:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc82d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895506:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc82d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895511:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:0.0:1716999790.895513:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.895515:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc82d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895519:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131440/0x6d188eabd8dc82d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895525:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc82df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895529:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc82df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895533:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc82df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895537:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.895538:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc82df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895543:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc82df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895548:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x45439694 (ffff88008a83f200) 00010000:00010000:0.0:1716999790.895549:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.895551:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc82df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895555:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132640/0x6d188eabd8dc82df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895570:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c131680/0x6d188eabd8dc82d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66348 expref: 569 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.895577:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc82e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x730:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66348 expref: 568 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.895581:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x730:0x0].0x0 (ffff880131c40500) 00010000:00010000:0.0:1716999790.895583:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1716999790.895585:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133840, rc 0) 00010000:00010000:0.0:1716999790.895587:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999790.895592:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc82ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6634f expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.895604:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc82f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895610:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc82f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895614:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc82f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895621:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc82fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895626:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc82fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895630:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc82fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895670:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc8302 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895676:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc8302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895681:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc8302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:0.0:1716999790.895701:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x704:0x0]: returning size 12800 00000004:00200000:0.0:1716999790.895703:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999790.895709:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc8302 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895715:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc82f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895719:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc82f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895724:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc82f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895728:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.895730:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc82f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895734:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc82f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895740:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:0.0:1716999790.895742:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.895744:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc82f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895748:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130000/0x6d188eabd8dc82f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895755:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc82fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895760:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc82fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895764:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc82fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895767:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.895769:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc82fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895774:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc82fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895778:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x41aa9094 (ffff88008a83f700) 00010000:00010000:0.0:1716999790.895780:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.895782:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc82fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895785:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133cc0/0x6d188eabd8dc82fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895812:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130480/0x6d188eabd8dc82ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6634f expref: 570 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.895821:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc8302 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x704:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6634f expref: 569 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.895825:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:0.0:1716999790.895827:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1716999790.895829:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c133180, rc 0) 00010000:00010000:0.0:1716999790.895832:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999790.895837:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc8309 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66356 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.895850:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc8310 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895855:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc8310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895860:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc8310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895867:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc8317 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895872:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc8317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895877:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc8317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895939:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc831e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895946:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc831e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895951:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc831e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:0.0:1716999790.895972:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6dd:0x0]: returning size 12800 00000004:00200000:0.0:1716999790.895974:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999790.895981:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc831e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895987:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc8310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895991:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc8310 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895995:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc8310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.895998:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.896000:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc8310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896005:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc8310 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896010:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:0.0:1716999790.896012:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.896014:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc8310 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896017:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132ac0/0x6d188eabd8dc8310 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896024:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc8317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896029:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc8317 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896032:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc8317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896036:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c130d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.896038:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc8317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896042:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc8317 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896046:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x45524f8f (ffff88008a83f600) 00010000:00010000:0.0:1716999790.896048:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.896049:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc8317 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896053:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130d80/0x6d188eabd8dc8317 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896066:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130900/0x6d188eabd8dc8309 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66356 expref: 571 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.896072:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc831e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66356 expref: 570 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.896077:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:0.0:1716999790.896078:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1716999790.896080:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c130fc0, rc 0) 00010000:00010000:0.0:1716999790.896083:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999790.896088:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc8325 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6635d expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.896100:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc832c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896105:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc832c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896109:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc832c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896123:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc8333 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896128:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc8333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896132:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc8333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896170:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc833a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896175:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc833a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896180:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc833a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:0.0:1716999790.896198:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6c3:0x0]: returning size 11776 00000004:00200000:0.0:1716999790.896200:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999790.896206:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc833a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896211:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc832c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896216:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc832c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896220:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc832c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896224:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c132f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.896226:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc832c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896230:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc832c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896236:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:0.0:1716999790.896237:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.896239:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc832c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896243:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132f40/0x6d188eabd8dc832c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896250:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc8333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896254:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc8333 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896259:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc8333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896262:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.896264:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc8333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896271:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc8333 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896276:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x44524f57 (ffff88008a83fb00) 00010000:00010000:0.0:1716999790.896277:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.896279:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc8333 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896283:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133a80/0x6d188eabd8dc8333 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896296:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130b40/0x6d188eabd8dc8325 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6635d expref: 572 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.896303:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc833a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6635d expref: 571 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.896308:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:0.0:1716999790.896309:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1716999790.896311:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132d00, rc 0) 00010000:00010000:0.0:1716999790.896314:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999790.896319:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc8341 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66364 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.896332:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc8348 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896337:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc8348 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896342:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc8348 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896349:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc834f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896354:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc834f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896358:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc834f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896397:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc8356 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896403:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc8356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896408:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc8356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:0.0:1716999790.896426:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6d1:0x0]: returning size 11776 00000004:00200000:0.0:1716999790.896428:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999790.896434:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc8356 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896438:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc8348 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896442:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc8348 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896446:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc8348 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896450:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c133600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.896452:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc8348 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896457:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc8348 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896462:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:0.0:1716999790.896464:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.896466:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc8348 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896469:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133600/0x6d188eabd8dc8348 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896476:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc834f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896480:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc834f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896484:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc834f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896487:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff88009c1306c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.896489:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc834f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896493:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc834f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896497:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x5052ab9e (ffff88008a83f100) 00010000:00010000:0.0:1716999790.896499:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.896500:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc834f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896504:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1306c0/0x6d188eabd8dc834f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896518:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1318c0/0x6d188eabd8dc8341 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66364 expref: 573 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.896525:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc8356 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66364 expref: 572 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.896530:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:0.0:1716999790.896531:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1716999790.896533:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c132400, rc 0) 00010000:00010000:0.0:1716999790.896536:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1716999790.896541:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68480/0x6d188eabd8dc835d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6636b expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.896553:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a1c0/0x6d188eabd8dc8364 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896559:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a1c0/0x6d188eabd8dc8364 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896564:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a1c0/0x6d188eabd8dc8364 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896571:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc836b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896575:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc836b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896580:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc836b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896624:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69d40/0x6d188eabd8dc8372 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x734:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896629:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69d40/0x6d188eabd8dc8372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x734:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896634:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69d40/0x6d188eabd8dc8372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x734:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:0.0:1716999790.896655:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x734:0x0]: returning size 11776 00000004:00200000:0.0:1716999790.896657:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1716999790.896663:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69d40/0x6d188eabd8dc8372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x734:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896668:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a1c0/0x6d188eabd8dc8364 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896672:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a1c0/0x6d188eabd8dc8364 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896677:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a1c0/0x6d188eabd8dc8364 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896680:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6a1c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.896682:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a1c0/0x6d188eabd8dc8364 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896686:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a1c0/0x6d188eabd8dc8364 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896692:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:0.0:1716999790.896693:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.896696:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a1c0/0x6d188eabd8dc8364 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896700:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a1c0/0x6d188eabd8dc8364 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896719:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc836b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896723:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc836b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896727:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc836b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896731:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6b840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.896732:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc836b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896736:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc836b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896742:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x44454553 (ffff88008a83f500) 00010000:00010000:0.0:1716999790.896743:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.896745:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc836b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896749:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b840/0x6d188eabd8dc836b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:0.0:1716999790.896774:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68480/0x6d188eabd8dc835d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6636b expref: 574 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.896788:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69d40/0x6d188eabd8dc8372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x734:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6636b expref: 573 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.896809:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x734:0x0].0x0 (ffff8800b4877400) 00010000:00010000:0.0:1716999790.896810:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1716999790.896812:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880132e69d40, rc 0) 00000100:00100000:0.0:1716999790.896843:0:4523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+573:1959:x1800404480790080:12345-192.168.203.3@tcp:63:ll_sa.0 Request processed in 3746us (5569us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.896850:0:4523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 16 00000100:00100000:3.0:1716999790.897447:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+571:11584:x1800404480790016:12345-192.168.203.3@tcp:37:rm.0 Request processed in 4117us (4721us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.897455:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9416 00000100:00100000:0.0:1716999790.899567:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.899614:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.899640:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790272 00000100:00100000:3.0:1716999790.899648:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790272 00000100:00100000:2.0:1716999790.899853:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790336 00000100:00100000:2.0:1716999790.899858:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790336 00000100:00100000:2.0:1716999790.899908:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45960 00000100:00100000:2.0:1716999790.899914:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+572:11585:x1800404480790336:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999790.899975:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9417 00000100:00100000:3.0:1716999790.899981:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+572:11584:x1800404480790272:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:2.0:1716999790.900204:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+572:11585:x1800404480790336:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 289us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.900213:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45960 00000100:00100000:3.0:1716999790.900352:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+572:11584:x1800404480790272:12345-192.168.203.3@tcp:35:rm.0 Request processed in 370us (788us total) trans 4294986590 rc 0/0 00000100:00100000:3.0:1716999790.900359:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9417 00000100:00100000:1.0:1716999790.902584:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.902990:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790400 00000100:00100000:2.0:1716999790.902996:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790400 00000100:00100000:2.0:1716999790.903022:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45961 00000100:00100000:2.0:1716999790.903027:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+572:11585:x1800404480790400:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.903139:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+572:11585:x1800404480790400:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 111us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.903145:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45961 00000100:00100000:1.0:1716999790.903228:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.903342:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790528 00000100:00100000:0.0:1716999790.903345:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790528 00000100:00100000:0.0:1716999790.903369:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45962 00000100:00100000:0.0:1716999790.903373:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+572:11584:x1800404480790528:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:0.0:1716999790.903399:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 7 locks, starting at 0 00010000:00010000:0.0:1716999790.903417:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a880/0x6d188eabd8d7168c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6fc:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc23 expref: 572 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.903443:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc8292 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66333 expref: 571 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.903451:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0900/0x6d188eabd8d7e663 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f500fd expref: 570 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.903460:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69200/0x6d188eabd8d7163f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fc:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc0e expref: 569 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.903475:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x0 (ffff88012ca38d00) 00010000:00010000:0.0:1716999790.903485:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb9a640/0x6d188eabd8d7a5db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ec04 expref: 568 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.903494:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb98000/0x6d188eabd8d79549 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4e6d9 expref: 567 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.903502:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1200/0x6d188eabd8d72a7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c49d expref: 566 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999790.903508:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:0.0:1716999790.903510:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999790.903526:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68b40/0x6d188eabd8dc8379 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.903535:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68b40/0x6d188eabd8dc8379 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.903541:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68b40/0x6d188eabd8dc8379 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.903549:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68240/0x6d188eabd8dc8380 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.903553:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68240/0x6d188eabd8dc8380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.903557:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68240/0x6d188eabd8dc8380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.903632:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6ba80/0x6d188eabd8dc8387 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6fc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.903638:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6ba80/0x6d188eabd8dc8387 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.903643:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6ba80/0x6d188eabd8dc8387 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:0.0:1716999790.904426:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].51, 176 off16728 00000004:00200000:0.0:1716999790.904473:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6fc:0x0]: returning size 11776 00010000:00010000:0.0:1716999790.904484:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6ba80/0x6d188eabd8dc8387 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904490:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6ba80/0x6d188eabd8dc8387 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904495:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6ba80/0x6d188eabd8dc8387 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904499:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6ba80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.904501:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6ba80/0x6d188eabd8dc8387 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904506:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6ba80/0x6d188eabd8dc8387 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904512:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fc:0x0].0x0 (ffff88008a83fa00) 00010000:00010000:0.0:1716999790.904514:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999790.904516:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6ba80/0x6d188eabd8dc8387 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904520:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6ba80/0x6d188eabd8dc8387 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6fc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904550:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68b40/0x6d188eabd8dc8379 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904554:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68b40/0x6d188eabd8dc8379 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904558:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68b40/0x6d188eabd8dc8379 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904562:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e68b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.904563:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68b40/0x6d188eabd8dc8379 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904567:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68b40/0x6d188eabd8dc8379 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904571:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:0.0:1716999790.904573:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.904574:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68b40/0x6d188eabd8dc8379 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999790.904578:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68b40/0x6d188eabd8dc8379 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999790.904589:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88009a6a0700 reply state ffff88012bd98000 transno 4294986591 ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68240/0x6d188eabd8dc8380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999790.904594:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999790.904636:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+567:11584:x1800404480790528:12345-192.168.203.3@tcp:36:rm.0 Request processed in 1261us (1407us total) trans 4294986591 rc 0/0 00000100:00100000:0.0:1716999790.904642:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45962 00000100:00100000:0.0:1716999790.906564:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.906677:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790592 00000100:00100000:2.0:1716999790.906684:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790592 00000100:00100000:2.0:1716999790.906709:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45963 00000100:00100000:2.0:1716999790.906715:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+567:11585:x1800404480790592:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00010000:00010000:1.0:1716999790.906802:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68240/0x6d188eabd8dc8380 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.906813:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68240/0x6d188eabd8dc8380 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.906818:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68240/0x6d188eabd8dc8380 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.906822:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e68240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.906824:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68240/0x6d188eabd8dc8380 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.906830:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68240/0x6d188eabd8dc8380 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.906840:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x4d50 (ffff88008a83ff00) 00010000:00010000:1.0:1716999790.906842:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.906844:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68240/0x6d188eabd8dc8380 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999790.906848:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68240/0x6d188eabd8dc8380 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999790.907091:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+566:11585:x1800404480790592:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 311us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.907099:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45963 00000100:00100000:1.0:1716999790.907270:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.907946:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790656 00000100:00100000:3.0:1716999790.907951:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790656 00000100:00100000:3.0:1716999790.907983:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9418 00000100:00100000:3.0:1716999790.907988:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+566:11584:x1800404480790656:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999790.908792:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.909420:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790720 00000100:00100000:2.0:1716999790.909424:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790720 00000100:00100000:2.0:1716999790.909451:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45964 00000100:00100000:2.0:1716999790.909457:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+568:11585:x1800404480790720:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.909556:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+568:11585:x1800404480790720:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 98us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.909563:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45964 00000100:00100000:0.0:1716999790.910711:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.910748:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790784 00000100:00100000:1.0:1716999790.910753:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790784 00000100:00100000:1.0:1716999790.910772:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45965 00000100:00100000:1.0:1716999790.910777:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+567:11585:x1800404480790784:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.910877:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+567:11585:x1800404480790784:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 98us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.910907:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45965 00000100:00100000:3.0:1716999790.911148:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+566:11584:x1800404480790656:12345-192.168.203.3@tcp:37:rm.0 Request processed in 3158us (3877us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.911155:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9418 00000100:00100000:0.0:1716999790.913083:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.913122:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.913263:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790912 00000100:00100000:3.0:1716999790.913269:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790912 00000100:00100000:3.0:1716999790.913306:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9419 00000100:00100000:3.0:1716999790.913312:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+566:11584:x1800404480790912:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:1.0:1716999790.913566:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480790976 00000100:00100000:1.0:1716999790.913570:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480790976 00000100:00100000:1.0:1716999790.913670:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45966 00000100:00100000:1.0:1716999790.913675:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+568:11585:x1800404480790976:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.913769:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+568:11585:x1800404480790976:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 93us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.913775:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45966 00000100:00100000:0.0:1716999790.914785:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.914848:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+567:11584:x1800404480790912:12345-192.168.203.3@tcp:35:rm.0 Request processed in 1535us (1766us total) trans 4294986592 rc 0/0 00000100:00100000:3.0:1716999790.914856:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9419 00000100:00100000:2.0:1716999790.914894:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480791040 00000100:00100000:2.0:1716999790.914899:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480791040 00000100:00100000:2.0:1716999790.914928:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45967 00000100:00100000:2.0:1716999790.914933:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+567:11585:x1800404480791040:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.915015:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+567:11585:x1800404480791040:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 82us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.915020:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45967 00000100:00100000:0.0:1716999790.916563:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.916599:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.916647:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480791104 00000100:00100000:3.0:1716999790.916653:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480791104 00000100:00100000:1.0:1716999790.916668:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480791232 00000100:00100000:1.0:1716999790.916672:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480791232 00000100:00100000:3.0:1716999790.916718:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45968 00000100:00100000:3.0:1716999790.916724:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+568:11585:x1800404480791104:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.916724:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45969 00000100:00100000:1.0:1716999790.916729:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+568:11584:x1800404480791232:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:1.0:1716999790.916764:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999790.916783:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f26400/0x6d188eabd8d71408 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6f5:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb27 expref: 568 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.916816:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132880/0x6d188eabd8dc82ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6633a expref: 567 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.916828:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8d7e169 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ff6e expref: 566 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.916837:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6ad00/0x6d188eabd8d713d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb12 expref: 565 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999790.916858:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0x0 (ffff8800910ce400) 00000100:00100000:3.0:1716999790.916872:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+564:11585:x1800404480791104:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 147us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.916896:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45968 00010000:00010000:1.0:1716999790.916942:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999790.916963:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc838e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.916976:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc838e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.916984:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc838e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.916993:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8395 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.916997:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917002:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917073:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc839c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6f5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917079:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc839c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917084:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc839c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:1.0:1716999790.917438:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].52, 176 off16904 00000004:00200000:1.0:1716999790.917481:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6f5:0x0]: returning size 11776 00010000:00010000:1.0:1716999790.917493:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc839c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917498:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc839c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917503:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc839c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917510:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.917513:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc839c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917519:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc839c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917526:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f5:0x0].0x0 (ffff8800a6d5f100) 00010000:00010000:1.0:1716999790.917529:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999790.917531:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc839c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917535:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc839c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6f5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917561:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc838e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917566:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc838e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917570:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc838e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917574:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.917576:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc838e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917580:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc838e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917586:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:1.0:1716999790.917588:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.917591:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc838e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.917595:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc838e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:1.0:1716999790.917600:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bc9c00 reply state ffff88009c206000 transno 4294986593 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.917605:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999790.917635:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+565:11584:x1800404480791232:12345-192.168.203.3@tcp:36:rm.0 Request processed in 905us (1035us total) trans 4294986593 rc 0/0 00000100:00100000:1.0:1716999790.917640:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45969 00000100:00100000:0.0:1716999790.919330:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999790.919377:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8395 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.919384:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8395 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.919388:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8395 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.919392:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.919395:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8395 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.919400:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8395 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.919409:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x44a1a1a7 (ffff8800a6d5f400) 00010000:00010000:0.0:1716999790.919411:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.919414:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8395 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.919419:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8395 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.919924:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480791296 00000100:00100000:1.0:1716999790.919931:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480791296 00000100:00100000:1.0:1716999790.919967:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45970 00000100:00100000:1.0:1716999790.919973:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+564:11585:x1800404480791296:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.920093:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+564:11585:x1800404480791296:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 119us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.920099:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45970 00000100:00100000:0.0:1716999790.921380:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.921824:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480791360 00000100:00100000:3.0:1716999790.921829:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480791360 00000100:00100000:3.0:1716999790.921863:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9420 00000100:00100000:3.0:1716999790.921868:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec23850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+564:11584:x1800404480791360:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999790.923223:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.923286:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480791424 00000100:00100000:1.0:1716999790.923290:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480791424 00000100:00100000:1.0:1716999790.923311:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45971 00000100:00100000:1.0:1716999790.923316:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+566:11585:x1800404480791424:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.924148:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+566:11585:x1800404480791424:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 829us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.924155:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45971 00000100:00100000:3.0:1716999790.927045:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec23850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+564:11584:x1800404480791360:12345-192.168.203.3@tcp:37:rm.0 Request processed in 5170us (5659us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.927053:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9420 00000100:00100000:0.0:1716999790.927468:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.927702:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480791488 00000100:00100000:1.0:1716999790.927709:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480791488 00000100:00100000:1.0:1716999790.927742:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45972 00000100:00100000:1.0:1716999790.927748:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+564:11585:x1800404480791488:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.927905:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+564:11585:x1800404480791488:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 157us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.927911:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45972 00000100:00100000:0.0:1716999790.931470:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.931520:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.931830:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480791616 00000100:00100000:3.0:1716999790.931837:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480791616 00000100:00100000:3.0:1716999790.931902:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9421 00000100:00100000:3.0:1716999790.931909:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+564:11584:x1800404480791616:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:1.0:1716999790.932178:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480791680 00000100:00100000:1.0:1716999790.932182:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480791680 00000100:00100000:1.0:1716999790.932212:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45973 00000100:00100000:1.0:1716999790.932217:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+565:11585:x1800404480791680:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.932393:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+565:11585:x1800404480791680:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 173us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.932400:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45973 00000100:00100000:3.0:1716999790.932743:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+565:11584:x1800404480791616:12345-192.168.203.3@tcp:35:rm.0 Request processed in 833us (1279us total) trans 4294986594 rc 0/0 00000100:00100000:3.0:1716999790.932748:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9421 00000100:00100000:0.0:1716999790.936528:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.936830:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.936876:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480791808 00000100:00100000:2.0:1716999790.936901:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480791808 00000100:00100000:2.0:1716999790.936943:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480791872 00000100:00100000:2.0:1716999790.936946:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480791872 00000100:00100000:2.0:1716999790.936964:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45974 00000100:00100000:2.0:1716999790.936969:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+566:11584:x1800404480791808:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:2.0:1716999790.937009:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.937027:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131f8e640/0x6d188eabd8d70624 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6cb:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b55b expref: 566 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.937044:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c1321c0/0x6d188eabd8dc82ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66341 expref: 565 pid: 4523 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999790.937053:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45975 00010000:00010000:2.0:1716999790.937054:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf52f40/0x6d188eabd8d7ba80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f286 expref: 564 pid: 6821 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999790.937059:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+564:11585:x1800404480791872:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00010000:00010000:2.0:1716999790.937062:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c577cc0/0x6d188eabd8d705ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6cb:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b546 expref: 563 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.937069:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x0 (ffff8800a660c800) 00010000:00010000:2.0:1716999790.937078:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.937098:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc83a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937111:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc83a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937119:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc83a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937127:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc83aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937131:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc83aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937135:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc83aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999790.937177:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480791872:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 117us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.937183:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45975 00010000:00010000:2.0:1716999790.937205:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc83b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6cb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937211:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc83b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937302:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc83b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:2.0:1716999790.937670:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].53, 176 off17080 00000004:00200000:2.0:1716999790.937711:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6cb:0x0]: returning size 11776 00010000:00010000:2.0:1716999790.937724:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc83b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937730:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc83b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937735:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc83b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937743:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918306c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.937746:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc83b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937848:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc83b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937858:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6cb:0x0].0x0 (ffff880088977100) 00010000:00010000:2.0:1716999790.937860:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.937863:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc83b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.937867:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918306c0/0x6d188eabd8dc83b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6cb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.940328:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.940679:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480791936 00000100:00100000:3.0:1716999790.940686:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480791936 00000100:00100000:3.0:1716999790.940726:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45976 00000100:00100000:3.0:1716999790.940732:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480791936:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999790.940870:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480791936:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 138us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.940877:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45976 00010000:00010000:3.0:1716999790.940925:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc83a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.940936:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc83a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.940941:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc83a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.940945:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.940948:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc83a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.940953:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc83a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.940962:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:3.0:1716999790.940964:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.940967:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc83a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999790.940970:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832400/0x6d188eabd8dc83a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999790.940977:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880099bcb100 reply state ffff88009c0e6000 transno 4294986595 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc83aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999790.940983:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.941014:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+563:11584:x1800404480791808:12345-192.168.203.3@tcp:36:rm.0 Request processed in 4045us (4492us total) trans 4294986595 rc 0/0 00000100:00100000:3.0:1716999790.941020:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45974 00000100:00100000:0.0:1716999790.944371:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999790.946303:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc83aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.946314:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc83aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.946320:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc83aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.946328:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.946333:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc83aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.946339:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc83aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.946340:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999790.946351:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x45435891 (ffff880088977000) 00010000:00010000:1.0:1716999790.946354:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.946357:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc83aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999790.946361:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831f80/0x6d188eabd8dc83aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.946410:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792000 00000100:00100000:2.0:1716999790.946416:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792000 00000100:00100000:3.0:1716999790.947203:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792064 00000100:00100000:3.0:1716999790.947208:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792064 00000100:00100000:3.0:1716999790.947232:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9422 00000100:00100000:3.0:1716999790.947239:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+564:11584:x1800404480792064:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:2.0:1716999790.948553:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45977 00000100:00100000:2.0:1716999790.948561:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+564:11585:x1800404480792000:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.948714:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+564:11585:x1800404480792000:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 152us (4348us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.948721:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45977 00000100:00100000:0.0:1716999790.952452:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.952496:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792128 00000100:00100000:1.0:1716999790.952503:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792128 00000100:00100000:1.0:1716999790.952546:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45978 00000100:00100000:1.0:1716999790.952552:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480792128:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.952676:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480792128:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 123us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.952683:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45978 00000100:00100000:3.0:1716999790.953850:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+562:11584:x1800404480792064:12345-192.168.203.3@tcp:37:rm.0 Request processed in 6608us (7509us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.953858:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9422 00000100:00100000:0.0:1716999790.955568:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.955639:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792192 00000100:00100000:2.0:1716999790.955646:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792192 00000100:00100000:2.0:1716999790.955686:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45979 00000100:00100000:2.0:1716999790.955692:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480792192:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.955860:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480792192:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 167us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.955867:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45979 00000100:00100000:0.0:1716999790.957607:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.957654:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.957830:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792320 00000100:00100000:3.0:1716999790.957837:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792320 00000100:00100000:3.0:1716999790.957872:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9423 00000100:00100000:3.0:1716999790.957877:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+562:11584:x1800404480792320:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:2.0:1716999790.957947:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792384 00000100:00100000:2.0:1716999790.957952:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792384 00000100:00100000:2.0:1716999790.957972:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45980 00000100:00100000:2.0:1716999790.957977:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480792384:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.958073:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480792384:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 95us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.958079:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45980 00000100:00100000:3.0:1716999790.959593:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+563:11584:x1800404480792320:12345-192.168.203.3@tcp:35:rm.0 Request processed in 1711us (1986us total) trans 4294986596 rc 0/0 00000100:00100000:3.0:1716999790.959601:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9423 00000100:00100000:0.0:1716999790.960516:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.960597:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792448 00000100:00100000:2.0:1716999790.960604:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792448 00000100:00100000:2.0:1716999790.960628:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45981 00000100:00100000:2.0:1716999790.960633:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480792448:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.960752:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+563:11585:x1800404480792448:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 118us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.960759:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45981 00000100:00100000:0.0:1716999790.961247:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.961406:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792576 00000100:00100000:2.0:1716999790.961410:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792576 00000100:00100000:2.0:1716999790.961719:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45982 00000100:00100000:2.0:1716999790.961725:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+563:11584:x1800404480792576:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:2.0:1716999790.961756:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.961776:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c2640/0x6d188eabd8d726ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x730:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c338 expref: 563 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.961814:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133840/0x6d188eabd8dc82e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x730:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66348 expref: 562 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.961826:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8d81326 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x730:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50fba expref: 561 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.961840:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ec900/0x6d188eabd8d726c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x730:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c323 expref: 560 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.961849:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x730:0x0].0x0 (ffff880131c40500) 00010000:00010000:2.0:1716999790.961856:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.961876:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc83b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.961903:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc83b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.961911:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc83b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.961922:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc83bf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.961927:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc83bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.961932:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc83bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962008:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc83c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x730:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962014:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc83c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x730:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962020:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc83c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x730:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:2.0:1716999790.962389:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].54, 176 off17256 00000004:00200000:2.0:1716999790.962434:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x730:0x0]: returning size 11776 00010000:00010000:2.0:1716999790.962445:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc83c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x730:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962450:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc83c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x730:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962455:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc83c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x730:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962461:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.962464:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc83c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x730:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962469:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc83c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x730:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962476:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x730:0x0].0x0 (ffff880088977f00) 00010000:00010000:2.0:1716999790.962478:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.962481:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc83c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x730:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962485:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832640/0x6d188eabd8dc83c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x730:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962514:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc83b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962518:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc83b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962523:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc83b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962527:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.962530:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc83b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962534:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc83b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962539:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:2.0:1716999790.962541:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.962543:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc83b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999790.962547:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830000/0x6d188eabd8dc83b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:2.0:1716999790.962553:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131d5c700 reply state ffff88009c0e7000 transno 4294986597 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc83bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999790.962559:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.962598:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+561:11584:x1800404480792576:12345-192.168.203.3@tcp:36:rm.0 Request processed in 872us (1351us total) trans 4294986597 rc 0/0 00000100:00100000:2.0:1716999790.962604:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45982 00000100:00100000:0.0:1716999790.963930:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.964873:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792640 00000100:00100000:3.0:1716999790.964898:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792640 00000100:00100000:3.0:1716999790.965072:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45983 00000100:00100000:3.0:1716999790.965079:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+561:11585:x1800404480792640:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999790.965231:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+561:11585:x1800404480792640:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 151us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.965238:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45983 00010000:00010000:0.0:1716999790.965531:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc83bf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.965540:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc83bf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.965545:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc83bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.965550:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830b40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999790.965553:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc83bf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.965558:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc83bf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.965569:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x45439694 (ffff880088977d00) 00010000:00010000:0.0:1716999790.965572:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999790.965575:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc83bf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:0.0:1716999790.965582:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830b40/0x6d188eabd8dc83bf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999790.967238:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.967310:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.970872:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792704 00000100:00100000:3.0:1716999790.970909:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792704 00000100:00100000:3.0:1716999790.970959:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9424 00000100:00100000:3.0:1716999790.970965:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+560:11584:x1800404480792704:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:2.0:1716999790.971691:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792768 00000100:00100000:2.0:1716999790.971697:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792768 00000100:00100000:2.0:1716999790.971720:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45984 00000100:00100000:2.0:1716999790.971725:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480792768:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.971839:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480792768:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 112us (4528us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.971846:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45984 00000100:00100000:0.0:1716999790.973459:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.974049:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+560:11584:x1800404480792704:12345-192.168.203.3@tcp:37:rm.0 Request processed in 3082us (6812us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.974057:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9424 00000100:00100000:2.0:1716999790.974117:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792832 00000100:00100000:2.0:1716999790.974122:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792832 00000100:00100000:2.0:1716999790.974142:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45985 00000100:00100000:2.0:1716999790.974147:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+560:11585:x1800404480792832:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.974256:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+560:11585:x1800404480792832:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 108us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.974262:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45985 00000100:00100000:0.0:1716999790.976310:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.976382:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480792896 00000100:00100000:3.0:1716999790.976388:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480792896 00000100:00100000:3.0:1716999790.976422:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45986 00000100:00100000:3.0:1716999790.976427:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+560:11585:x1800404480792896:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999790.976543:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+560:11585:x1800404480792896:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 114us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.976550:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45986 00000100:00100000:0.0:1716999790.977009:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.977064:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793024 00000100:00100000:3.0:1716999790.977067:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793024 00000100:00100000:3.0:1716999790.977090:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9425 00000100:00100000:3.0:1716999790.977094:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+560:11584:x1800404480793024:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999790.977378:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec23450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+561:11584:x1800404480793024:12345-192.168.203.3@tcp:35:rm.0 Request processed in 283us (369us total) trans 4294986598 rc 0/0 00000100:00100000:3.0:1716999790.977384:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9425 00000100:00100000:0.0:1716999790.979763:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.979837:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.979911:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793088 00000100:00100000:2.0:1716999790.979917:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793088 00000100:00100000:2.0:1716999790.979939:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793216 00000100:00100000:2.0:1716999790.979941:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793216 00000100:00100000:2.0:1716999790.979957:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45987 00000100:00100000:2.0:1716999790.979962:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480793088:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.980080:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+562:11585:x1800404480793088:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 117us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.980087:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45987 00000100:00100000:2.0:1716999790.980098:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45988 00000100:00100000:2.0:1716999790.980102:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+561:11584:x1800404480793216:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:2.0:1716999790.980129:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999790.980147:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419eac0/0x6d188eabd8d71956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x704:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd42 expref: 561 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.980165:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c133180/0x6d188eabd8dc8302 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6634f expref: 560 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.980177:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009963dd40/0x6d188eabd8d7ea53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50262 expref: 559 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.980186:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419c6c0/0x6d188eabd8d71925 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x704:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd2d expref: 558 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999790.980193:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff88009a33c100) 00010000:00010000:2.0:1716999790.980201:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999790.980217:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc83cd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980226:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc83cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980233:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc83cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980242:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc83d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980246:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc83d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980251:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc83d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980321:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc83db lrc: 3/0,1 mode: --/EX res: [0x200000401:0x704:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980326:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc83db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x704:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980331:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc83db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x704:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:2.0:1716999790.980673:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].55, 176 off17432 00000004:00200000:2.0:1716999790.980715:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x704:0x0]: returning size 12800 00010000:00010000:2.0:1716999790.980728:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc83db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x704:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980734:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc83db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x704:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980739:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc83db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x704:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980744:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833a80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.980747:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc83db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x704:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980753:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc83db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x704:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980760:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x704:0x0].0x0 (ffff880088977d00) 00010000:00010000:2.0:1716999790.980762:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999790.980764:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc83db lrc: 2/0,0 mode: --/EX res: [0x200000401:0x704:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980769:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833a80/0x6d188eabd8dc83db lrc: 0/0,0 mode: --/EX res: [0x200000401:0x704:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980804:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc83cd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980810:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc83cd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980814:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc83cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980818:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918318c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.980820:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc83cd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980828:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc83cd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980835:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:2.0:1716999790.980837:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.980839:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc83cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999790.980843:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc83cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999790.980849:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131d5fb80 reply state ffff88009c0e0000 transno 4294986599 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc83d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999790.980854:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999790.980925:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+559:11584:x1800404480793216:12345-192.168.203.3@tcp:36:rm.0 Request processed in 820us (1086us total) trans 4294986599 rc 0/0 00000100:00100000:2.0:1716999790.980931:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45988 00000100:00100000:0.0:1716999790.984070:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.984398:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793280 00000100:00100000:2.0:1716999790.984405:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793280 00000100:00100000:2.0:1716999790.984667:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45989 00000100:00100000:2.0:1716999790.984674:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480793280:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999790.984822:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480793280:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 147us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999790.984829:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45989 00010000:00010000:1.0:1716999790.985225:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc83d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999790.985234:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc83d4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999790.985241:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc83d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999790.985246:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999790.985249:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc83d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999790.985255:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc83d4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999790.985267:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x41aa9094 (ffff880088977800) 00010000:00010000:1.0:1716999790.985269:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999790.985272:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc83d4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999790.985277:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833180/0x6d188eabd8dc83d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999790.986448:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.986653:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793344 00000100:00100000:0.0:1716999790.986658:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793344 00000100:00100000:1.0:1716999790.986857:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.986872:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793408 00000100:00100000:1.0:1716999790.986876:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793408 00000100:00100000:1.0:1716999790.986917:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45990 00000100:00100000:1.0:1716999790.986922:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480793408:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.987033:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480793408:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 110us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.987039:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45990 00000100:00100000:0.0:1716999790.987198:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9426 00000100:00100000:0.0:1716999790.987203:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+558:11584:x1800404480793344:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999790.989236:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.989291:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793472 00000100:00100000:3.0:1716999790.989297:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793472 00000100:00100000:3.0:1716999790.989323:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45991 00000100:00100000:3.0:1716999790.989329:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480793472:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999790.989436:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480793472:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 106us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999790.989443:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45991 00000100:00100000:0.0:1716999790.989902:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+558:11584:x1800404480793344:12345-192.168.203.3@tcp:37:rm.0 Request processed in 2697us (3453us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999790.989909:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9426 00000100:00100000:0.0:1716999790.992192:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999790.992269:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999790.992337:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793664 00000100:00100000:2.0:1716999790.992343:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793664 00000100:00100000:1.0:1716999790.992408:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793536 00000100:00100000:1.0:1716999790.992412:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793536 00000100:00100000:2.0:1716999790.992422:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9427 00000100:00100000:2.0:1716999790.992428:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+559:11584:x1800404480793664:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:1.0:1716999790.992457:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45992 00000100:00100000:1.0:1716999790.992462:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480793536:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.992614:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480793536:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 151us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.992621:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45992 00000100:00100000:2.0:1716999790.993052:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+559:11584:x1800404480793664:12345-192.168.203.3@tcp:35:rm.0 Request processed in 623us (782us total) trans 4294986600 rc 0/0 00000100:00100000:2.0:1716999790.993058:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9427 00000100:00100000:0.0:1716999790.993634:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.993689:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793728 00000100:00100000:1.0:1716999790.993694:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793728 00000100:00100000:1.0:1716999790.993818:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45993 00000100:00100000:1.0:1716999790.993824:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480793728:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.993929:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+559:11585:x1800404480793728:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 104us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.993935:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45993 00000100:00100000:0.0:1716999790.994682:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999790.994722:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793856 00000100:00100000:3.0:1716999790.994727:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793856 00000100:00100000:3.0:1716999790.994757:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45994 00000100:00100000:3.0:1716999790.994762:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+559:11584:x1800404480793856:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:3.0:1716999790.994789:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999790.994820:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091186640/0x6d188eabd8d70c6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6dd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7df expref: 559 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.994848:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c130fc0/0x6d188eabd8dc831e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66356 expref: 558 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.994859:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215d680/0x6d188eabd8d7cb6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f82f expref: 557 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.994869:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f24b40/0x6d188eabd8d70c36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6dd:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7ca expref: 556 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999790.994877:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800b431d600) 00010000:00010000:3.0:1716999790.994905:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999790.994923:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc83e2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.994932:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc83e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.994940:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc83e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.994948:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc83e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.994954:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc83e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.994958:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc83e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995025:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc83f0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6dd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995032:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc83f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995037:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc83f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999790.995369:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].56, 176 off17608 00000004:00200000:3.0:1716999790.995409:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6dd:0x0]: returning size 12800 00010000:00010000:3.0:1716999790.995423:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc83f0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995428:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc83f0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995433:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc83f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995437:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.995441:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc83f0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995446:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc83f0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995453:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dd:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999790.995455:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999790.995458:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc83f0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995462:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc83f0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6dd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995500:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc83e2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995505:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc83e2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995509:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc83e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995513:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999790.995515:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc83e2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995519:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc83e2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995525:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:3.0:1716999790.995527:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999790.995529:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc83e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999790.995533:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc83e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999790.995539:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880129f4bb80 reply state ffff88012e8a5000 transno 4294986601 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc83e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999790.995543:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999790.995591:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11584:x1800404480793856:12345-192.168.203.3@tcp:36:rm.0 Request processed in 827us (909us total) trans 4294986601 rc 0/0 00000100:00100000:3.0:1716999790.995597:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45994 00000100:00100000:0.0:1716999790.996347:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.996455:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793920 00000100:00100000:1.0:1716999790.996460:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793920 00000100:00100000:1.0:1716999790.996492:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45995 00000100:00100000:1.0:1716999790.996497:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480793920:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.996614:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480793920:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 115us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.996620:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45995 00010000:00010000:2.0:1716999790.998349:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc83e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.998359:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc83e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.998365:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc83e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.998370:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52f40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999790.998373:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc83e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.998380:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc83e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.998390:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x45524f8f (ffff8800a5c6e200) 00010000:00010000:2.0:1716999790.998393:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999790.998396:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc83e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999790.998401:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc83e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999790.999020:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999790.999084:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480793984 00000100:00100000:1.0:1716999790.999090:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480793984 00000100:00100000:1.0:1716999790.999154:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45996 00000100:00100000:1.0:1716999790.999160:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480793984:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999790.999267:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480793984:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 106us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999790.999276:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45996 00000100:00100000:0.0:1716999790.999944:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.000111:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794048 00000100:00100000:2.0:1716999791.000115:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794048 00000100:00100000:2.0:1716999791.000144:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9428 00000100:00100000:2.0:1716999791.000149:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+556:11584:x1800404480794048:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999791.001091:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.001134:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794112 00000100:00100000:3.0:1716999791.001139:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794112 00000100:00100000:3.0:1716999791.001179:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45997 00000100:00100000:3.0:1716999791.001184:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480794112:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.001288:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+558:11585:x1800404480794112:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 103us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.001295:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45997 00000100:00080000:0.0:1716999791.001751:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1716999761 00000100:00100000:0.0:1716999791.003471:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.003595:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794176 00000100:00100000:1.0:1716999791.003601:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794176 00000100:00100000:1.0:1716999791.003639:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45998 00000100:00100000:1.0:1716999791.003645:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480794176:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.003771:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480794176:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 125us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.003778:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45998 00000100:00100000:2.0:1716999791.003868:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+556:11584:x1800404480794048:12345-192.168.203.3@tcp:37:rm.0 Request processed in 3716us (3923us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.003877:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9428 00000100:00100000:0.0:1716999791.005820:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.005974:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794240 00000100:00100000:3.0:1716999791.005980:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794240 00000100:00100000:3.0:1716999791.006014:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 45999 00000100:00100000:3.0:1716999791.006019:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480794240:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.006131:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480794240:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 112us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.006137:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 45999 00000100:00100000:0.0:1716999791.007182:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.007285:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794368 00000100:00100000:2.0:1716999791.007291:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794368 00000100:00100000:2.0:1716999791.007323:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9429 00000100:00100000:2.0:1716999791.007329:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+556:11584:x1800404480794368:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:2.0:1716999791.007639:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+557:11584:x1800404480794368:12345-192.168.203.3@tcp:35:rm.0 Request processed in 308us (457us total) trans 4294986602 rc 0/0 00000100:00100000:2.0:1716999791.007644:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9429 00000100:00100000:0.0:1716999791.007963:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.008210:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794432 00000100:00100000:3.0:1716999791.008215:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794432 00000100:00100000:3.0:1716999791.008244:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46000 00000100:00100000:3.0:1716999791.008249:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480794432:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.008337:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480794432:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 86us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.008343:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46000 00000100:00100000:0.0:1716999791.009144:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.011089:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.011129:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794560 00000100:00100000:3.0:1716999791.011138:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794560 00000100:00100000:3.0:1716999791.011158:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794624 00000100:00100000:3.0:1716999791.011160:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794624 00000100:00100000:3.0:1716999791.011172:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46001 00000100:00100000:3.0:1716999791.011177:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+558:11584:x1800404480794560:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:3.0:1716999791.011210:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999791.011227:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012face400/0x6d188eabd8d70345 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c3:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b43c expref: 558 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.011243:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132d00/0x6d188eabd8dc833a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6635d expref: 557 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.011257:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013541b600/0x6d188eabd8d7b1f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4efe6 expref: 556 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.011271:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012facf840/0x6d188eabd8d70314 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b420 expref: 555 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.011278:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff88009a3b6f00) 00010000:00010000:3.0:1716999791.011285:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999791.011303:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc83f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011312:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc83f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011319:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc83f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011327:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc83fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011331:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc83fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011335:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc83fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011417:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc8405 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011426:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc8405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011431:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc8405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:3.0:1716999791.011813:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].57, 176 off17784 00000004:00200000:3.0:1716999791.011854:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6c3:0x0]: returning size 11776 00010000:00010000:3.0:1716999791.011867:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc8405 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011873:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc8405 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011901:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc8405 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011907:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.011910:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc8405 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011916:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc8405 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011923:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c3:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999791.011926:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999791.011928:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc8405 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011933:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc8405 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6c3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999791.011950:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46002 00000100:00100000:0.0:1716999791.011957:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11585:x1800404480794624:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00010000:00010000:3.0:1716999791.011962:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc83f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011968:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc83f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011972:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc83f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011976:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.011978:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc83f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011982:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc83f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011986:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:3.0:1716999791.011988:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.011990:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc83f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.011993:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc83f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:3.0:1716999791.011998:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b3b80 reply state ffff88012e8a1000 transno 4294986603 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc83fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999791.012003:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999791.012044:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+556:11584:x1800404480794560:12345-192.168.203.3@tcp:36:rm.0 Request processed in 866us (2900us total) trans 4294986603 rc 0/0 00000100:00100000:3.0:1716999791.012049:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46001 00000100:00100000:0.0:1716999791.012066:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11585:x1800404480794624:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 109us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999791.012072:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46002 00010000:00010000:1.0:1716999791.012968:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc83fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.012976:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc83fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.012980:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc83fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.012984:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.012986:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc83fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.012991:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc83fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.012998:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x44524f57 (ffff8800a5c6e100) 00010000:00010000:1.0:1716999791.013000:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.013002:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc83fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.013006:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc83fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999791.013326:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.013386:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794688 00000100:00100000:1.0:1716999791.013391:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794688 00000100:00100000:1.0:1716999791.013423:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46003 00000100:00100000:1.0:1716999791.013428:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+554:11585:x1800404480794688:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.013519:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+554:11585:x1800404480794688:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 90us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.013525:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46003 00000100:00100000:0.0:1716999791.014013:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.014455:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794752 00000100:00100000:2.0:1716999791.014460:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794752 00000100:00100000:2.0:1716999791.014491:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9430 00000100:00100000:2.0:1716999791.014496:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec23050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+554:11584:x1800404480794752:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:2.0:1716999791.016685:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.016823:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794816 00000100:00100000:0.0:1716999791.016829:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794816 00000100:00100000:0.0:1716999791.016863:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46004 00000100:00100000:0.0:1716999791.016869:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480794816:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1716999791.017002:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480794816:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 132us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999791.017010:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46004 00000100:00100000:3.0:1716999791.018865:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec23050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+554:11584:x1800404480794752:12345-192.168.203.3@tcp:37:rm.0 Request processed in 4362us (4846us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.018874:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9430 00000100:00100000:0.0:1716999791.020459:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.020552:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794880 00000100:00100000:2.0:1716999791.020559:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794880 00000100:00100000:2.0:1716999791.020599:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46005 00000100:00100000:2.0:1716999791.020605:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+554:11585:x1800404480794880:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.021237:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+554:11585:x1800404480794880:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 630us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.021243:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46005 00000100:00100000:2.0:1716999791.022971:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.023000:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.023048:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795072 00000100:00100000:3.0:1716999791.023054:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795072 00000100:00100000:0.0:1716999791.023057:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480794944 00000100:00100000:0.0:1716999791.023061:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480794944 00000100:00100000:0.0:1716999791.023089:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46006 00000100:00100000:0.0:1716999791.023095:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11585:x1800404480794944:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.023159:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9431 00000100:00100000:3.0:1716999791.023165:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+555:11584:x1800404480795072:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:0.0:1716999791.023209:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11585:x1800404480794944:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 114us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999791.023214:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46006 00000100:00100000:3.0:1716999791.023860:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+555:11584:x1800404480795072:12345-192.168.203.3@tcp:35:rm.0 Request processed in 693us (857us total) trans 4294986604 rc 0/0 00000100:00100000:3.0:1716999791.023868:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9431 00000100:00100000:0.0:1716999791.024028:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.024070:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795136 00000100:00100000:1.0:1716999791.024074:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795136 00000100:00100000:1.0:1716999791.024092:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46007 00000100:00100000:1.0:1716999791.024096:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11585:x1800404480795136:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.024192:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11585:x1800404480795136:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 94us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.024198:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46007 00000100:00100000:0.0:1716999791.025159:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.025196:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795200 00000100:00100000:0.0:1716999791.025199:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.025200:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795200 00000100:00100000:3.0:1716999791.025343:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795328 00000100:00100000:3.0:1716999791.025346:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795328 00000100:00100000:3.0:1716999791.025364:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46008 00000100:00100000:3.0:1716999791.025368:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480795200:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.025447:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480795200:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 77us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.025453:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46008 00000100:00100000:3.0:1716999791.025463:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46009 00000100:00100000:3.0:1716999791.025466:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+555:11584:x1800404480795328:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:3.0:1716999791.025491:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999791.025507:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091184900/0x6d188eabd8d70877 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d1:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b642 expref: 555 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.025522:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c132400/0x6d188eabd8dc8356 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66364 expref: 554 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.025532:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091331d40/0x6d188eabd8d7c117 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f49a expref: 553 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.025546:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091184480/0x6d188eabd8d70846 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b626 expref: 552 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.025553:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff880092624e00) 00010000:00010000:3.0:1716999791.025560:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999791.025577:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc840c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.025587:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc840c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.025594:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc840c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.025603:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc8413 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.025608:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc8413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.025613:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc8413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.025677:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc841a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.025683:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc841a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.025688:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc841a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999791.027224:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000040:00080000:3.0:1716999791.027511:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].58, 176 off17960 00000004:00200000:3.0:1716999791.027557:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6d1:0x0]: returning size 11776 00010000:00010000:3.0:1716999791.027570:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc841a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027577:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc841a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027583:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc841a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027587:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.027591:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc841a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027596:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc841a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027604:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d1:0x0].0x0 (ffff8800a5c6ec00) 00010000:00010000:3.0:1716999791.027607:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999791.027609:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc841a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027613:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc841a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6d1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027643:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc840c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027648:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc840c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027653:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc840c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027656:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.027660:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc840c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027664:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc840c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027669:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:3.0:1716999791.027671:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.027674:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc840c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.027678:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc840c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999791.027684:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b0380 reply state ffff88012e8a6000 transno 4294986605 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc8413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999791.027689:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999791.027742:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+553:11584:x1800404480795328:12345-192.168.203.3@tcp:36:rm.0 Request processed in 2273us (2541us total) trans 4294986605 rc 0/0 00000100:00100000:3.0:1716999791.027749:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46009 00000100:00100000:3.0:1716999791.027763:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795392 00000100:00100000:3.0:1716999791.027767:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795392 00000100:00100000:3.0:1716999791.027781:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46010 00000100:00100000:3.0:1716999791.027786:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+553:11585:x1800404480795392:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.027873:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+553:11585:x1800404480795392:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 86us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.027894:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46010 00010000:00010000:2.0:1716999791.030301:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc8413 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.030314:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc8413 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.030319:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc8413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.030323:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.030327:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc8413 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.030331:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc8413 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.030342:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x5052ab9e (ffff8800a5c6eb00) 00010000:00010000:2.0:1716999791.030344:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.030347:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc8413 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.030350:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc8413 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999791.030606:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.031042:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.031116:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795520 00000100:00100000:3.0:1716999791.031123:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795520 00000100:00100000:1.0:1716999791.031145:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795456 00000100:00100000:1.0:1716999791.031148:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795456 00000100:00100000:3.0:1716999791.031149:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9432 00000100:00100000:3.0:1716999791.031155:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11584:x1800404480795520:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:1.0:1716999791.031163:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46011 00000100:00100000:1.0:1716999791.031166:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11585:x1800404480795456:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.031273:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11585:x1800404480795456:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 105us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.031279:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46011 00000100:00100000:2.0:1716999791.034409:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.034549:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795584 00000100:00100000:0.0:1716999791.034556:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795584 00000100:00100000:0.0:1716999791.034584:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46012 00000100:00100000:0.0:1716999791.034590:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+554:11585:x1800404480795584:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1716999791.034718:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+554:11585:x1800404480795584:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 128us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999791.034724:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46012 00000100:00100000:0.0:1716999791.039460:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.039531:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795648 00000100:00100000:1.0:1716999791.039538:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795648 00000100:00100000:1.0:1716999791.039565:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46013 00000100:00100000:1.0:1716999791.039570:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11585:x1800404480795648:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.040105:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11584:x1800404480795520:12345-192.168.203.3@tcp:37:rm.0 Request processed in 8948us (9061us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.040105:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11585:x1800404480795648:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 534us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.040112:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9432 00000100:00100000:1.0:1716999791.040112:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46013 00000100:00100000:0.0:1716999791.043701:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.043762:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795712 00000100:00100000:1.0:1716999791.043770:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795712 00000100:00100000:1.0:1716999791.043816:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46014 00000100:00100000:1.0:1716999791.043822:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+552:11585:x1800404480795712:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.045112:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+552:11585:x1800404480795712:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 1287us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.045120:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46014 00000100:00100000:0.0:1716999791.047473:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.048125:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.048194:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795904 00000100:00100000:1.0:1716999791.048199:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795904 00000100:00100000:1.0:1716999791.048226:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46015 00000100:00100000:1.0:1716999791.048231:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+552:11585:x1800404480795904:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.048353:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+552:11585:x1800404480795904:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 121us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.048360:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46015 00000100:00100000:3.0:1716999791.048518:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795840 00000100:00100000:3.0:1716999791.048522:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795840 00000100:00100000:3.0:1716999791.048999:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9433 00000100:00100000:3.0:1716999791.049004:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+552:11584:x1800404480795840:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999791.050272:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11584:x1800404480795840:12345-192.168.203.3@tcp:35:rm.0 Request processed in 1264us (2799us total) trans 4294986606 rc 0/0 00000100:00100000:3.0:1716999791.050280:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9433 00000100:00100000:0.0:1716999791.051912:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.051951:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.052034:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480795968 00000100:00100000:1.0:1716999791.052040:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480795968 00000100:00100000:1.0:1716999791.052074:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480796096 00000100:00100000:1.0:1716999791.052076:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480796096 00000100:00100000:1.0:1716999791.052089:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46016 00000100:00100000:1.0:1716999791.052094:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+554:11585:x1800404480795968:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.052227:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+554:11585:x1800404480795968:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 131us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.052233:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46016 00000100:00100000:1.0:1716999791.052243:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46017 00000100:00100000:1.0:1716999791.052247:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+553:11584:x1800404480796096:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:1.0:1716999791.052275:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999791.052294:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ecb40/0x6d188eabd8d72883 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x734:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3c4 expref: 553 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.052313:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69d40/0x6d188eabd8dc8372 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x734:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6636b expref: 552 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.052335:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2640/0x6d188eabd8d81716 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x734:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f510f5 expref: 551 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.052345:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7efcc0/0x6d188eabd8d72860 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x734:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3af expref: 550 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.052352:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x734:0x0].0x0 (ffff8800b4877400) 00010000:00010000:1.0:1716999791.052361:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999791.052380:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc8421 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052390:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc8421 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052397:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc8421 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052409:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc8428 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052414:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc8428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052419:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc8428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052485:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc842f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x734:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052490:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc842f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x734:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052494:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc842f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x734:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:1.0:1716999791.052870:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].59, 176 off18136 00000004:00200000:1.0:1716999791.052941:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x734:0x0]: returning size 11776 00010000:00010000:1.0:1716999791.052953:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc842f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x734:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052958:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc842f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x734:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052963:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc842f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x734:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052967:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.052970:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc842f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x734:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052976:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc842f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x734:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052983:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x734:0x0].0x0 (ffff8800a6d5f900) 00010000:00010000:1.0:1716999791.052985:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999791.052988:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc842f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x734:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.052992:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc842f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x734:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.054321:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc8421 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.054326:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc8421 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.054331:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc8421 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.054334:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.054336:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc8421 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.054340:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc8421 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.054348:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:1.0:1716999791.054350:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.054353:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc8421 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.054357:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc8421 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999791.054363:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff8800917b3800 reply state ffff88009c203000 transno 4294986607 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc8428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999791.054369:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999791.055548:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+551:11584:x1800404480796096:12345-192.168.203.3@tcp:36:rm.0 Request processed in 3296us (3592us total) trans 4294986607 rc 0/0 00000100:00100000:1.0:1716999791.055556:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46017 00000100:00100000:3.0:1716999791.056930:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.057280:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480796160 00000100:00100000:1.0:1716999791.057287:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480796160 00000100:00100000:1.0:1716999791.057324:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46018 00000100:00100000:1.0:1716999791.057330:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+551:11585:x1800404480796160:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.057454:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+551:11585:x1800404480796160:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 123us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.057459:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46018 00010000:00010000:1.0:1716999791.057828:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc8428 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.057836:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc8428 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.057842:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc8428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.057846:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.057849:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc8428 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.057854:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc8428 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.057865:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x44454553 (ffff8800a6d5f500) 00010000:00010000:1.0:1716999791.057868:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.057871:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc8428 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.057876:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc8428 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b7:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999791.059733:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.060173:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.060437:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480796288 00000100:00100000:3.0:1716999791.060444:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480796288 00000100:00100000:2.0:1716999791.060547:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480796352 00000100:00100000:2.0:1716999791.060551:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480796352 00000100:00100000:2.0:1716999791.060570:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46019 00000100:00100000:2.0:1716999791.060575:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+551:11585:x1800404480796352:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.060708:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+551:11585:x1800404480796352:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 131us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.060714:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46019 00000100:00100000:3.0:1716999791.060955:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9434 00000100:00100000:3.0:1716999791.060960:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+550:11584:x1800404480796288:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999791.061272:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+551:11584:x1800404480796288:12345-192.168.203.3@tcp:35:rm.0 Request processed in 311us (1542us total) trans 4294986608 rc 0/0 00000100:00100000:3.0:1716999791.061277:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9434 00000100:00100000:0.0:1716999791.063218:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.063441:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480796416 00000100:00100000:1.0:1716999791.063447:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480796416 00000100:00100000:1.0:1716999791.063482:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46020 00000100:00100000:1.0:1716999791.063488:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+551:11585:x1800404480796416:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.063601:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+551:11585:x1800404480796416:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 112us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.063607:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46020 00000100:00100000:0.0:1716999791.063872:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.064039:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480796544 00000100:00100000:2.0:1716999791.064042:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480796544 00000100:00100000:2.0:1716999791.064057:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46021 00000100:00100000:2.0:1716999791.064060:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+551:11584:x1800404480796544:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:2.0:1716999791.064087:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999791.064104:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800911873c0/0x6d188eabd8d70b56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b784 expref: 551 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.064120:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb98900/0x6d188eabd8d7a628 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ec12 expref: 550 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.064130:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c577180/0x6d188eabd8d70234 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b7:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b3e1 expref: 549 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.064137:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff8800939c9200) 00010000:00010000:2.0:1716999791.064146:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8268 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b5:0x0].0x0 bits 0x12/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66325 expref: 548 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.064152:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x0 (ffff880099d1be00) 00010000:00010000:2.0:1716999791.064154:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999791.064170:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8436 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064179:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8436 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064185:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8436 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064193:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc843d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b5:0x0].0x746dd4eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064197:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc843d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064201:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc843d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064262:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc8444 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064266:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc8444 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064270:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc8444 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:2.0:1716999791.064596:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].60, 176 off18312 00000004:00200000:2.0:1716999791.064638:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6b7:0x0]: returning size 11776 00010000:00010000:2.0:1716999791.064649:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc8444 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064654:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc8444 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064658:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc8444 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064662:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.064665:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc8444 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064670:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc8444 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064675:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b7:0x0].0x0 (ffff880088977600) 00010000:00010000:2.0:1716999791.064678:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999791.064680:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc8444 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064684:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc8444 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064706:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8436 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064710:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8436 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064713:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8436 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064717:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.064719:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8436 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064723:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8436 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064729:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x0 (ffff880099d1be00) 00010000:00010000:2.0:1716999791.064731:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.064733:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8436 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.064737:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831d40/0x6d188eabd8dc8436 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999791.064743:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092e7e680 reply state ffff880133935000 transno 4294986609 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc843d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999791.064748:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999791.064788:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+549:11584:x1800404480796544:12345-192.168.203.3@tcp:36:rm.0 Request processed in 726us (915us total) trans 4294986609 rc 0/0 00000100:00100000:2.0:1716999791.064801:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46021 00010000:00010000:2.0:1716999791.066935:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc843d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.066945:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc843d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.066950:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc843d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.066954:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.066958:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc843d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.066963:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc843d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b5:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.066972:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x746dd4eb (ffff880088977400) 00010000:00010000:2.0:1716999791.066974:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.066977:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc843d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b5:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.066980:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc843d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b5:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999791.067141:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.067206:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.067902:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480796672 00000100:00100000:2.0:1716999791.067908:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480796672 00000100:00100000:2.0:1716999791.067941:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9435 00000100:00100000:2.0:1716999791.067947:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+548:11584:x1800404480796672:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:1.0:1716999791.068213:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480796736 00000100:00100000:1.0:1716999791.068217:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480796736 00000100:00100000:1.0:1716999791.068245:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46022 00000100:00100000:1.0:1716999791.068250:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+549:11585:x1800404480796736:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.068354:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+549:11585:x1800404480796736:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 103us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.068361:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46022 00000100:00100000:2.0:1716999791.069179:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+549:11584:x1800404480796672:12345-192.168.203.3@tcp:35:rm.0 Request processed in 1230us (2039us total) trans 4294986610 rc 0/0 00000100:00100000:2.0:1716999791.069187:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9435 00000100:00100000:2.0:1716999791.070334:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.070473:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480796800 00000100:00100000:3.0:1716999791.070478:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480796800 00000100:00100000:3.0:1716999791.070504:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46023 00000100:00100000:3.0:1716999791.070509:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+549:11585:x1800404480796800:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.070600:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+549:11585:x1800404480796800:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 90us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.070609:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46023 00000100:00100000:0.0:1716999791.071742:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.072502:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480796928 00000100:00100000:1.0:1716999791.072508:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480796928 00000100:00100000:1.0:1716999791.072538:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46024 00000100:00100000:1.0:1716999791.072543:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+549:11584:x1800404480796928:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:1.0:1716999791.072576:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999791.072594:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012facc900/0x6d188eabd8d6fdf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b5:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b228 expref: 549 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.072623:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009cf53180/0x6d188eabd8d7a476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b5:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4eb78 expref: 548 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.072632:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920faac0/0x6d188eabd8d6fdb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b5:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b213 expref: 547 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.072640:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x0 (ffff880099d1be00) 00010000:00010000:1.0:1716999791.072650:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8229 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66310 expref: 546 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.072655:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:1.0:1716999791.072657:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999791.072674:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc844b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.072682:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc844b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.072688:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc844b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.072698:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8452 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b3:0x0].0x659ae0d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.072703:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x659ae0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.072708:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x659ae0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.072804:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc8459 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.072811:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc8459 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.072816:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc8459 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:1.0:1716999791.073238:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].61, 176 off18488 00000004:00200000:1.0:1716999791.073282:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6b5:0x0]: returning size 11776 00010000:00010000:1.0:1716999791.073294:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc8459 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073299:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc8459 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073304:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc8459 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073308:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.073311:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc8459 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073316:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc8459 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073323:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b5:0x0].0x0 (ffff8800a6d5fb00) 00010000:00010000:1.0:1716999791.073325:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999791.073327:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc8459 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073331:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc8459 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073358:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc844b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073363:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc844b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073366:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc844b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073370:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b06c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.073372:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc844b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073376:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc844b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073381:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:1.0:1716999791.073383:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.073384:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc844b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.073388:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc844b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999791.073394:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880092e7f100 reply state ffff880093a41000 transno 4294986611 ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x659ae0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999791.073399:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999791.073440:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+547:11584:x1800404480796928:12345-192.168.203.3@tcp:36:rm.0 Request processed in 896us (1699us total) trans 4294986611 rc 0/0 00000100:00100000:1.0:1716999791.073445:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46024 00000100:00100000:2.0:1716999791.073702:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.073968:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480796992 00000100:00100000:3.0:1716999791.073973:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480796992 00000100:00100000:3.0:1716999791.073991:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46025 00000100:00100000:3.0:1716999791.073996:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+547:11585:x1800404480796992:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.074085:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+547:11585:x1800404480796992:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 87us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.074091:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46025 00010000:00010000:1.0:1716999791.074995:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8452 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x659ae0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.075001:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8452 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x659ae0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.075007:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8452 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x659ae0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.075276:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.075281:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8452 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x659ae0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.075286:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8452 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x659ae0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.075296:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x659ae0d1 (ffff8800a6d5fe00) 00010000:00010000:1.0:1716999791.075298:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.075301:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8452 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b3:0x0].0x659ae0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.075305:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc8452 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b3:0x0].0x659ae0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999791.076615:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.076745:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.077148:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797056 00000100:00100000:2.0:1716999791.077154:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797056 00000100:00100000:2.0:1716999791.077183:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46026 00000100:00100000:2.0:1716999791.077188:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480797056:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.077310:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480797056:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 120us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.077316:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46026 00000100:00100000:3.0:1716999791.077421:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797120 00000100:00100000:3.0:1716999791.077424:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797120 00000100:00100000:3.0:1716999791.077440:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9436 00000100:00100000:3.0:1716999791.077444:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+546:11584:x1800404480797120:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:2.0:1716999791.079546:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.079686:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797184 00000100:00100000:0.0:1716999791.079691:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797184 00000100:00100000:0.0:1716999791.079784:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46027 00000100:00100000:0.0:1716999791.079790:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480797184:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.080328:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480797184:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 537us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.080334:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46027 00000100:00100000:3.0:1716999791.081204:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec22c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+546:11584:x1800404480797120:12345-192.168.203.3@tcp:37:rm.0 Request processed in 3757us (4457us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.081211:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9436 00000100:00100000:0.0:1716999791.083163:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.083279:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797248 00000100:00100000:1.0:1716999791.083286:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797248 00000100:00100000:2.0:1716999791.084367:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46028 00000100:00100000:2.0:1716999791.084379:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480797248:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.084518:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480797248:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 140us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.084947:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46028 00000100:00100000:0.0:1716999791.086471:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.086681:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797312 00000100:00100000:3.0:1716999791.086688:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797312 00000100:00100000:3.0:1716999791.086724:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9437 00000100:00100000:3.0:1716999791.086730:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+546:11584:x1800404480797312:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999791.087417:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.087463:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797376 00000100:00100000:2.0:1716999791.087466:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797376 00000100:00100000:2.0:1716999791.087494:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46029 00000100:00100000:2.0:1716999791.087498:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+547:11585:x1800404480797376:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.087699:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+547:11585:x1800404480797376:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 199us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.087707:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46029 00000100:00100000:0.0:1716999791.089827:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.089903:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797440 00000100:00100000:2.0:1716999791.089908:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797440 00000100:00100000:3.0:1716999791.089954:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+547:11584:x1800404480797312:12345-192.168.203.3@tcp:37:rm.0 Request processed in 3223us (3484us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.089962:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9437 00000100:00100000:2.0:1716999791.089994:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46030 00000100:00100000:2.0:1716999791.089999:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+547:11585:x1800404480797440:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.090100:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480797440:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 100us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.090107:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46030 00000100:00100000:0.0:1716999791.092051:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.092100:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797504 00000100:00100000:1.0:1716999791.092105:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797504 00000100:00100000:1.0:1716999791.092136:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46031 00000100:00100000:1.0:1716999791.092142:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480797504:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.092254:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480797504:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 110us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.092263:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46031 00000100:00100000:0.0:1716999791.094899:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.094943:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.094966:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797568 00000100:00100000:2.0:1716999791.094973:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797568 00000100:00100000:2.0:1716999791.095014:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797632 00000100:00100000:2.0:1716999791.095017:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797632 00000100:00100000:2.0:1716999791.095032:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46032 00000100:00100000:2.0:1716999791.095039:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+547:11584:x1800404480797568:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:2.0:1716999791.095055:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1716999791.095071:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc8460 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66372 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999791.095098:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46033 00000100:00100000:3.0:1716999791.095102:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480797632:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00010000:00010000:2.0:1716999791.095113:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc8467 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.095125:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc8467 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.095133:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc8467 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.095142:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc846e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.095146:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc846e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.095153:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc846e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999791.095220:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480797632:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 116us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.095226:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46033 00010000:00010000:2.0:1716999791.095229:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc8475 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.095235:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc8475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.095241:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc8475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:3.0:1716999791.095292:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6d0:0x0]: returning size 11776 00000004:00200000:3.0:1716999791.095295:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999791.095308:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc8475 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095315:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc8467 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095320:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc8467 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095325:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc8467 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095330:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.095334:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc8467 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095339:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc8467 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095349:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:3.0:1716999791.095351:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.095356:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc8467 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095360:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc8467 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095380:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc846e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095386:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc846e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095389:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc846e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095393:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.095395:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc846e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095399:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc846e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095405:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x5052ab9e (ffff880088977900) 00010000:00010000:3.0:1716999791.095407:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.095409:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc846e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.095413:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc846e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.096112:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc8460 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66372 expref: 548 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.096124:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc8475 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66372 expref: 547 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.096130:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999791.096132:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1716999791.096134:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091830240, rc 0) 00000100:00100000:3.0:1716999791.096282:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+547:11584:x1800404480797568:12345-192.168.203.3@tcp:101:rm.0 Request processed in 1242us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.096288:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46032 00010000:00010000:0.0:1716999791.097356:0:6810:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1716999791.097397:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.097511:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797696 00000100:00100000:3.0:1716999791.097517:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797696 00000100:00100000:3.0:1716999791.097551:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46034 00000100:00100000:3.0:1716999791.097556:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+547:11585:x1800404480797696:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.097671:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+547:11585:x1800404480797696:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 112us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.097677:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46034 00000100:00100000:0.0:1716999791.099545:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.099772:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797760 00000100:00100000:3.0:1716999791.099778:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797760 00000100:00100000:3.0:1716999791.099824:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46035 00000100:00100000:3.0:1716999791.099830:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+547:11585:x1800404480797760:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.099967:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+547:11585:x1800404480797760:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 136us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.099973:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46035 00000100:00100000:2.0:1716999791.102552:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.102571:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.102625:0:4523:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797824 00000100:00100000:1.0:1716999791.102631:0:4523:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797824 00000100:00100000:1.0:1716999791.102666:0:4523:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:1.0:1716999791.102673:0:4523:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+547:1958:x1800404480797824:12345-192.168.203.3@tcp:63:ll_sa.0 00010000:00010000:1.0:1716999791.102702:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999791.102718:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc847c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66379 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.102751:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8483 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.102762:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8483 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.102771:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8483 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.102781:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc848a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.102786:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc848a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.102790:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc848a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.102912:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8491 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.102919:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.102926:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999791.102962:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x705:0x0]: returning size 12800 00000004:00200000:1.0:1716999791.102965:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999791.102977:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8491 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.102985:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8483 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.102989:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8483 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.102995:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8483 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.102999:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.103002:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8483 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103007:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8483 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103015:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999791.103018:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.103021:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8483 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103025:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3840/0x6d188eabd8dc8483 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103038:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc848a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103043:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc848a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103047:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc848a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103051:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.103053:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc848a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103057:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc848a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103063:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x41aa9094 (ffff8800a6d5fa00) 00010000:00010000:1.0:1716999791.103065:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.103066:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc848a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103070:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0900/0x6d188eabd8dc848a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103088:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2f40/0x6d188eabd8dc847c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66379 expref: 549 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.103097:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8491 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x705:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66379 expref: 548 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.103103:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:1.0:1716999791.103104:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999791.103106:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b0b40, rc 0) 00010000:00010000:1.0:1716999791.103110:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999791.103117:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc8498 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66380 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.103131:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc849f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103137:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc849f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103142:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc849f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103149:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc84a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103154:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc84a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103158:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc84a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103199:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc84ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103205:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc84ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103210:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc84ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999791.103231:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6ca:0x0]: returning size 11776 00000004:00200000:1.0:1716999791.103233:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999791.103240:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc84ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103246:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc849f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103250:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc849f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103255:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc849f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103259:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.103261:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc849f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103265:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc849f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103271:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999791.103273:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.103275:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc849f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103279:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1f80/0x6d188eabd8dc849f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103285:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc84a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103290:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc84a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103294:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc84a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103297:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b21c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.103299:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc84a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103307:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc84a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103312:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x45435891 (ffff8800a6d5f000) 00010000:00010000:1.0:1716999791.103314:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.103315:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc84a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103320:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b21c0/0x6d188eabd8dc84a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103335:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1d40/0x6d188eabd8dc8498 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66380 expref: 550 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.103342:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc84ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66380 expref: 549 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.103348:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x0 (ffff8800a660c200) 00010000:00010000:1.0:1716999791.103349:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999791.103351:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b1680, rc 0) 00010000:00010000:1.0:1716999791.103354:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999791.103359:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc84b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66387 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.103373:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc84bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103378:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc84bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103383:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc84bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103391:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc84c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103396:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc84c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103400:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc84c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103442:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc84c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103448:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc84c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103454:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc84c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999791.103474:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6fd:0x0]: returning size 11776 00000004:00200000:1.0:1716999791.103476:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999791.103483:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc84c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103488:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc84bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103492:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc84bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103496:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc84bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103500:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.103502:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc84bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103507:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc84bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103512:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999791.103514:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.103515:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc84bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103520:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1440/0x6d188eabd8dc84bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103526:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc84c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103530:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc84c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103534:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc84c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00000100:00100000:0.0:1716999791.103536:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999791.103538:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.103540:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc84c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103544:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc84c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103549:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x4d50 (ffff8800a6d5f700) 00010000:00010000:1.0:1716999791.103551:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.103553:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc84c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.103557:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2ac0/0x6d188eabd8dc84c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00000100:00100000:3.0:1716999791.103645:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797888 00000100:00100000:3.0:1716999791.103649:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797888 00000100:00100000:3.0:1716999791.103670:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9438 00000100:00100000:3.0:1716999791.103675:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+551:11584:x1800404480797888:12345-192.168.203.3@tcp:37:rm.0 00010000:00010000:1.0:1716999791.104268:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3a80/0x6d188eabd8dc84b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66387 expref: 553 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.104277:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc84c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66387 expref: 552 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.104282:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x0 (ffff8800910ceb00) 00010000:00010000:1.0:1716999791.104283:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999791.104285:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b0000, rc 0) 00010000:00010000:1.0:1716999791.104289:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999791.104295:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc84d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6638e expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.104311:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc84d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104317:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc84d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104323:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc84d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104331:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc84de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104337:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc84de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104341:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc84de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104386:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc84e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104394:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc84e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104400:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc84e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999791.104423:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6c2:0x0]: returning size 11776 00000004:00200000:1.0:1716999791.104425:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999791.104432:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc84e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104438:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc84d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104442:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc84d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104446:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc84d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104450:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2880 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.104452:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc84d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104456:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc84d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104462:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999791.104463:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.104465:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc84d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104469:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2880/0x6d188eabd8dc84d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104477:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc84de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104481:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc84de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104484:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc84de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104487:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b06c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.104489:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc84de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104493:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc84de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104497:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x44524f57 (ffff8800a6d5fe00) 00010000:00010000:1.0:1716999791.104499:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.104501:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc84de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104504:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b06c0/0x6d188eabd8dc84de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104519:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3180/0x6d188eabd8dc84d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6638e expref: 554 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.104528:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc84e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6638e expref: 553 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.104533:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:1.0:1716999791.104535:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999791.104537:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b2d00, rc 0) 00010000:00010000:1.0:1716999791.104539:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999791.104545:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc84ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f66395 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.104559:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc84f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104565:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc84f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104570:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc84f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104578:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc84fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104583:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc84fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104588:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc84fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104630:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2640/0x6d188eabd8dc8501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104637:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2640/0x6d188eabd8dc8501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104642:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2640/0x6d188eabd8dc8501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999791.104663:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6dc:0x0]: returning size 12800 00000004:00200000:1.0:1716999791.104665:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999791.104672:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2640/0x6d188eabd8dc8501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104678:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc84f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104682:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc84f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104686:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc84f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104689:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b1200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.104691:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc84f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104695:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc84f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104701:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999791.104702:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.104704:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc84f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104709:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1200/0x6d188eabd8dc84f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104715:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc84fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104719:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc84fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104724:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc84fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104731:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0d80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.104733:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc84fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104737:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc84fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104742:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x45524f8f (ffff8800a6d5fb00) 00010000:00010000:1.0:1716999791.104743:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.104745:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc84fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104749:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0d80/0x6d188eabd8dc84fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104763:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1b00/0x6d188eabd8dc84ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66395 expref: 555 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.104770:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2640/0x6d188eabd8dc8501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66395 expref: 554 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.104774:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:1.0:1716999791.104776:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999791.104777:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b2640, rc 0) 00010000:00010000:1.0:1716999791.104780:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999791.104785:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc8508 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f6639c expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.104810:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc850f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104819:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc850f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104825:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc850f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104833:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8516 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.104837:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00000100:00100000:2.0:1716999791.104977:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480797952 00000100:00100000:2.0:1716999791.104981:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480797952 00000100:00100000:2.0:1716999791.105012:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46036 00000100:00100000:2.0:1716999791.105017:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480797952:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.105120:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480797952:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 102us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.105126:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46036 00000100:00100000:2.0:1716999791.105779:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+554:11584:x1800404480797888:12345-192.168.203.3@tcp:37:rm.0 Request processed in 2102us (3230us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.105786:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9438 00010000:00010000:1.0:1716999791.105846:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.105917:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc851d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x731:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.105925:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc851d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x731:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.105931:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc851d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x731:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999791.105953:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x731:0x0]: returning size 11776 00000004:00200000:1.0:1716999791.105956:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999791.105964:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc851d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x731:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.105970:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc850f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.105973:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc850f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.105981:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc850f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.105985:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b2400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.105987:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc850f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.105991:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc850f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.105997:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999791.105999:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.106001:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc850f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106004:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2400/0x6d188eabd8dc850f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106011:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8516 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106015:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8516 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106019:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106023:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.106024:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8516 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106028:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8516 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106033:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x44454553 (ffff8800a6d5ff00) 00010000:00010000:1.0:1716999791.106034:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.106036:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8516 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106040:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3cc0/0x6d188eabd8dc8516 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106060:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0480/0x6d188eabd8dc8508 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6639c expref: 554 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.106068:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc851d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x731:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6639c expref: 553 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.106073:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x731:0x0].0x0 (ffff8800939bae00) 00010000:00010000:1.0:1716999791.106075:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999791.106077:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800919b33c0, rc 0) 00010000:00010000:1.0:1716999791.106080:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999791.106085:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc8524 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f663a3 expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.106100:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc852b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106105:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc852b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106110:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc852b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106119:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106124:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106129:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106170:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8539 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106176:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106181:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999791.106202:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6f4:0x0]: returning size 11776 00000004:00200000:1.0:1716999791.106204:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999791.106211:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8539 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106217:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc852b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106221:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc852b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106225:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc852b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106228:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b3600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.106230:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc852b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106235:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc852b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106241:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999791.106242:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.106244:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc852b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106248:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b3600/0x6d188eabd8dc852b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106255:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106259:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8532 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106263:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106267:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800919b0240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.106269:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106273:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8532 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106278:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x44a1a1a7 (ffff8800a6d5f500) 00010000:00010000:1.0:1716999791.106280:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.106282:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8532 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106285:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0240/0x6d188eabd8dc8532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106300:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0fc0/0x6d188eabd8dc8524 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663a3 expref: 555 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.106307:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8539 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663a3 expref: 554 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.106312:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0x0 (ffff8800908c6c00) 00010000:00010000:1.0:1716999791.106314:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999791.106315:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a695dd40, rc 0) 00010000:00010000:1.0:1716999791.106318:0:4523:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999791.106323:0:4523:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8540 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f663aa expref: -99 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.106337:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8547 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106342:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8547 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106347:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8547 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106354:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc854e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106359:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc854e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.106363:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc854e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000100:00100000:0.0:1716999791.107617:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.107659:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480798016 00000100:00100000:3.0:1716999791.107665:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480798016 00000100:00100000:3.0:1716999791.107701:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46037 00000100:00100000:3.0:1716999791.107707:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480798016:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.107838:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480798016:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 129us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.107845:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46037 00010000:00010000:1.0:1716999791.108068:0:4523:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc8555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108078:0:4523:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc8555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108085:0:4523:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc8555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00000004:00200000:1.0:1716999791.108115:0:4523:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x72e:0x0]: returning size 11776 00000004:00200000:1.0:1716999791.108117:0:4523:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999791.108126:0:4523:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc8555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108133:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8547 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108138:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8547 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108142:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8547 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108146:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.108149:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8547 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108153:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8547 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108160:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:1.0:1716999791.108162:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.108164:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8547 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108168:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8547 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108176:0:4523:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc854e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108180:0:4523:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc854e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108184:0:4523:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc854e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108188:0:4523:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695d8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.108190:0:4523:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc854e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108194:0:4523:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc854e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108199:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x45439694 (ffff8800a6d5f900) 00010000:00010000:1.0:1716999791.108201:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.108202:0:4523:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc854e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00010000:00010000:1.0:1716999791.108206:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc854e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 4523 initiator: MDT0 00000100:00100000:0.0:1716999791.108533:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.108596:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480798080 00000100:00100000:3.0:1716999791.108600:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480798080 00000100:00100000:3.0:1716999791.108966:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46038 00000100:00100000:3.0:1716999791.108971:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+557:11585:x1800404480798080:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00010000:00010000:1.0:1716999791.109195:0:4523:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663aa expref: 557 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.109205:0:4523:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc8555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663aa expref: 556 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.109211:0:4523:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72e:0x0].0x0 (ffff8800939bad00) 00010000:00010000:1.0:1716999791.109213:0:4523:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999791.109215:0:4523:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a695d440, rc 0) 00000100:00100000:3.0:1716999791.109642:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+556:11585:x1800404480798080:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 669us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.109648:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46038 00000100:00100000:1.0:1716999791.109689:0:4523:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:107d663a-2216-406b-94c6-b2fcb1558728+555:1958:x1800404480797824:12345-192.168.203.3@tcp:63:ll_sa.0 Request processed in 7015us (7117us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.109695:0:4523:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 17 00000100:00100000:0.0:1716999791.110231:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.110595:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480798208 00000100:00100000:3.0:1716999791.110600:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480798208 00000100:00100000:3.0:1716999791.110621:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9439 00000100:00100000:3.0:1716999791.110626:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+555:11584:x1800404480798208:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999791.110985:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+556:11584:x1800404480798208:12345-192.168.203.3@tcp:35:rm.0 Request processed in 357us (754us total) trans 4294986612 rc 0/0 00000100:00100000:3.0:1716999791.110991:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9439 00000100:00100000:0.0:1716999791.113023:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.113121:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480798336 00000100:00100000:3.0:1716999791.113127:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480798336 00000100:00100000:3.0:1716999791.113305:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46039 00000100:00100000:3.0:1716999791.113311:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+556:11584:x1800404480798336:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:3.0:1716999791.113343:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 7 locks, starting at 0 00010000:00010000:3.0:1716999791.113360:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091184000/0x6d188eabd8d707dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6d0:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b611 expref: 556 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.113374:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc8475 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66372 expref: 555 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.113385:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d200/0x6d188eabd8d7c029 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f44d expref: 554 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.113394:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef1f80/0x6d188eabd8d707b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6d0:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5fc expref: 553 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.113402:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff880092624f00) 00010000:00010000:3.0:1716999791.113412:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419cb40/0x6d188eabd8d7a548 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ebc5 expref: 552 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.113420:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fef1680/0x6d188eabd8d7945b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4e685 expref: 551 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.113429:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009215c900/0x6d188eabd8d729ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c465 expref: 550 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.113435:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:3.0:1716999791.113438:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999791.113455:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc855c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.113464:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc855c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.113470:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc855c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.113479:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8563 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.113486:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.113491:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.113569:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc856a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6d0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.113574:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc856a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.113579:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc856a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999791.114400:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.114449:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480798400 00000100:00100000:2.0:1716999791.114454:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480798400 00000100:00100000:2.0:1716999791.114475:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46040 00000100:00100000:2.0:1716999791.114481:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+550:11585:x1800404480798400:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.114606:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+550:11585:x1800404480798400:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 125us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.114613:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46040 00000040:00080000:3.0:1716999791.115452:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].62, 176 off18664 00000004:00200000:3.0:1716999791.115509:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6d0:0x0]: returning size 11776 00010000:00010000:3.0:1716999791.115522:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc856a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115529:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc856a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115542:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc856a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115546:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.115550:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc856a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115555:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc856a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115564:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6d0:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999791.115566:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999791.115569:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc856a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115573:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc856a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6d0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115607:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc855c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115613:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc855c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115617:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc855c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115621:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.115624:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc855c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115628:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc855c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115634:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:3.0:1716999791.115636:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.115638:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc855c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.115642:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc855c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999791.115648:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008eb2ca80 reply state ffff88012e8a4000 transno 4294986613 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999791.115654:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999791.116320:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+551:11584:x1800404480798336:12345-192.168.203.3@tcp:36:rm.0 Request processed in 3006us (3299us total) trans 4294986613 rc 0/0 00000100:00100000:3.0:1716999791.116327:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46039 00000100:00100000:2.0:1716999791.116773:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.117122:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480798464 00000100:00100000:3.0:1716999791.117127:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480798464 00000100:00100000:3.0:1716999791.117147:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46041 00000100:00100000:3.0:1716999791.117152:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+551:11585:x1800404480798464:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.117262:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+551:11585:x1800404480798464:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 108us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.117268:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46041 00010000:00010000:3.0:1716999791.117482:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8563 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.117489:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8563 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.117494:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8563 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.117498:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.117501:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8563 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.117506:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8563 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.117515:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x5052ab9e (ffff8800a5c6e200) 00010000:00010000:3.0:1716999791.117517:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.117520:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8563 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.117527:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8563 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x5052ab9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999791.118211:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.118700:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480798528 00000100:00100000:2.0:1716999791.118705:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480798528 00000100:00100000:2.0:1716999791.118736:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9440 00000100:00100000:2.0:1716999791.118741:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+550:11584:x1800404480798528:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999791.119509:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.119555:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480798592 00000100:00100000:2.0:1716999791.119559:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480798592 00000100:00100000:2.0:1716999791.120383:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46042 00000100:00100000:2.0:1716999791.120389:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+552:11585:x1800404480798592:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.120506:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+552:11585:x1800404480798592:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 115us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.120512:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46042 00000100:00100000:3.0:1716999791.121298:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+550:11584:x1800404480798528:12345-192.168.203.3@tcp:37:rm.0 Request processed in 2554us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.121306:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9440 00000100:00100000:0.0:1716999791.121433:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.121490:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480798656 00000100:00100000:3.0:1716999791.121495:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480798656 00000100:00100000:3.0:1716999791.121524:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46043 00000100:00100000:3.0:1716999791.121529:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+550:11585:x1800404480798656:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.121618:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+550:11585:x1800404480798656:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 87us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.121624:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46043 00000100:00100000:0.0:1716999791.123003:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.123208:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.123383:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480798848 00000100:00100000:3.0:1716999791.123389:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480798848 00000100:00100000:3.0:1716999791.123409:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9441 00000100:00100000:3.0:1716999791.123414:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+550:11584:x1800404480798848:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999791.123721:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec22850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+551:11584:x1800404480798848:12345-192.168.203.3@tcp:35:rm.0 Request processed in 305us (512us total) trans 4294986614 rc 0/0 00000100:00100000:3.0:1716999791.123728:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9441 00000100:00100000:2.0:1716999791.123789:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480798720 00000100:00100000:2.0:1716999791.123805:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480798720 00000100:00100000:2.0:1716999791.123824:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46044 00000100:00100000:2.0:1716999791.123829:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+551:11585:x1800404480798720:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.123932:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+551:11585:x1800404480798720:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 102us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.123938:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46044 00000100:00100000:0.0:1716999791.126570:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.126618:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480798912 00000100:00100000:3.0:1716999791.126625:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480798912 00000100:00100000:3.0:1716999791.126663:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46045 00000100:00100000:3.0:1716999791.127002:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+551:11585:x1800404480798912:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.127149:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+551:11585:x1800404480798912:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 151us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.127156:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46045 00000100:00100000:0.0:1716999791.129983:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.130076:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799040 00000100:00100000:3.0:1716999791.130083:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799040 00000100:00100000:3.0:1716999791.130121:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46046 00000100:00100000:3.0:1716999791.130127:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+551:11584:x1800404480799040:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:3.0:1716999791.130164:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999791.130185:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b180/0x6d188eabd8d7199c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x705:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd57 expref: 551 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.130214:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0b40/0x6d188eabd8dc8491 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66379 expref: 550 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.130226:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009186fa80/0x6d188eabd8d7ea7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50270 expref: 549 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.130236:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6b600/0x6d188eabd8d71979 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x705:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd49 expref: 548 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.130244:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff88012de9cd00) 00010000:00010000:3.0:1716999791.130251:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999791.130272:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc8571 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130282:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc8571 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130290:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc8571 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130308:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8578 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130313:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130318:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130396:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc857f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x705:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130401:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc857f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x705:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130407:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc857f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x705:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:3.0:1716999791.130772:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].63, 176 off18840 00000100:00100000:0.0:1716999791.130786:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000004:00200000:3.0:1716999791.130826:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x705:0x0]: returning size 12800 00000100:00100000:2.0:1716999791.130834:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799104 00010000:00010000:3.0:1716999791.130838:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc857f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x705:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999791.130838:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799104 00010000:00010000:3.0:1716999791.130844:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc857f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x705:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130850:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc857f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x705:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130855:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.130859:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc857f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x705:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130864:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc857f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x705:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999791.130870:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46047 00010000:00010000:3.0:1716999791.130872:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x705:0x0].0x0 (ffff8800a5c6ec00) 00010000:00010000:3.0:1716999791.130874:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00000100:00100000:2.0:1716999791.130876:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+549:11585:x1800404480799104:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00010000:00010000:3.0:1716999791.130877:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc857f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x705:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130899:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53600/0x6d188eabd8dc857f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x705:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130923:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc8571 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130928:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc8571 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130933:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc8571 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130936:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.130939:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc8571 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130943:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc8571 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130949:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:3.0:1716999791.130951:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.130954:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc8571 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.130958:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53180/0x6d188eabd8dc8571 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999791.130964:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008eb2ed80 reply state ffff88012e8a2000 transno 4294986615 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999791.130970:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999791.131009:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+550:11585:x1800404480799104:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 132us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.131015:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46047 00000100:00100000:3.0:1716999791.131023:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+549:11584:x1800404480799040:12345-192.168.203.3@tcp:36:rm.0 Request processed in 895us (1045us total) trans 4294986615 rc 0/0 00000100:00100000:3.0:1716999791.131029:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46046 00010000:00010000:1.0:1716999791.132437:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8578 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999791.132444:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8578 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999791.132449:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999791.132453:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52d00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.132455:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8578 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999791.132460:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8578 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999791.132469:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x41aa9094 (ffff8800a5c6e000) 00010000:00010000:1.0:1716999791.132471:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.132473:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8578 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999791.132477:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8578 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x41aa9094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999791.132838:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.132905:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799168 00000100:00100000:3.0:1716999791.132910:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799168 00000100:00100000:3.0:1716999791.132938:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46048 00000100:00100000:3.0:1716999791.132944:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480799168:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.133046:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480799168:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 101us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.133052:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46048 00000100:00100000:0.0:1716999791.134246:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.134447:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799232 00000100:00100000:2.0:1716999791.134451:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799232 00000100:00100000:2.0:1716999791.134482:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9442 00000100:00100000:2.0:1716999791.134487:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+548:11584:x1800404480799232:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999791.135635:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.135720:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799296 00000100:00100000:3.0:1716999791.135725:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799296 00000100:00100000:3.0:1716999791.136004:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46049 00000100:00100000:3.0:1716999791.136010:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+549:11585:x1800404480799296:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.136119:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+549:11585:x1800404480799296:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 108us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.136125:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46049 00000100:00100000:0.0:1716999791.137511:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.137978:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799360 00000100:00100000:2.0:1716999791.137984:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799360 00000100:00100000:3.0:1716999791.138683:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+549:11584:x1800404480799232:12345-192.168.203.3@tcp:37:rm.0 Request processed in 4193us (4435us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.138691:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9442 00000100:00100000:2.0:1716999791.138827:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46050 00000100:00100000:2.0:1716999791.138833:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480799360:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.138956:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480799360:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 122us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.138962:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46050 00000100:00100000:0.0:1716999791.141489:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.141637:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799424 00000100:00100000:3.0:1716999791.141643:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799424 00000100:00100000:3.0:1716999791.141681:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46051 00000100:00100000:3.0:1716999791.141687:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480799424:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.141820:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480799424:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 132us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.141827:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46051 00000100:00100000:0.0:1716999791.142714:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.142903:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799552 00000100:00100000:3.0:1716999791.142907:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799552 00000100:00100000:3.0:1716999791.142924:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9443 00000100:00100000:3.0:1716999791.142929:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+548:11584:x1800404480799552:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999791.146138:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+549:11584:x1800404480799552:12345-192.168.203.3@tcp:35:rm.0 Request processed in 3202us (3419us total) trans 4294986616 rc 0/0 00000100:00100000:3.0:1716999791.146147:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9443 00000100:00100000:1.0:1716999791.147253:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.147314:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799616 00000100:00100000:2.0:1716999791.147321:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799616 00000100:00100000:2.0:1716999791.147353:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46052 00000100:00100000:2.0:1716999791.147358:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+549:11585:x1800404480799616:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.147458:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+549:11585:x1800404480799616:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 99us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.147463:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46052 00000100:00100000:0.0:1716999791.148967:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.149103:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799744 00000100:00100000:3.0:1716999791.149108:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799744 00000100:00100000:3.0:1716999791.149130:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46053 00000100:00100000:3.0:1716999791.149135:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+549:11584:x1800404480799744:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:3.0:1716999791.149170:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999791.149189:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012faccfc0/0x6d188eabd8d7057c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ca:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b52a expref: 549 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.149205:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b1680/0x6d188eabd8dc84ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66380 expref: 548 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.149213:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f600/0x6d188eabd8d7b9c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f24e expref: 547 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.149223:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920faf40/0x6d188eabd8d70559 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ca:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b51c expref: 546 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.149234:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x0 (ffff8800a660c200) 00010000:00010000:3.0:1716999791.149242:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999791.149262:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc8586 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149272:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc8586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149279:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc8586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149289:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc858d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149294:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc858d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149298:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc858d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149371:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8594 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6ca:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149377:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149382:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:3.0:1716999791.149746:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].64, 176 off19016 00000004:00200000:3.0:1716999791.149810:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6ca:0x0]: returning size 11776 00010000:00010000:3.0:1716999791.149822:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149827:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8594 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149832:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8594 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149836:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c521c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.149839:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8594 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149844:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8594 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149850:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ca:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999791.149852:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999791.149854:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8594 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149858:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc8594 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6ca:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149905:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc8586 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149910:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc8586 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149914:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc8586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149918:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.149920:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc8586 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149928:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc8586 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149934:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:3.0:1716999791.149936:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.149938:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc8586 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.149942:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc8586 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999791.149948:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131c3ca80 reply state ffff88008b77c000 transno 4294986617 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc858d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999791.149953:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999791.149992:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+547:11584:x1800404480799744:12345-192.168.203.3@tcp:36:rm.0 Request processed in 856us (1026us total) trans 4294986617 rc 0/0 00000100:00100000:3.0:1716999791.149998:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46053 00000100:00100000:1.0:1716999791.150346:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.150446:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799808 00000100:00100000:0.0:1716999791.150450:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799808 00000100:00100000:0.0:1716999791.150468:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46054 00000100:00100000:0.0:1716999791.150472:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+547:11585:x1800404480799808:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:0.0:1716999791.150581:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+547:11585:x1800404480799808:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 107us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999791.150587:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46054 00010000:00010000:3.0:1716999791.151677:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc858d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.151684:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc858d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.151688:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc858d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.151692:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.151695:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc858d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.151699:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc858d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.151708:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x45435891 (ffff8800a5c6e700) 00010000:00010000:3.0:1716999791.151710:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.151713:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc858d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.151717:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc858d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x45435891 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999791.152806:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.153099:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799872 00000100:00100000:2.0:1716999791.153105:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799872 00000100:00100000:2.0:1716999791.153129:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9444 00000100:00100000:2.0:1716999791.153135:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+546:11584:x1800404480799872:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999791.154993:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.155345:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480799936 00000100:00100000:3.0:1716999791.155351:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480799936 00000100:00100000:3.0:1716999791.155386:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46055 00000100:00100000:3.0:1716999791.155392:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480799936:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.155519:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480799936:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 127us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.155526:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46055 00000100:00100000:2.0:1716999791.157352:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+546:11584:x1800404480799872:12345-192.168.203.3@tcp:37:rm.0 Request processed in 4212us (4545us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.157360:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9444 00000100:00100000:0.0:1716999791.157512:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.157711:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800000 00000100:00100000:2.0:1716999791.157716:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800000 00000100:00100000:2.0:1716999791.157746:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46056 00000100:00100000:2.0:1716999791.157750:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480800000:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.158706:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480800000:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 952us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.158712:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46056 00000100:00100000:0.0:1716999791.160163:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.160296:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800064 00000100:00100000:2.0:1716999791.160301:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800064 00000100:00100000:2.0:1716999791.160330:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46057 00000100:00100000:2.0:1716999791.160335:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480800064:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.160442:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480800064:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 106us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.160448:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46057 00000100:00100000:0.0:1716999791.160729:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.161552:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800192 00000100:00100000:2.0:1716999791.161556:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800192 00000100:00100000:2.0:1716999791.161574:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9445 00000100:00100000:2.0:1716999791.161577:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+546:11584:x1800404480800192:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:0.0:1716999791.162235:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.162346:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800256 00000100:00100000:3.0:1716999791.162349:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800256 00000100:00100000:3.0:1716999791.162366:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46058 00000100:00100000:3.0:1716999791.162370:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480800256:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.162593:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+548:11584:x1800404480800192:12345-192.168.203.3@tcp:35:rm.0 Request processed in 1013us (1864us total) trans 4294986618 rc 0/0 00000100:00100000:2.0:1716999791.162600:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9445 00000100:00100000:3.0:1716999791.162670:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+547:11585:x1800404480800256:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 298us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.162676:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46058 00000100:00100000:0.0:1716999791.163984:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.164021:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.164089:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800320 00000100:00100000:3.0:1716999791.164093:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800320 00000100:00100000:2.0:1716999791.164106:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800448 00000100:00100000:2.0:1716999791.164109:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800448 00000100:00100000:3.0:1716999791.164125:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46059 00000100:00100000:2.0:1716999791.164129:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46060 00000100:00100000:3.0:1716999791.164130:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+548:11585:x1800404480800320:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.164133:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+548:11584:x1800404480800448:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:2.0:1716999791.164164:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999791.164181:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091185680/0x6d188eabd8d716d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6fd:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc3f expref: 548 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.164194:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b0000/0x6d188eabd8dc84c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66387 expref: 547 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.164217:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999e0000/0x6d188eabd8d7e70b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5013c expref: 546 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.164227:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091186880/0x6d188eabd8d716af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6fd:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc31 expref: 545 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.164234:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x0 (ffff8800910ceb00) 00000100:00100000:3.0:1716999791.164238:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+544:11585:x1800404480800320:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 108us (256us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999791.164242:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999791.164243:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46059 00010000:00010000:2.0:1716999791.164259:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc859b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.164269:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc859b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.164280:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc859b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.164290:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc85a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.164298:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc85a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.164303:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc85a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.164367:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc85a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6fd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.164373:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc85a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.164378:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc85a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:2.0:1716999791.164782:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].65, 176 off19192 00000004:00200000:2.0:1716999791.164840:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6fd:0x0]: returning size 11776 00010000:00010000:2.0:1716999791.164851:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc85a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.164856:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc85a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.164861:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc85a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.164866:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.164869:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc85a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.164874:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc85a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.165194:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6fd:0x0].0x0 (ffff880088977700) 00010000:00010000:2.0:1716999791.165197:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999791.165200:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc85a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.165204:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830480/0x6d188eabd8dc85a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6fd:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.165628:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc859b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.165633:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc859b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.165637:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc859b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.165641:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.165644:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc859b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.165648:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc859b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.165655:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:3.0:1716999791.165657:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.165659:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc859b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.165662:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc859b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999791.165669:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131c3ea00 reply state ffff880133934000 transno 4294986619 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc85a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999791.165675:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999791.165709:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+545:11584:x1800404480800448:12345-192.168.203.3@tcp:36:rm.0 Request processed in 1573us (1686us total) trans 4294986619 rc 0/0 00000100:00100000:3.0:1716999791.165715:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46060 00000100:00100000:0.0:1716999791.166527:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.166599:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800512 00000100:00100000:3.0:1716999791.166605:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800512 00000100:00100000:3.0:1716999791.166625:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46061 00000100:00100000:3.0:1716999791.166630:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+545:11585:x1800404480800512:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.167281:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+545:11585:x1800404480800512:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 648us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.167286:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46061 00010000:00010000:2.0:1716999791.167439:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc85a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.167445:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc85a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.167449:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc85a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.167453:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833600 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.167456:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc85a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.167461:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc85a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.167468:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x4d50 (ffff880088977800) 00010000:00010000:2.0:1716999791.167471:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.167473:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc85a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.167477:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833600/0x6d188eabd8dc85a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x4d50 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999791.169031:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.169090:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800576 00000100:00100000:2.0:1716999791.169095:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800576 00000100:00100000:0.0:1716999791.169102:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.169138:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800640 00000100:00100000:3.0:1716999791.169141:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800640 00000100:00100000:2.0:1716999791.169155:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9446 00000100:00100000:2.0:1716999791.169161:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+545:11584:x1800404480800576:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:3.0:1716999791.169189:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46062 00000100:00100000:3.0:1716999791.169193:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+545:11585:x1800404480800640:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.169288:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+545:11585:x1800404480800640:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 94us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.169293:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46062 00000100:00100000:0.0:1716999791.170450:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.170487:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800704 00000100:00100000:3.0:1716999791.170490:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800704 00000100:00100000:3.0:1716999791.170505:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46063 00000100:00100000:3.0:1716999791.170509:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480800704:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.170586:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480800704:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 75us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.170595:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46063 00000100:00100000:0.0:1716999791.171682:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.171728:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800768 00000100:00100000:3.0:1716999791.171732:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800768 00000100:00100000:3.0:1716999791.171748:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46064 00000100:00100000:3.0:1716999791.171753:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+546:11585:x1800404480800768:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.172288:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+545:11585:x1800404480800768:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 532us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.172294:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46064 00000100:00100000:2.0:1716999791.172410:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec22450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+544:11584:x1800404480800576:12345-192.168.203.3@tcp:37:rm.0 Request processed in 3248us (3381us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.172417:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9446 00000100:00100000:0.0:1716999791.174341:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.174400:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800832 00000100:00100000:3.0:1716999791.174406:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800832 00000100:00100000:3.0:1716999791.174429:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46065 00000100:00100000:3.0:1716999791.174434:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+544:11585:x1800404480800832:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.175141:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+544:11585:x1800404480800832:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 703us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.175147:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46065 00000100:00100000:1.0:1716999791.175754:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.175914:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480800960 00000100:00100000:2.0:1716999791.175918:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480800960 00000100:00100000:2.0:1716999791.175937:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9447 00000100:00100000:2.0:1716999791.175942:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+544:11584:x1800404480800960:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:2.0:1716999791.176262:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+545:11584:x1800404480800960:12345-192.168.203.3@tcp:35:rm.0 Request processed in 319us (508us total) trans 4294986620 rc 0/0 00000100:00100000:2.0:1716999791.176268:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9447 00000100:00100000:0.0:1716999791.178205:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.178295:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801024 00000100:00100000:3.0:1716999791.178301:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801024 00000100:00100000:3.0:1716999791.178329:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46066 00000100:00100000:3.0:1716999791.178333:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+545:11585:x1800404480801024:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.179046:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+545:11585:x1800404480801024:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 709us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.179054:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46066 00000100:00100000:0.0:1716999791.180402:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.180581:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801152 00000100:00100000:3.0:1716999791.180587:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801152 00000100:00100000:3.0:1716999791.180609:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46067 00000100:00100000:3.0:1716999791.180614:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+545:11584:x1800404480801152:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:3.0:1716999791.180649:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999791.180668:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920f9f80/0x6d188eabd8d70296 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6c2:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b404 expref: 545 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.180700:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2d00/0x6d188eabd8dc84e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6638e expref: 544 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.180711:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c576d00/0x6d188eabd8d7b19d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4efd8 expref: 543 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.180721:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c576400/0x6d188eabd8d70265 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6c2:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b3ef expref: 542 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.180728:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff880092a37b00) 00010000:00010000:3.0:1716999791.180736:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999791.180756:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc85b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.180766:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc85b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.180773:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc85b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.180783:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc85b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.180788:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc85b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.180802:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc85b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.180897:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc85be lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6c2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.180907:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc85be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.180913:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc85be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000040:00080000:3.0:1716999791.181274:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].66, 176 off19368 00000004:00200000:3.0:1716999791.181318:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6c2:0x0]: returning size 11776 00010000:00010000:3.0:1716999791.181328:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc85be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181334:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc85be lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181339:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc85be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181343:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c521c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.181345:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc85be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181350:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc85be lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181356:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6c2:0x0].0x0 (ffff8800a5c6eb00) 00010000:00010000:3.0:1716999791.181358:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999791.181360:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc85be lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181364:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc85be lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6c2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181387:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc85b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181391:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc85b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181395:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc85b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181398:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.181400:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc85b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181403:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc85b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181408:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:3.0:1716999791.181409:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.181411:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc85b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.181414:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51680/0x6d188eabd8dc85b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999791.181419:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880131c3dc00 reply state ffff88008b77f000 transno 4294986621 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc85b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999791.181423:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999791.181474:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+543:11584:x1800404480801152:12345-192.168.203.3@tcp:36:rm.0 Request processed in 858us (1073us total) trans 4294986621 rc 0/0 00000100:00100000:3.0:1716999791.181479:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46067 00000100:00100000:1.0:1716999791.181957:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.182777:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801216 00000100:00100000:0.0:1716999791.182783:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801216 00000100:00100000:0.0:1716999791.182829:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46068 00000100:00100000:0.0:1716999791.182835:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+543:11585:x1800404480801216:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.183226:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+543:11585:x1800404480801216:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 389us (1268us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.183235:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46068 00010000:00010000:3.0:1716999791.183294:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc85b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.183302:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc85b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.183309:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc85b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.183313:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.183315:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc85b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.183321:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc85b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.183330:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x44524f57 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999791.183333:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.183336:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc85b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.183340:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51200/0x6d188eabd8dc85b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x44524f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999791.184018:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.184059:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801280 00000100:00100000:3.0:1716999791.184063:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801280 00000100:00100000:3.0:1716999791.184092:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46069 00000100:00100000:3.0:1716999791.184096:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+542:11585:x1800404480801280:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.184193:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+542:11585:x1800404480801280:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 94us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.184198:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46069 00000100:00100000:0.0:1716999791.185584:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.185622:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.185631:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801344 00000100:00100000:1.0:1716999791.185636:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801344 00000100:00100000:3.0:1716999791.185665:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801408 00000100:00100000:3.0:1716999791.185669:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801408 00000100:00100000:3.0:1716999791.185697:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46070 00000100:00100000:3.0:1716999791.185702:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+543:11585:x1800404480801408:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.185786:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+543:11585:x1800404480801408:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 83us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.185803:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46070 00000100:00100000:1.0:1716999791.186006:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9448 00000100:00100000:1.0:1716999791.186011:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+542:11584:x1800404480801344:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999791.188131:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.188167:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.188186:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801472 00000100:00100000:2.0:1716999791.188192:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801472 00000100:00100000:3.0:1716999791.188212:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801536 00000100:00100000:3.0:1716999791.188216:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801536 00000100:00100000:2.0:1716999791.188216:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46071 00000100:00100000:2.0:1716999791.188221:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+545:11585:x1800404480801472:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.188233:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46072 00000100:00100000:3.0:1716999791.188238:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+545:11581:x1800404480801536:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.188251:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1716999791.188333:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+545:11585:x1800404480801472:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 110us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.188339:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46071 00000004:00000080:3.0:1716999791.188977:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:3.0:1716999791.189004:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+544:11581:x1800404480801536:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 765us (836us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.189010:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46072 00000100:00100000:0.0:1716999791.189725:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+542:11584:x1800404480801344:12345-192.168.203.3@tcp:37:rm.0 Request processed in 3711us (4140us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999791.189733:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9448 00000100:00100000:0.0:1716999791.191182:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.191212:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.191326:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801600 00000100:00100000:3.0:1716999791.191330:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801600 00000100:00100000:3.0:1716999791.191346:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801664 00000100:00100000:3.0:1716999791.191348:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801664 00000100:00100000:2.0:1716999791.191358:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46073 00000100:00100000:3.0:1716999791.191363:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46074 00000100:00100000:2.0:1716999791.191364:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+543:11585:x1800404480801600:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.191366:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+543:11581:x1800404480801664:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.191397:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.191440:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:3.0:1716999791.191469:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+543:11581:x1800404480801664:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 103us (256us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.191474:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46074 00000100:00100000:2.0:1716999791.191484:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+542:11585:x1800404480801600:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 119us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.191490:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46073 00000100:00100000:0.0:1716999791.192757:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.192786:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.192813:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801792 00000100:00100000:2.0:1716999791.192817:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801792 00000100:00100000:0.0:1716999791.192835:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.192851:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9449 00000100:00100000:2.0:1716999791.192856:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+542:11584:x1800404480801792:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:2.0:1716999791.193350:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+543:11584:x1800404480801792:12345-192.168.203.3@tcp:35:rm.0 Request processed in 493us (595us total) trans 4294986622 rc 0/0 00000100:00100000:2.0:1716999791.193356:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9449 00000100:00100000:2.0:1716999791.193372:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801920 00000100:00100000:2.0:1716999791.193374:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801920 00000100:00100000:2.0:1716999791.193385:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480801856 00000100:00100000:2.0:1716999791.193387:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480801856 00000100:00100000:2.0:1716999791.193396:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46075 00000100:00100000:2.0:1716999791.193400:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+544:11581:x1800404480801920:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.193411:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc0a:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.193447:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc0a:0x0]: rc = -2 00000100:00100000:2.0:1716999791.193465:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+544:11581:x1800404480801920:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 64us (678us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.193470:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46075 00000100:00100000:2.0:1716999791.193479:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46076 00000100:00100000:2.0:1716999791.193483:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+543:11585:x1800404480801856:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.193553:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+543:11585:x1800404480801856:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 68us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.193559:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46076 00000100:00100000:0.0:1716999791.194989:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.195068:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802048 00000100:00100000:3.0:1716999791.195073:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802048 00000100:00100000:3.0:1716999791.195098:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46077 00000100:00100000:3.0:1716999791.195104:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+543:11584:x1800404480802048:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:3.0:1716999791.195132:0:7785:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999791.195149:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f25d40/0x6d188eabd8d70c44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6dc:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7d1 expref: 543 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.195164:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b2640/0x6d188eabd8dc8501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66395 expref: 542 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.195175:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ed200/0x6d188eabd8d7cab7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4f7e9 expref: 541 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.195187:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f246c0/0x6d188eabd8d70c05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6dc:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7bc expref: 540 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.195194:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff880092624900) 00010000:00010000:3.0:1716999791.195201:0:7785:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999791.195218:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc85c5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195228:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc85c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195236:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc85c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195244:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc85cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195249:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc85cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195255:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc85cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:0.0:1716999791.195451:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999791.195477:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc85d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6dc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195484:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc85d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195490:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc85d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:2.0:1716999791.195587:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802112 00000100:00100000:2.0:1716999791.195592:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802112 00000100:00100000:2.0:1716999791.195618:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46078 00000100:00100000:2.0:1716999791.195623:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+540:11581:x1800404480802112:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.195637:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.195671:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:2.0:1716999791.195706:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+540:11581:x1800404480802112:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 82us (255us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.195712:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46078 00000040:00080000:3.0:1716999791.195830:0:7785:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].67, 176 off19544 00000004:00200000:3.0:1716999791.195869:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6dc:0x0]: returning size 12800 00010000:00010000:3.0:1716999791.195900:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc85d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195907:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc85d3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195912:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc85d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195918:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50000 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.195921:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc85d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195927:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc85d3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195934:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6dc:0x0].0x0 (ffff8800a5c6ef00) 00010000:00010000:3.0:1716999791.195936:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999791.195939:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc85d3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195944:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50000/0x6d188eabd8dc85d3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6dc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195966:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc85c5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195971:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc85c5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195976:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc85c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195979:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.195981:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc85c5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195986:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc85c5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195991:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:3.0:1716999791.195993:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.195995:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc85c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.195999:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50240/0x6d188eabd8dc85c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00010000:3.0:1716999791.196004:0:7785:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008f779f80 reply state ffff88008b77d000 transno 4294986623 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc85cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999791.196009:0:7785:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999791.196032:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.196049:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+541:11584:x1800404480802048:12345-192.168.203.3@tcp:36:rm.0 Request processed in 944us (1061us total) trans 4294986623 rc 0/0 00000100:00100000:3.0:1716999791.196055:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46077 00000100:00100000:3.0:1716999791.196067:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802176 00000100:00100000:3.0:1716999791.196070:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802176 00000100:00100000:3.0:1716999791.196087:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46079 00000100:00100000:3.0:1716999791.196092:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+541:11585:x1800404480802176:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.196161:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+541:11585:x1800404480802176:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 68us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.196166:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46079 00000100:00100000:0.0:1716999791.198267:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.198295:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.198321:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.198384:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802240 00000100:00100000:3.0:1716999791.198389:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802240 00010000:00010000:2.0:1716999791.198399:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc85cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.198406:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc85cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.198411:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc85cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999791.198412:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802304 00000100:00100000:3.0:1716999791.198414:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802304 00010000:00010000:2.0:1716999791.198415:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.198418:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc85cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.198423:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc85cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00000100:00100000:3.0:1716999791.198426:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46080 00000100:00100000:3.0:1716999791.198432:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+542:11581:x1800404480802240:12345-192.168.203.3@tcp:53:lustre_rsync.0 00010000:00010000:2.0:1716999791.198432:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x45524f8f (ffff8800a5c6e100) 00010000:00010000:2.0:1716999791.198434:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.198437:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc85cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:2.0:1716999791.198441:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc85cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x45524f8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00000004:00000080:3.0:1716999791.198448:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1716999791.198484:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46081 00000004:00000080:3.0:1716999791.198490:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:1.0:1716999791.198490:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+542:11585:x1800404480802304:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.198515:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+542:11581:x1800404480802240:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (252us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.198521:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46080 00000100:00100000:1.0:1716999791.198581:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+540:11585:x1800404480802304:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 89us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.198584:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802368 00000100:00100000:1.0:1716999791.198587:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46081 00000100:00100000:2.0:1716999791.198588:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802368 00000100:00100000:2.0:1716999791.198605:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9450 00000100:00100000:2.0:1716999791.198610:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+540:11584:x1800404480802368:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999791.200697:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.200734:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.200848:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802432 00000100:00100000:1.0:1716999791.200853:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802432 00000100:00100000:1.0:1716999791.201153:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802496 00000100:00100000:1.0:1716999791.201155:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802496 00000100:00100000:2.0:1716999791.201199:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46082 00000100:00100000:2.0:1716999791.201206:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+543:11581:x1800404480802432:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000100:00100000:1.0:1716999791.201206:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46083 00000100:00100000:1.0:1716999791.201211:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+543:11585:x1800404480802496:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000004:00000080:2.0:1716999791.201225:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc0b:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.201277:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc0b:0x0]: rc = -2 00000100:00100000:2.0:1716999791.201305:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+543:11581:x1800404480802432:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (611us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.201306:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+543:11585:x1800404480802496:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 94us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.201311:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46082 00000100:00100000:1.0:1716999791.201361:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46083 00000100:00100000:3.0:1716999791.202131:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+540:11584:x1800404480802368:12345-192.168.203.3@tcp:37:rm.0 Request processed in 3519us (3808us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.202139:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9450 00000100:00100000:0.0:1716999791.202805:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.202843:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802560 00000100:00100000:2.0:1716999791.202847:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802560 00000100:00100000:2.0:1716999791.202896:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46084 00000100:00100000:2.0:1716999791.202901:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+540:11585:x1800404480802560:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.203046:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+540:11585:x1800404480802560:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 92us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.203052:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46084 00000100:00100000:0.0:1716999791.203161:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.203247:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802624 00000100:00100000:2.0:1716999791.203251:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802624 00000100:00100000:2.0:1716999791.203377:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46085 00000100:00100000:2.0:1716999791.203382:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+540:11581:x1800404480802624:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.203394:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc0c:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.203445:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc0c:0x0]: rc = -2 00000100:00100000:2.0:1716999791.203472:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+540:11581:x1800404480802624:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (311us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.203477:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46085 00000100:00100000:0.0:1716999791.203876:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.204010:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802752 00000100:00100000:3.0:1716999791.204014:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802752 00000100:00100000:3.0:1716999791.204032:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9451 00000100:00100000:3.0:1716999791.204037:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+540:11584:x1800404480802752:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999791.204331:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec22050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+541:11584:x1800404480802752:12345-192.168.203.3@tcp:35:rm.0 Request processed in 292us (454us total) trans 4294986624 rc 0/0 00000100:00100000:3.0:1716999791.204340:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9451 00000100:00100000:0.0:1716999791.204478:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.204678:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802816 00000100:00100000:1.0:1716999791.204682:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802816 00000100:00100000:1.0:1716999791.204699:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46086 00000100:00100000:1.0:1716999791.204704:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+541:11585:x1800404480802816:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.204801:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+541:11585:x1800404480802816:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 85us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.204808:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46086 00000100:00100000:0.0:1716999791.205686:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.205724:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480802880 00000100:00100000:2.0:1716999791.205728:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480802880 00000100:00100000:2.0:1716999791.205755:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46087 00000100:00100000:2.0:1716999791.205760:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+541:11581:x1800404480802880:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.205773:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.205823:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:2.0:1716999791.205852:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+541:11581:x1800404480802880:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 91us (167us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.205858:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46087 00000100:00100000:0.0:1716999791.206976:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.207008:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.207044:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803008 00000100:00100000:2.0:1716999791.207049:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803008 00000100:00100000:2.0:1716999791.207079:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803072 00000100:00100000:2.0:1716999791.207082:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803072 00000100:00100000:1.0:1716999791.207292:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46088 00000100:00100000:1.0:1716999791.207300:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+542:11585:x1800404480803008:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.207310:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46089 00000100:00100000:2.0:1716999791.207316:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+542:11584:x1800404480803072:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:2.0:1716999791.207343:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999791.207362:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009419db00/0x6d188eabd8d7279c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x731:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c370 expref: 542 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.207381:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b33c0/0x6d188eabd8dc851d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x731:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6639c expref: 541 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.207391:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009477aac0/0x6d188eabd8d81429 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x731:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f5100e expref: 540 pid: 6823 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999791.207399:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+539:11585:x1800404480803008:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 98us (423us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999791.207401:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c1d40/0x6d188eabd8d72779 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x731:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c362 expref: 539 pid: 6822 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999791.207406:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46088 00010000:00010000:2.0:1716999791.207409:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x731:0x0].0x0 (ffff8800939bae00) 00010000:00010000:2.0:1716999791.207416:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999791.207434:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc85da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.207449:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc85da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.207456:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc85da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.207466:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc85e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.207472:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc85e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.207476:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc85e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.207539:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc85e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x731:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.207545:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc85e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x731:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.207550:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc85e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x731:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999791.207873:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.207910:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803136 00000100:00100000:3.0:1716999791.207915:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803136 00000040:00080000:2.0:1716999791.207928:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].68, 176 off19720 00000100:00100000:3.0:1716999791.207933:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46090 00000100:00100000:3.0:1716999791.207938:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+539:11581:x1800404480803136:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.207950:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00200000:2.0:1716999791.207969:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x731:0x0]: returning size 11776 00010000:00010000:2.0:1716999791.207979:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc85e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x731:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00000004:00000080:3.0:1716999791.207984:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00010000:00010000:2.0:1716999791.207984:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc85e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x731:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.207992:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc85e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x731:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.207996:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.207999:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc85e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x731:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.208003:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc85e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x731:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999791.208004:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+539:11581:x1800404480803136:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 65us (131us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.208009:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46090 00010000:00010000:2.0:1716999791.208009:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x731:0x0].0x0 (ffff880088977100) 00010000:00010000:2.0:1716999791.208011:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999791.208013:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc85e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x731:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.208017:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831440/0x6d188eabd8dc85e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x731:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.208035:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc85da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.208039:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc85da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.208043:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc85da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.208047:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830240 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.208049:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc85da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.208053:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc85da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.208063:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:2.0:1716999791.208065:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.208067:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc85da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.208071:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830240/0x6d188eabd8dc85da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:2.0:1716999791.208076:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012ea9c380 reply state ffff880133933000 transno 4294986625 ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc85e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999791.208081:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999791.208121:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+539:11584:x1800404480803072:12345-192.168.203.3@tcp:36:rm.0 Request processed in 804us (1111us total) trans 4294986625 rc 0/0 00000100:00100000:2.0:1716999791.208127:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46089 00000100:00100000:0.0:1716999791.208925:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999791.209020:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc85e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.209027:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc85e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.209033:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc85e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.209037:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.209040:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc85e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.209045:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc85e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.209053:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x44454553 (ffff880088977000) 00010000:00010000:3.0:1716999791.209055:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.209057:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc85e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.209062:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833840/0x6d188eabd8dc85e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x44454553 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999791.209316:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803200 00000100:00100000:2.0:1716999791.209324:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803200 00000100:00100000:2.0:1716999791.209353:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46091 00000100:00100000:2.0:1716999791.209358:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+538:11585:x1800404480803200:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.209446:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+538:11585:x1800404480803200:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 87us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.209452:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46091 00000100:00100000:0.0:1716999791.209575:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.209936:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803264 00000100:00100000:2.0:1716999791.209940:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803264 00000100:00100000:2.0:1716999791.209962:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46092 00000100:00100000:2.0:1716999791.209966:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+538:11581:x1800404480803264:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.209978:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.210015:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:2.0:1716999791.210041:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+538:11581:x1800404480803264:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 74us (466us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.210046:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46092 00000100:00100000:0.0:1716999791.211006:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.211031:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.211056:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.211080:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803392 00000100:00100000:2.0:1716999791.211083:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803392 00000100:00100000:2.0:1716999791.211098:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803456 00000100:00100000:2.0:1716999791.211100:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803456 00000100:00100000:3.0:1716999791.211103:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46093 00000100:00100000:3.0:1716999791.211109:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+539:11581:x1800404480803392:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.211125:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.211164:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:2.0:1716999791.211178:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46094 00000100:00100000:2.0:1716999791.211183:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+539:11585:x1800404480803456:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.211293:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+539:11581:x1800404480803392:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 183us (260us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.211299:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46093 00000100:00100000:2.0:1716999791.211331:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+538:11585:x1800404480803456:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 145us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.211337:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46094 00000100:00100000:3.0:1716999791.211339:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803328 00000100:00100000:3.0:1716999791.211342:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803328 00000100:00100000:3.0:1716999791.211398:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9452 00000100:00100000:3.0:1716999791.211403:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+538:11584:x1800404480803328:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999791.212300:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.212375:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.212518:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803520 00000100:00100000:3.0:1716999791.212522:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803520 00000100:00100000:3.0:1716999791.212545:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803584 00000100:00100000:3.0:1716999791.212547:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803584 00000100:00100000:3.0:1716999791.212583:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46095 00000100:00100000:3.0:1716999791.212588:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+541:11581:x1800404480803520:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000100:00100000:1.0:1716999791.212590:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46096 00000100:00100000:1.0:1716999791.212596:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+541:11585:x1800404480803584:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000004:00000080:3.0:1716999791.212603:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc0d:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.212638:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc0d:0x0]: rc = -2 00000100:00100000:3.0:1716999791.212657:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+541:11581:x1800404480803520:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 69us (358us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.212663:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46095 00000100:00100000:1.0:1716999791.213221:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+539:11585:x1800404480803584:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 624us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.213227:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46096 00000100:00100000:3.0:1716999791.213540:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+538:11584:x1800404480803328:12345-192.168.203.3@tcp:37:rm.0 Request processed in 2135us (2533us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.213547:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9452 00000100:00100000:0.0:1716999791.214105:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.214138:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.214191:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803648 00000100:00100000:1.0:1716999791.214196:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803648 00000100:00100000:1.0:1716999791.214220:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803712 00000100:00100000:1.0:1716999791.214223:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803712 00000100:00100000:1.0:1716999791.214234:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46097 00000100:00100000:1.0:1716999791.214238:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+539:11581:x1800404480803648:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.214249:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc0e:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.214288:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc0e:0x0]: rc = -2 00000100:00100000:1.0:1716999791.214306:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+539:11581:x1800404480803648:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 68us (202us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.214312:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46097 00000100:00100000:1.0:1716999791.214321:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46098 00000100:00100000:1.0:1716999791.214324:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+538:11585:x1800404480803712:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.214388:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+538:11585:x1800404480803712:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 62us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.214393:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46098 00000100:00100000:0.0:1716999791.215339:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.215375:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803840 00000100:00100000:3.0:1716999791.215379:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803840 00000100:00100000:3.0:1716999791.215408:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9453 00000100:00100000:3.0:1716999791.215413:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+538:11584:x1800404480803840:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999791.215699:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+539:11584:x1800404480803840:12345-192.168.203.3@tcp:35:rm.0 Request processed in 285us (361us total) trans 4294986626 rc 0/0 00000100:00100000:3.0:1716999791.215705:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9453 00000100:00100000:0.0:1716999791.215746:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.215812:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.215909:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803904 00000100:00100000:3.0:1716999791.215913:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803904 00000100:00100000:3.0:1716999791.215926:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480803968 00000100:00100000:3.0:1716999791.215928:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480803968 00000100:00100000:3.0:1716999791.215944:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46099 00000100:00100000:3.0:1716999791.215948:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+540:11585:x1800404480803904:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999791.215965:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46100 00000100:00100000:1.0:1716999791.215971:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+540:11581:x1800404480803968:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.215984:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1716999791.216014:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+540:11585:x1800404480803904:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 64us (646us total) trans 0 rc 0/0 00000004:00000080:1.0:1716999791.216018:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:3.0:1716999791.216020:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46099 00000100:00100000:1.0:1716999791.216036:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+539:11581:x1800404480803968:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 64us (223us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.216041:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46100 00000100:00100000:2.0:1716999791.217070:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.217214:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804096 00000100:00100000:0.0:1716999791.217219:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804096 00000100:00100000:0.0:1716999791.217251:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46101 00000100:00100000:0.0:1716999791.217256:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+539:11584:x1800404480804096:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:0.0:1716999791.217283:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999791.217301:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f25200/0x6d188eabd8d713de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6f4:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb19 expref: 539 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999791.217319:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8539 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663a3 expref: 538 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999791.217329:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51f80/0x6d188eabd8d7e051 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ff13 expref: 537 pid: 16641 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999791.217339:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099f258c0/0x6d188eabd8d7139f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6f4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb04 expref: 536 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999791.217346:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0x0 (ffff8800908c6c00) 00010000:00010000:0.0:1716999791.217354:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999791.217371:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc85ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.217381:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc85ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.217389:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc85ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.217398:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68900/0x6d188eabd8dc85f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.217403:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68900/0x6d188eabd8dc85f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.217408:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68900/0x6d188eabd8dc85f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.217487:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a640/0x6d188eabd8dc85fd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6f4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.217497:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a640/0x6d188eabd8dc85fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.217503:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a640/0x6d188eabd8dc85fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999791.217789:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.217829:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000040:00080000:0.0:1716999791.217851:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].69, 176 off19896 00000100:00100000:1.0:1716999791.217866:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804160 00000100:00100000:1.0:1716999791.217871:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804160 00000100:00100000:3.0:1716999791.217875:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804224 00000100:00100000:3.0:1716999791.217893:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804224 00000100:00100000:1.0:1716999791.217902:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46102 00000100:00100000:1.0:1716999791.217907:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+538:11585:x1800404480804160:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000004:00200000:0.0:1716999791.217913:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6f4:0x0]: returning size 11776 00000100:00100000:3.0:1716999791.217914:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46103 00000100:00100000:3.0:1716999791.217919:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+538:11581:x1800404480804224:12345-192.168.203.3@tcp:53:lustre_rsync.0 00010000:00010000:0.0:1716999791.217923:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a640/0x6d188eabd8dc85fd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.217929:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a640/0x6d188eabd8dc85fd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00000004:00000080:3.0:1716999791.217931:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00010000:00010000:0.0:1716999791.217934:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a640/0x6d188eabd8dc85fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.217939:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6a640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999791.217942:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a640/0x6d188eabd8dc85fd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.217947:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a640/0x6d188eabd8dc85fd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.217954:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6f4:0x0].0x0 (ffff88009cfbdc00) 00010000:00010000:0.0:1716999791.217956:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999791.217958:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a640/0x6d188eabd8dc85fd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00000080:3.0:1716999791.217962:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00010000:00010000:0.0:1716999791.217963:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6a640/0x6d188eabd8dc85fd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6f4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.218001:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc85ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.218007:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc85ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.218011:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc85ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.218014:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6bcc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999791.218016:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc85ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.218020:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc85ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.218026:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:0.0:1716999791.218027:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999791.218030:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc85ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.218034:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc85ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999791.218036:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+538:11585:x1800404480804160:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 129us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.218042:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46102 00000004:00010000:0.0:1716999791.218048:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88012b7f5880 reply state ffff88012bd99000 transno 4294986627 ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68900/0x6d188eabd8dc85f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999791.218054:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999791.218097:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+538:11584:x1800404480804096:12345-192.168.203.3@tcp:36:rm.0 Request processed in 839us (1027us total) trans 4294986627 rc 0/0 00000100:00100000:0.0:1716999791.218103:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46101 00000100:00100000:3.0:1716999791.218427:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+537:11581:x1800404480804224:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 506us (596us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.218436:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46103 00010000:00010000:2.0:1716999791.220185:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68900/0x6d188eabd8dc85f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.220194:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68900/0x6d188eabd8dc85f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.220199:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68900/0x6d188eabd8dc85f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.220203:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e68900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.220205:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68900/0x6d188eabd8dc85f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.220210:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68900/0x6d188eabd8dc85f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.220220:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x44a1a1a7 (ffff8801361a8a00) 00010000:00010000:2.0:1716999791.220222:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.220225:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68900/0x6d188eabd8dc85f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.220229:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68900/0x6d188eabd8dc85f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x44a1a1a7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999791.220756:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.220811:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804288 00000100:00100000:3.0:1716999791.220816:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804288 00000100:00100000:3.0:1716999791.220849:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46104 00000100:00100000:3.0:1716999791.220856:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11581:x1800404480804288:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.220877:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.221006:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:3.0:1716999791.221033:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11581:x1800404480804288:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 176us (278us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.221039:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46104 00000100:00100000:0.0:1716999791.221240:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.221526:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804352 00000100:00100000:3.0:1716999791.221531:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804352 00000100:00100000:3.0:1716999791.221557:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46105 00000100:00100000:3.0:1716999791.221562:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11585:x1800404480804352:12345-192.168.203.3@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1716999791.221609:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+536:11585:x1800404480804352:12345-192.168.203.3@tcp:501:chlg_load_threa.0 Request processed in 46us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.221614:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46105 00000100:00100000:0.0:1716999791.222292:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.222400:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804416 00000100:00100000:1.0:1716999791.222404:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804416 00000100:00100000:1.0:1716999791.222427:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9454 00000100:00100000:1.0:1716999791.222432:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11584:x1800404480804416:12345-192.168.203.3@tcp:37:rm.0 00000100:00100000:0.0:1716999791.223249:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.223570:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804480 00000100:00100000:1.0:1716999791.223575:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804480 00000100:00100000:0.0:1716999791.223696:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.224336:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804544 00000100:00100000:1.0:1716999791.224340:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804544 00000100:00100000:1.0:1716999791.224363:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46106 00000100:00100000:1.0:1716999791.224368:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+539:11581:x1800404480804480:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.224385:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1716999791.224417:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46107 00000100:00100000:2.0:1716999791.224424:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+539:11585:x1800404480804544:12345-192.168.203.3@tcp:503:chlg_load_threa.0 00000004:00000080:1.0:1716999791.224435:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:1.0:1716999791.224458:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+539:11581:x1800404480804480:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 90us (1210us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.224463:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46106 00000100:00100000:2.0:1716999791.224503:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11585:x1800404480804544:12345-192.168.203.3@tcp:503:chlg_load_threa.0 Request processed in 79us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.224509:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46107 00000100:00100000:1.0:1716999791.225405:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+536:11584:x1800404480804416:12345-192.168.203.3@tcp:37:rm.0 Request processed in 2971us (3111us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.225412:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9454 00000100:00100000:0.0:1716999791.225653:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.226163:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804608 00000100:00100000:3.0:1716999791.226169:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804608 00000100:00100000:3.0:1716999791.226199:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46108 00000100:00100000:3.0:1716999791.226204:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+536:11581:x1800404480804608:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.226218:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc0f:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.226262:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc0f:0x0]: rc = -2 00000100:00100000:3.0:1716999791.226294:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+536:11581:x1800404480804608:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (640us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.226303:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46108 00000100:00100000:0.0:1716999791.227988:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.228019:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.228080:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.228126:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804672 00000100:00100000:2.0:1716999791.228132:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804672 00000100:00100000:2.0:1716999791.228150:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804864 00000100:00100000:2.0:1716999791.228153:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804864 00000100:00100000:2.0:1716999791.228166:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46109 00000100:00100000:2.0:1716999791.228171:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+537:11585:x1800404480804672:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999791.228205:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46110 00000100:00100000:3.0:1716999791.228210:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+537:11581:x1800404480804864:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.228226:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1716999791.228259:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804800 00000100:00100000:1.0:1716999791.228263:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804800 00000100:00100000:2.0:1716999791.228275:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+538:11585:x1800404480804672:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 103us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.228281:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46109 00000100:00100000:1.0:1716999791.228281:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9455 00000100:00100000:1.0:1716999791.228286:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+538:11584:x1800404480804800:12345-192.168.203.3@tcp:35:rm.0 00000004:00000080:3.0:1716999791.228372:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:3.0:1716999791.228389:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+537:11581:x1800404480804864:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 178us (309us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.228394:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46110 00000100:00100000:1.0:1716999791.229982:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11584:x1800404480804800:12345-192.168.203.3@tcp:35:rm.0 Request processed in 1692us (1959us total) trans 4294986628 rc 0/0 00000100:00100000:1.0:1716999791.229990:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9455 00000100:00100000:0.0:1716999791.231213:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.231249:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.231273:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804928 00000100:00100000:2.0:1716999791.231279:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804928 00000100:00100000:2.0:1716999791.231299:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480804992 00000100:00100000:2.0:1716999791.231301:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480804992 00000100:00100000:2.0:1716999791.231314:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46111 00000100:00100000:2.0:1716999791.231320:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+538:11581:x1800404480804928:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.231339:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1716999791.231361:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46112 00000100:00100000:0.0:1716999791.231367:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+538:11585:x1800404480804992:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000004:00000080:2.0:1716999791.231390:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:2.0:1716999791.231429:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+538:11581:x1800404480804928:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 108us (217us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.231435:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46111 00000100:00100000:0.0:1716999791.231812:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11585:x1800404480804992:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 444us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999791.231819:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46112 00000100:00100000:3.0:1716999791.231987:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.232270:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480805120 00000100:00100000:0.0:1716999791.232274:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480805120 00000100:00100000:0.0:1716999791.232290:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46113 00000100:00100000:0.0:1716999791.232293:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+537:11584:x1800404480805120:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:0.0:1716999791.232325:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1716999791.232342:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800997c3a80/0x6d188eabd8d72606 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x72e:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c2e4 expref: 537 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999791.232357:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc8555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663aa expref: 536 pid: 4523 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999791.232366:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009477a1c0/0x6d188eabd8d810b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f50efd expref: 535 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999791.232378:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8901440/0x6d188eabd8d725e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x72e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c2d6 expref: 534 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999791.232386:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72e:0x0].0x0 (ffff8800939bad00) 00010000:00010000:0.0:1716999791.232391:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999791.232407:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc8604 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232416:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc8604 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232423:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc8604 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232430:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc860b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232434:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc860b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232438:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc860b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232492:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc8612 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x72e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232497:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc8612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232501:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc8612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:0.0:1716999791.232861:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].70, 176 off20072 00000004:00200000:0.0:1716999791.232936:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x72e:0x0]: returning size 11776 00010000:00010000:0.0:1716999791.232948:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc8612 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x72e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232953:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc8612 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x72e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232958:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc8612 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232962:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999791.232964:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc8612 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x72e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232969:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc8612 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x72e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.232975:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x72e:0x0].0x0 (ffff8800900d1a00) 00010000:00010000:0.0:1716999791.232977:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1716999791.234009:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc8612 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x72e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.234016:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69680/0x6d188eabd8dc8612 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x72e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.234062:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc8604 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.234067:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc8604 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.234072:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc8604 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.234076:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6af40 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999791.234079:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc8604 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.234084:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc8604 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.234093:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:0.0:1716999791.234095:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999791.234098:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc8604 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.234102:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc8604 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:0.0:1716999791.234118:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e442680 reply state ffff880131ff5000 transno 4294986629 ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc860b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999791.234123:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1716999791.235129:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11584:x1800404480805120:12345-192.168.203.3@tcp:36:rm.0 Request processed in 2830us (3138us total) trans 4294986629 rc 0/0 00000100:00100000:0.0:1716999791.235136:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46113 00000100:00100000:1.0:1716999791.235458:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.236100:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.236145:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480805184 00000100:00100000:2.0:1716999791.236151:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480805184 00000100:00100000:2.0:1716999791.236174:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480805248 00000100:00100000:2.0:1716999791.236176:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480805248 00000100:00100000:2.0:1716999791.236192:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46114 00000100:00100000:2.0:1716999791.236198:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+536:11581:x1800404480805184:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.236221:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc10:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.236276:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc10:0x0]: rc = -2 00000100:00100000:2.0:1716999791.236302:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+536:11581:x1800404480805184:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 104us (845us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.236308:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46114 00000100:00100000:2.0:1716999791.236318:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46115 00000100:00100000:2.0:1716999791.236322:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+535:11585:x1800404480805248:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999791.236405:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+535:11585:x1800404480805248:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.236412:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46115 00010000:00010000:3.0:1716999791.238222:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc860b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.238231:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc860b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.238237:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc860b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.238241:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.238244:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc860b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.238250:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc860b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.238260:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x45439694 (ffff8800900d1300) 00010000:00010000:3.0:1716999791.238262:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.238265:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc860b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.238272:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc860b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b6:0x0].0x45439694 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999791.238657:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.239327:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480805312 00000100:00100000:2.0:1716999791.239334:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480805312 00000100:00100000:2.0:1716999791.239371:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46116 00000100:00100000:2.0:1716999791.239377:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+534:11581:x1800404480805312:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.239402:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.239455:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:2.0:1716999791.239500:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+534:11581:x1800404480805312:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 122us (844us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.239506:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46116 00000100:00100000:1.0:1716999791.239865:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.240143:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480805440 00000100:00100000:2.0:1716999791.240147:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480805440 00000100:00100000:2.0:1716999791.240175:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9456 00000100:00100000:2.0:1716999791.240179:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+534:11584:x1800404480805440:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:2.0:1716999791.240602:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec21c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11584:x1800404480805440:12345-192.168.203.3@tcp:35:rm.0 Request processed in 420us (736us total) trans 4294986630 rc 0/0 00000100:00100000:2.0:1716999791.240609:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9456 00000100:00100000:0.0:1716999791.240916:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.240955:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480805504 00000100:00100000:3.0:1716999791.240959:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480805504 00000100:00100000:3.0:1716999791.240976:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46117 00000100:00100000:3.0:1716999791.240980:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11581:x1800404480805504:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.240992:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.241029:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:3.0:1716999791.241101:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11581:x1800404480805504:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 119us (184us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.241107:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46117 00000100:00100000:0.0:1716999791.242019:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.242157:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480805632 00000100:00100000:3.0:1716999791.242161:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480805632 00000100:00100000:3.0:1716999791.242187:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46118 00000100:00100000:3.0:1716999791.242192:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+535:11584:x1800404480805632:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:3.0:1716999791.242218:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1716999791.242235:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920f9680/0x6d188eabd8d70b5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b6:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b78b expref: 535 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.242249:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c574b40/0x6d188eabd8d7a556 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ebcc expref: 534 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.242258:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c575200/0x6d188eabd8d7018c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b6:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b3a9 expref: 533 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.242266:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff88009ab4a400) 00010000:00010000:3.0:1716999791.242276:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091832f40/0x6d188eabd8dc8276 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6632c expref: 532 pid: 6826 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.242283:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x0 (ffff880099d1bf00) 00010000:00010000:3.0:1716999791.242285:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999791.242302:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8619 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.242312:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8619 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.242444:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8619 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.242456:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8620 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b4:0x0].0x746dd4eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.242461:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.242465:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.242524:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc8627 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00000100:00100000:0.0:1716999791.242528:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999791.242529:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc8627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.242534:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc8627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999791.242601:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480805696 00000100:00100000:1.0:1716999791.242605:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480805696 00000100:00100000:1.0:1716999791.242634:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46119 00000100:00100000:1.0:1716999791.242639:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11581:x1800404480805696:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.242651:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc11:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.242683:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc11:0x0]: rc = -2 00000100:00100000:1.0:1716999791.242718:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11581:x1800404480805696:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 78us (189us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.242724:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46119 00000040:00080000:3.0:1716999791.243111:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].71, 176 off20248 00000004:00200000:3.0:1716999791.243156:0:6823:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6b6:0x0]: returning size 11776 00010000:00010000:3.0:1716999791.243167:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc8627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243173:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc8627 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243177:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc8627 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243181:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.243184:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc8627 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243190:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc8627 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243197:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b6:0x0].0x0 (ffff8800a5c6ea00) 00010000:00010000:3.0:1716999791.243199:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999791.243201:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc8627 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243205:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c50480/0x6d188eabd8dc8627 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243231:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8619 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243235:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8619 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243239:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8619 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243242:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.243244:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8619 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243248:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8619 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243253:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x0 (ffff880099d1bf00) 00010000:00010000:3.0:1716999791.243254:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.243256:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8619 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:3.0:1716999791.243260:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8619 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:3.0:1716999791.243265:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008c705c00 reply state ffff88008b779000 transno 4294986631 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999791.243271:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999791.243310:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11584:x1800404480805632:12345-192.168.203.3@tcp:36:rm.0 Request processed in 1116us (1291us total) trans 4294986631 rc 0/0 00000100:00100000:3.0:1716999791.243316:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46118 00000100:00100000:0.0:1716999791.245784:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.245857:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480805760 00000100:00100000:3.0:1716999791.245864:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480805760 00010000:00010000:2.0:1716999791.245901:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999791.245905:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46120 00010000:00010000:2.0:1716999791.245909:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8620 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.245914:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8620 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.245918:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.245921:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8620 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.245926:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8620 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b4:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.245936:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x746dd4eb (ffff8800a5c6e100) 00010000:00010000:2.0:1716999791.245941:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.245943:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8620 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b4:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:2.0:1716999791.245947:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8620 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b4:0x0].0x746dd4eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:3.0:1716999791.246506:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11581:x1800404480805760:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.246531:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.246587:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:3.0:1716999791.246630:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11581:x1800404480805760:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 719us (852us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.246637:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46120 00000100:00100000:0.0:1716999791.252394:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.252441:0:16640:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480805888 00000100:00100000:3.0:1716999791.252448:0:16640:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480805888 00000100:00100000:3.0:1716999791.252489:0:16640:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9457 00000100:00100000:3.0:1716999791.252495:0:16640:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11584:x1800404480805888:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999791.252876:0:16640:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11584:x1800404480805888:12345-192.168.203.3@tcp:35:rm.0 Request processed in 379us (487us total) trans 4294986632 rc 0/0 00000100:00100000:3.0:1716999791.252900:0:16640:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9457 00000100:00100000:0.0:1716999791.255205:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.256089:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480805952 00000100:00100000:3.0:1716999791.256096:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480805952 00000100:00100000:3.0:1716999791.256129:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46121 00000100:00100000:3.0:1716999791.256135:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11581:x1800404480805952:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.256158:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.256219:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:3.0:1716999791.256268:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11581:x1800404480805952:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 131us (1067us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.256274:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46121 00000100:00100000:0.0:1716999791.258373:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.258418:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.261810:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480806080 00000100:00100000:2.0:1716999791.261821:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480806080 00000100:00100000:2.0:1716999791.261861:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480806144 00000100:00100000:2.0:1716999791.261864:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480806144 00000100:00100000:2.0:1716999791.261896:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46122 00000100:00100000:2.0:1716999791.261903:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+534:11584:x1800404480806080:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:2.0:1716999791.261944:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1716999791.261962:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920f86c0/0x6d188eabd8d6fd56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b1f7 expref: 534 pid: 6821 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999791.262064:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46123 00000100:00100000:1.0:1716999791.262071:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11581:x1800404480806144:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.262085:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.262148:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:1.0:1716999791.262192:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11581:x1800404480806144:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 121us (3773us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.262198:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46123 00010000:00010000:2.0:1716999791.263071:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008b7ec000/0x6d188eabd8d7a350 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4eb1d expref: 532 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.263086:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fa880/0x6d188eabd8d6fd25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b4:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b1e9 expref: 531 pid: 6821 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.263093:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x0 (ffff880099d1bf00) 00010000:00010000:2.0:1716999791.263100:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999791.263118:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc862e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263127:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc862e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263135:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc862e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263145:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8635 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263150:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263155:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263215:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc863c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263220:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc863c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263225:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc863c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:2.0:1716999791.263566:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].72, 176 off20424 00000004:00200000:2.0:1716999791.263606:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6b4:0x0]: returning size 11776 00010000:00010000:2.0:1716999791.263618:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc863c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263630:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc863c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263635:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc863c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263640:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.263643:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc863c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263649:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc863c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263656:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b4:0x0].0x0 (ffff880088977400) 00010000:00010000:2.0:1716999791.263658:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999791.263661:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc863c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263665:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831b00/0x6d188eabd8dc863c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263685:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc862e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263689:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc862e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263694:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc862e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263698:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.263700:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc862e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263705:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc862e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263710:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:2.0:1716999791.263711:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.263713:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc862e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.263717:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc862e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:2.0:1716999791.263723:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008c707100 reply state ffff88008e7b4000 transno 4294986633 ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999791.263728:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1716999791.263776:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11584:x1800404480806080:12345-192.168.203.3@tcp:36:rm.0 Request processed in 1873us (5406us total) trans 4294986633 rc 0/0 00000100:00100000:2.0:1716999791.263782:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46122 00000100:00100000:0.0:1716999791.264580:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.264626:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480806208 00000100:00100000:2.0:1716999791.264631:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480806208 00000100:00100000:2.0:1716999791.264648:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46124 00000100:00100000:2.0:1716999791.264652:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+532:11581:x1800404480806208:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.264666:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.264697:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.264724:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+532:11581:x1800404480806208:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 71us (145us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.264729:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46124 00010000:00010000:3.0:1716999791.267210:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.267221:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8635 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.267227:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.267231:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.267235:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.267240:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8635 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.267254:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x6599e0d1 (ffff880088977900) 00010000:00010000:3.0:1716999791.267256:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.267259:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8635 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:3.0:1716999791.267262:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc8635 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b3:0x0].0x6599e0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999791.268173:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.268204:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.269312:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480806272 00000100:00100000:1.0:1716999791.269320:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480806272 00000100:00100000:1.0:1716999791.269355:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480806336 00000100:00100000:1.0:1716999791.269357:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480806336 00000100:00100000:1.0:1716999791.269371:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46125 00000100:00100000:1.0:1716999791.269376:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11581:x1800404480806272:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.269402:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.269460:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:1.0:1716999791.269494:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11581:x1800404480806272:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 118us (1619us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.269500:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46125 00000100:00100000:1.0:1716999791.269511:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46126 00000100:00100000:1.0:1716999791.269514:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+531:11584:x1800404480806336:12345-192.168.203.3@tcp:101:rm.0 00010000:00010000:1.0:1716999791.269521:0:6822:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999791.269532:0:6822:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8643 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f663b1 expref: -99 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.269571:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc864a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269581:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc864a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269588:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc864a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269596:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8651 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269600:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269604:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269665:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269671:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269676:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000004:00200000:1.0:1716999791.269703:0:6822:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6b3:0x0]: returning size 11776 00000004:00200000:1.0:1716999791.269706:0:6822:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999791.269716:0:6822:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269722:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc864a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269726:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc864a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269731:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc864a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269735:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695d8c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.269737:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc864a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269742:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc864a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269748:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999791.269751:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.269753:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc864a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269757:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc864a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269763:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8651 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269767:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8651 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269771:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269774:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.269775:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8651 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269782:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8651 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269786:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x65dce0d1 (ffff8800a6d5f400) 00010000:00010000:1.0:1716999791.269788:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.269789:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8651 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269802:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8651 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.269818:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8643 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663b1 expref: 533 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.269825:0:6822:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663b1 expref: 532 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.269830:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:1.0:1716999791.269832:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1716999791.269834:0:6822:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a695c480, rc 0) 00000100:00100000:1.0:1716999791.269851:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+532:11584:x1800404480806336:12345-192.168.203.3@tcp:101:rm.0 Request processed in 336us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.269855:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46126 00000100:00100000:0.0:1716999791.271063:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.271120:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480806400 00000100:00100000:2.0:1716999791.271124:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480806400 00000100:00100000:2.0:1716999791.271151:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46127 00000100:00100000:2.0:1716999791.271155:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11581:x1800404480806400:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.271170:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.271207:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.271239:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+532:11581:x1800404480806400:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 80us (176us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.271247:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46127 00000100:00100000:2.0:1716999791.271635:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.271671:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480806528 00000100:00100000:3.0:1716999791.271675:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480806528 00000100:00100000:3.0:1716999791.271819:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9458 00000100:00100000:3.0:1716999791.271824:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+532:11584:x1800404480806528:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999791.272405:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+533:11584:x1800404480806528:12345-192.168.203.3@tcp:35:rm.0 Request processed in 579us (769us total) trans 4294986634 rc 0/0 00000100:00100000:3.0:1716999791.272412:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9458 00000100:00100000:2.0:1716999791.273744:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.273804:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480806592 00000100:00100000:0.0:1716999791.273809:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480806592 00000100:00100000:0.0:1716999791.273841:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46128 00000100:00100000:0.0:1716999791.273845:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11581:x1800404480806592:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.273865:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.276612:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:0.0:1716999791.276966:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11581:x1800404480806592:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 2817us (2922us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.276978:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46128 00000100:00100000:0.0:1716999791.277432:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.277710:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480806720 00000100:00100000:1.0:1716999791.277716:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480806720 00000100:00100000:1.0:1716999791.277752:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46129 00000100:00100000:1.0:1716999791.277758:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+533:11584:x1800404480806720:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:1.0:1716999791.277805:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999791.277825:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663b1 expref: 533 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.277840:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc8245 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b3:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6631e expref: 532 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.277850:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a5c6e900) 00010000:00010000:1.0:1716999791.277864:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc81f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66302 expref: 531 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.277873:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800919b18c0/0x6d188eabd8dc7fcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6624c expref: 530 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.277897:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff880099d1bc00) 00010000:00010000:1.0:1716999791.277901:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999791.277923:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc865f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.277932:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc865f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.277940:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc865f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.277948:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8666 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.277953:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.277957:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278034:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc866d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278040:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc866d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278056:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc866d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:1.0:1716999791.278479:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].73, 176 off20600 00000004:00200000:1.0:1716999791.278522:0:11055:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6b3:0x0]: returning size 11776 00010000:00010000:1.0:1716999791.278533:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc866d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278539:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc866d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278544:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc866d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278548:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.278551:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc866d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278556:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc866d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278563:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b3:0x0].0x0 (ffff8800a6d5fb00) 00010000:00010000:1.0:1716999791.278565:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999791.278567:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc866d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278571:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc866d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278603:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc865f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278608:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc865f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278611:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc865f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278615:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.278616:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc865f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278620:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc865f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278626:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff8800a6d5f700) 00010000:00010000:1.0:1716999791.278627:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.278629:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc865f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:1.0:1716999791.278633:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc865f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:1.0:1716999791.278639:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880088b2f100 reply state ffff880093a43000 transno 4294986635 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:1.0:1716999791.278645:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999791.278697:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+531:11584:x1800404480806720:12345-192.168.203.3@tcp:36:rm.0 Request processed in 938us (1266us total) trans 4294986635 rc 0/0 00000100:00100000:1.0:1716999791.278703:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46129 00000100:00100000:0.0:1716999791.279055:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.279072:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480806784 00000100:00100000:2.0:1716999791.279076:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480806784 00000100:00100000:2.0:1716999791.279100:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46130 00000100:00100000:2.0:1716999791.279104:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+531:11581:x1800404480806784:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.279118:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.279150:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:2.0:1716999791.279178:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+531:11581:x1800404480806784:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 72us (126us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.279183:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46130 00000100:00100000:2.0:1716999791.282815:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.282853:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480806912 00000100:00100000:3.0:1716999791.282860:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480806912 00010000:00010000:0.0:1716999791.282877:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999791.282915:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8666 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999791.282921:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8666 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999791.282926:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695d680 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999791.282930:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8666 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999791.282935:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8666 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999791.282939:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46131 00000100:00100000:3.0:1716999791.282944:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+531:11584:x1800404480806912:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:0.0:1716999791.282946:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x65dce0d1 (ffff8800a6d5fe00) 00010000:00010000:0.0:1716999791.282949:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999791.282951:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8666 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:0.0:1716999791.282955:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8666 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ac:0x0].0x65dce0d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:0.0:1716999791.283222:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999791.283256:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1716999791.283270:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008eb9a400/0x6d188eabd8d790a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ad:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4e543 expref: 530 pid: 16641 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999791.283272:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480806976 00000100:00100000:2.0:1716999791.283275:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480806976 00010000:00010000:3.0:1716999791.283282:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920f9b00/0x6d188eabd8d6f66b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ad:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4afb2 expref: 530 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.283288:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ad:0x0].0x0 (ffff880099d1bd00) 00000100:00100000:2.0:1716999791.283291:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46132 00010000:00010000:3.0:1716999791.283294:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999791.283295:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+529:11581:x1800404480806976:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.283307:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00010000:00010000:3.0:1716999791.283314:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8674 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283322:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8674 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283327:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8674 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283334:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc867b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ac:0x0].0xa6575bd4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283338:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc867b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0xa6575bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283342:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc867b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0xa6575bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000004:00000080:2.0:1716999791.283360:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00010000:00010000:3.0:1716999791.283395:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc8682 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6ad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999791.283399:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+529:11581:x1800404480806976:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 103us (177us total) trans 0 rc -2/-2 00010000:00010000:3.0:1716999791.283401:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc8682 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999791.283405:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46132 00010000:00010000:3.0:1716999791.283406:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc8682 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:3.0:1716999791.283778:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1554, 64 off107712 00000004:00080000:3.0:1716999791.283784:0:11055:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 310482903244ns, next at 311482901618ns, rc = 0 00000040:00080000:3.0:1716999791.283813:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].74, 184 off20784 00010000:00010000:3.0:1716999791.283866:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8689 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ad:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283872:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283904:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283909:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8689 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283913:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8689 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283918:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283922:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8689 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283926:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52f40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999791.283928:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8689 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283933:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8689 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283939:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ad:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999791.283941:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1716999791.283943:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8689 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283947:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc8689 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ad:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283963:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc8682 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283968:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc8682 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283972:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc8682 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283976:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.283977:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc8682 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283981:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc8682 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283987:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ad:0x0].0x0 (ffff8800a5c6e000) 00010000:00010000:3.0:1716999791.283988:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1716999791.283990:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc8682 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.283994:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53840/0x6d188eabd8dc8682 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6ad:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.284024:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8674 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.284028:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8674 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.284032:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8674 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.284036:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.284038:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8674 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.284042:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8674 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.284051:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff8800a5c6e200) 00010000:00010000:3.0:1716999791.284052:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.284054:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8674 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.284058:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8674 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:3.0:1716999791.284065:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008927d880 reply state ffff88008b77a000 transno 4294986636 ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc867b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0xa6575bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999791.284070:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1716999791.284111:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+530:11584:x1800404480806912:12345-192.168.203.3@tcp:36:rm.0 Request processed in 1165us (1300us total) trans 4294986636 rc 0/0 00000100:00100000:3.0:1716999791.284117:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46131 00010000:00010000:3.0:1716999791.286228:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc867b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0xa6575bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.286237:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc867b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0xa6575bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.286243:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc867b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0xa6575bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.286247:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51b00 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.286250:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc867b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0xa6575bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.286255:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc867b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0xa6575bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.286263:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0xa6575bd4 (ffff8800a5c6eb00) 00010000:00010000:3.0:1716999791.286266:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.286269:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc867b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6ac:0x0].0xa6575bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:3.0:1716999791.286274:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc867b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ac:0x0].0xa6575bd4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999791.289055:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.289096:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480807040 00000100:00100000:3.0:1716999791.289104:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480807040 00000100:00100000:3.0:1716999791.289133:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46133 00000100:00100000:3.0:1716999791.289138:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+529:11581:x1800404480807040:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.289165:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.289224:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:3.0:1716999791.289259:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+529:11581:x1800404480807040:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 120us (210us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.289265:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46133 00000100:00100000:0.0:1716999791.294575:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.294634:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480807104 00000100:00100000:2.0:1716999791.294643:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480807104 00000100:00100000:2.0:1716999791.294687:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46134 00000100:00100000:2.0:1716999791.294693:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+529:11581:x1800404480807104:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.294717:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.294778:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999791.294852:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+529:11581:x1800404480807104:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 158us (282us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.294859:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46134 00000100:00100000:2.0:1716999791.313022:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.313082:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480807168 00000100:00100000:3.0:1716999791.313090:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480807168 00000100:00100000:3.0:1716999791.313134:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46135 00000100:00100000:3.0:1716999791.313140:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+529:11581:x1800404480807168:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.313165:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.313248:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:3.0:1716999791.313291:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+529:11581:x1800404480807168:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 151us (275us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.313297:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46135 00000100:00100000:0.0:1716999791.322364:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.323060:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480807232 00000100:00100000:2.0:1716999791.323068:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480807232 00000100:00100000:2.0:1716999791.323117:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46136 00000100:00100000:2.0:1716999791.323124:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+529:11581:x1800404480807232:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.323152:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.323232:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:2.0:1716999791.323271:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+529:11581:x1800404480807232:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 147us (915us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.323277:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46136 00000100:00100000:0.0:1716999791.328644:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.328711:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480807360 00000100:00100000:3.0:1716999791.328718:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480807360 00000100:00100000:3.0:1716999791.328763:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9459 00000100:00100000:3.0:1716999791.328770:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+529:11584:x1800404480807360:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999791.328997:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+530:11584:x1800404480807360:12345-192.168.203.3@tcp:35:rm.0 Request processed in 226us (360us total) trans 4294986637 rc 0/0 00000100:00100000:3.0:1716999791.329004:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9459 00000100:00100000:2.0:1716999791.330347:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.330383:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480807424 00000100:00100000:3.0:1716999791.330388:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480807424 00000100:00100000:3.0:1716999791.330424:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46137 00000100:00100000:3.0:1716999791.330429:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+530:11581:x1800404480807424:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.330448:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.330503:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:3.0:1716999791.330528:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+530:11581:x1800404480807424:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (185us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.330534:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46137 00000100:00100000:0.0:1716999791.330576:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.331025:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480807552 00000100:00100000:3.0:1716999791.331029:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480807552 00000100:00100000:1.0:1716999791.331447:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.332072:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480807616 00000100:00100000:2.0:1716999791.332076:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480807616 00000100:00100000:1.0:1716999791.332091:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46138 00000100:00100000:2.0:1716999791.332095:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46139 00000100:00100000:1.0:1716999791.332096:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+531:11584:x1800404480807552:12345-192.168.203.3@tcp:36:rm.0 00000100:00100000:2.0:1716999791.332098:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+531:11581:x1800404480807616:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.332130:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00010000:00010000:1.0:1716999791.332138:0:6823:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1716999791.332159:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c5746c0/0x6d188eabd8d6f855 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ae:0x0].0x0 bits 0xc/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b068 expref: 531 pid: 6821 timeout: 0 lvb_type: 0 00000004:00000080:2.0:1716999791.332175:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00010000:00010000:1.0:1716999791.332178:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c574900/0x6d188eabd8d6faf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ae:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b13a expref: 530 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.332187:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c575680/0x6d188eabd8d6f77c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6ae:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b014 expref: 529 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.332194:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ae:0x0].0x0 (ffff8800939c9d00) 00000100:00100000:2.0:1716999791.332199:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+528:11581:x1800404480807616:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 100us (753us total) trans 0 rc -2/-2 00010000:00010000:1.0:1716999791.332201:0:6823:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999791.332204:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46139 00010000:00010000:1.0:1716999791.332227:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc8690 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332236:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc8690 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332242:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc8690 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332250:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc8697 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ac:0x0].0x6e65cac7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332255:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc8697 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x6e65cac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332260:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc8697 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x6e65cac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332323:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc869e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332329:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc869e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332334:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc869e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000040:00080000:1.0:1716999791.332730:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1557, 64 off107904 00000040:00080000:1.0:1716999791.332749:0:6823:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].75, 176 off20960 00010000:00010000:1.0:1716999791.332811:0:6823:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6ae:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332818:0:6823:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332824:0:6823:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332829:0:6823:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332833:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86a5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332837:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332841:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332846:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999791.332848:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332853:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86a5 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332859:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ae:0x0].0x0 (ffff8800a6d5f400) 00010000:00010000:1.0:1716999791.332861:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999791.332864:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86a5 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332868:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ae:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332903:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc869e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332908:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc869e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332912:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc869e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332915:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.332917:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc869e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332922:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc869e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332928:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ae:0x0].0x0 (ffff8800a6d5f400) 00010000:00010000:1.0:1716999791.332929:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999791.332931:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc869e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332935:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc869e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6ae:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332966:0:6823:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc8690 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332970:0:6823:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc8690 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332974:0:6823:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc8690 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332978:0:6823:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.332980:0:6823:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc8690 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332984:0:6823:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc8690 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332989:0:6823:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff8800a6d5f700) 00010000:00010000:1.0:1716999791.332991:0:6823:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.332993:0:6823:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc8690 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:1.0:1716999791.332997:0:6823:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc8690 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000004:00010000:1.0:1716999791.333005:0:6823:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880088b2fb80 reply state ffff880093a45000 transno 4294986638 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc8697 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x6e65cac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6823 initiator: MDT0 00000100:00100000:1.0:1716999791.333010:0:6823:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999791.333042:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+529:11584:x1800404480807552:12345-192.168.203.3@tcp:36:rm.0 Request processed in 944us (2465us total) trans 4294986638 rc 0/0 00000100:00100000:1.0:1716999791.333047:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46138 00000100:00100000:0.0:1716999791.334956:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.335034:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480807680 00000100:00100000:3.0:1716999791.335040:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480807680 00000100:00100000:2.0:1716999791.336151:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46140 00000100:00100000:2.0:1716999791.336158:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+529:11581:x1800404480807680:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.336186:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.336247:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:2.0:1716999791.336283:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+529:11581:x1800404480807680:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 126us (1332us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.336289:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46140 00000100:00100000:3.0:1716999791.340905:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.340994:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999791.341052:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc8697 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x6e65cac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.341062:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc8697 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x6e65cac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.341068:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc8697 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x6e65cac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.341073:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f840 already unused, calling callback (ffffffffa1389790) 00010000:00010000:0.0:1716999791.341077:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc8697 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x6e65cac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.341082:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc8697 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6ac:0x0].0x6e65cac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.341094:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x6e65cac7 (ffff8800a6d5fb00) 00010000:00010000:0.0:1716999791.341097:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1716999791.341100:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc8697 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6ac:0x0].0x6e65cac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00010000:00010000:0.0:1716999791.341108:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc8697 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6ac:0x0].0x6e65cac7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6823 initiator: MDT0 00000100:00100000:2.0:1716999791.341180:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480807808 00000100:00100000:2.0:1716999791.341187:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480807808 00000100:00100000:2.0:1716999791.341210:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480807872 00000100:00100000:2.0:1716999791.341212:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480807872 00000100:00100000:2.0:1716999791.341225:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46141 00000100:00100000:2.0:1716999791.341231:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+529:11584:x1800404480807808:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:2.0:1716999791.341274:0:11055:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1716999791.341288:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012facd200/0x6d188eabd8d6fbf1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b187 expref: 529 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.341300:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c577840/0x6d188eabd8d6f97b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b0:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0c3 expref: 528 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.341309:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c574fc0/0x6d188eabd8d6f966 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0bc expref: 527 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.341316:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b0:0x0].0x0 (ffff8800939c9400) 00010000:00010000:2.0:1716999791.341325:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009216cb40/0x6d188eabd8d79fb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6af:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ea1a expref: 526 pid: 11055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999791.341331:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6af:0x0].0x0 (ffff88009ab4aa00) 00010000:00010000:2.0:1716999791.341334:0:11055:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999791.341356:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc86ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.341365:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc86ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.341373:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc86ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.341385:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc86b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6af:0x0].0xc5bc182a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.341390:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc86b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6af:0x0].0xc5bc182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.341394:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc86b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6af:0x0].0xc5bc182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.341570:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc86ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.341576:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc86ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.341581:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc86ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000040:00080000:2.0:1716999791.342028:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1555, 64 off107776 00000040:00080000:2.0:1716999791.342049:0:11055:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].76, 184 off21144 00010000:00010000:2.0:1716999791.342100:0:11055:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc86c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342106:0:11055:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc86c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342112:0:11055:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc86c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342116:0:11055:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc86c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6b0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342124:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc86c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6b0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342128:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc86c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342133:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc86c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342137:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999791.342140:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc86c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342145:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc86c1 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6b0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342151:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b0:0x0].0x0 (ffff880088977300) 00010000:00010000:2.0:1716999791.342153:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1716999791.342155:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc86c1 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6b0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342159:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831680/0x6d188eabd8dc86c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b0:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342179:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc86ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342183:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc86ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342187:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc86ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342191:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.342194:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc86ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342198:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc86ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342204:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b0:0x0].0x0 (ffff880088977300) 00010000:00010000:2.0:1716999791.342206:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1716999791.342208:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc86ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.342212:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091830900/0x6d188eabd8dc86ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b0:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:3.0:1716999791.342349:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46142 00000100:00100000:3.0:1716999791.342355:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+526:11581:x1800404480807872:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.342372:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.342404:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:3.0:1716999791.342441:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e443480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+526:11581:x1800404480807872:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 87us (1447us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.342446:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46142 00010000:00010000:2.0:1716999791.343447:0:11055:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc86ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.343456:0:11055:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc86ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.343462:0:11055:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc86ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.343465:0:11055:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833cc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.343468:0:11055:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc86ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.343473:0:11055:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc86ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.343481:0:11055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6af:0x0].0x0 (ffff88009ab4aa00) 00010000:00010000:2.0:1716999791.343483:0:11055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.343486:0:11055:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc86ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.343493:0:11055:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091833cc0/0x6d188eabd8dc86ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000004:00010000:2.0:1716999791.343501:0:11055:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008e441c00 reply state ffff88008e7b6000 transno 4294986639 ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc86b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6af:0x0].0xc5bc182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999791.343506:0:11055:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999791.344225:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.344268:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480807936 00000100:00100000:0.0:1716999791.344273:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480807936 00000100:00100000:0.0:1716999791.344298:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46143 00000100:00100000:0.0:1716999791.344303:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+527:11581:x1800404480807936:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.344320:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.344372:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:0.0:1716999791.344394:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+527:11581:x1800404480807936:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (173us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.344399:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46143 00000100:00100000:3.0:1716999791.345338:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+526:11584:x1800404480807808:12345-192.168.203.3@tcp:36:rm.0 Request processed in 4104us (4455us total) trans 4294986639 rc 0/0 00000100:00100000:3.0:1716999791.345345:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46141 00000100:00100000:1.0:1716999791.348934:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.349058:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999791.349135:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc86b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6af:0x0].0xc5bc182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.349145:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc86b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6af:0x0].0xc5bc182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.349150:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc86b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6af:0x0].0xc5bc182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.349155:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831200 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.349159:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc86b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6af:0x0].0xc5bc182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.349164:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc86b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6af:0x0].0xc5bc182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.349178:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6af:0x0].0xc5bc182a (ffff880088977600) 00010000:00010000:2.0:1716999791.349181:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.349184:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc86b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6af:0x0].0xc5bc182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00010000:00010000:2.0:1716999791.349188:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091831200/0x6d188eabd8dc86b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6af:0x0].0xc5bc182a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11055 initiator: MDT0 00000100:00100000:2.0:1716999791.349217:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808000 00000100:00100000:2.0:1716999791.349224:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808000 00000100:00100000:2.0:1716999791.349248:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808128 00000100:00100000:2.0:1716999791.349250:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808128 00000100:00100000:2.0:1716999791.349263:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46144 00000100:00100000:2.0:1716999791.349269:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+526:11581:x1800404480808000:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.349294:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1716999791.349355:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46145 00000004:00000080:2.0:1716999791.349360:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:0.0:1716999791.349361:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+526:11584:x1800404480808128:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:0.0:1716999791.349393:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00000100:00100000:2.0:1716999791.349398:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+526:11581:x1800404480808000:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 129us (472us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.349403:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46144 00010000:00010000:0.0:1716999791.349406:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012face880/0x6d188eabd8d6fc14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b1:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b18e expref: 526 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999791.349418:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fb600/0x6d188eabd8d6f9d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b1:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0df expref: 524 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999791.349428:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012facf180/0x6d188eabd8d6f9c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0d8 expref: 523 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999791.349434:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b1:0x0].0x0 (ffff88009ab4af00) 00010000:00010000:0.0:1716999791.349439:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999791.349458:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc86c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.349468:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc86c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.349475:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc86c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.349485:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc86cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6af:0x0].0x2060c1a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.349489:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc86cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6af:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.349493:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc86cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6af:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.349568:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc86d6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.351107:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc86d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:0.0:1716999791.351120:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc86d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999791.351291:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000040:00080000:1.0:1716999791.351747:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x6:0x0].1558, 64 off107968 00000040:00080000:1.0:1716999791.351766:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].77, 184 off21328 00010000:00010000:1.0:1716999791.351836:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.351843:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.351849:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.351855:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.351860:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86dd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.351866:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.351871:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.351876:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695e640 already unused, calling callback (ffffffffa0864a40) 00000100:00100000:3.0:1716999791.352503:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808192 00000100:00100000:3.0:1716999791.352510:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808192 00000100:00100000:3.0:1716999791.352550:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46146 00000100:00100000:3.0:1716999791.352556:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+524:11581:x1800404480808192:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.352578:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.352621:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:3.0:1716999791.352664:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+524:11581:x1800404480808192:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 107us (1376us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.352670:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46146 00010000:00010000:1.0:1716999791.353246:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353256:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86dd lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353267:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b1:0x0].0x0 (ffff8800900d1a00) 00010000:00010000:1.0:1716999791.353269:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999791.353273:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86dd lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353278:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353299:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc86d6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353303:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc86d6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353308:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc86d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353312:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69f80 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.353314:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc86d6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353318:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc86d6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353324:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b1:0x0].0x0 (ffff8800900d1a00) 00010000:00010000:1.0:1716999791.353326:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999791.353328:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc86d6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353332:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc86d6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353383:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc86c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353387:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc86c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353626:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc86c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353630:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e68fc0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.353632:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc86c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353636:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc86c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353643:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6af:0x0].0x0 (ffff88009ab4aa00) 00010000:00010000:1.0:1716999791.353645:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.353647:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc86c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.353651:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc86c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:1.0:1716999791.353666:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff88008b9ffb80 reply state ffff88013634e000 transno 4294986640 ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc86cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6af:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999791.353672:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999791.354182:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+524:11584:x1800404480808128:12345-192.168.203.3@tcp:36:rm.0 Request processed in 4818us (5121us total) trans 4294986640 rc 0/0 00000100:00100000:1.0:1716999791.354188:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46145 00000100:00100000:2.0:1716999791.355690:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.355774:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808256 00000100:00100000:1.0:1716999791.355780:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808256 00000100:00100000:1.0:1716999791.355815:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46147 00000100:00100000:1.0:1716999791.355820:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+524:11581:x1800404480808256:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.355842:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.356028:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:1.0:1716999791.356580:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+524:11581:x1800404480808256:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 756us (891us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.356587:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46147 00010000:00010000:2.0:1716999791.359079:0:3204:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc86cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6af:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.359091:0:3204:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc86cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6af:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.359098:0:3204:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc86cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6af:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.359103:0:3204:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e698c0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.359107:0:3204:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc86cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6af:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.359114:0:3204:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc86cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6af:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.359126:0:3204:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6af:0x0].0x2060c1a3 (ffff8800900d1300) 00010000:00010000:2.0:1716999791.359128:0:3204:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.359132:0:3204:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc86cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6af:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.359137:0:3204:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880132e698c0/0x6d188eabd8dc86cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6af:0x0].0x2060c1a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:2.0:1716999791.361244:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.361321:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808320 00000100:00100000:1.0:1716999791.361327:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808320 00000100:00100000:1.0:1716999791.361359:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46148 00000100:00100000:1.0:1716999791.361365:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+523:11581:x1800404480808320:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.361391:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.361916:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:1.0:1716999791.362335:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+523:11581:x1800404480808320:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 968us (1095us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.362343:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46148 00000100:00100000:0.0:1716999791.364985:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.365044:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808448 00000100:00100000:3.0:1716999791.365051:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808448 00000100:00100000:3.0:1716999791.365093:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9460 00000100:00100000:3.0:1716999791.365099:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+523:11584:x1800404480808448:12345-192.168.203.3@tcp:35:rm.0 00000100:00100000:3.0:1716999791.365264:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+524:11584:x1800404480808448:12345-192.168.203.3@tcp:35:rm.0 Request processed in 163us (284us total) trans 4294986641 rc 0/0 00000100:00100000:3.0:1716999791.365270:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9460 00000100:00100000:0.0:1716999791.368964:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.368999:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.369036:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808576 00000100:00100000:1.0:1716999791.369043:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808576 00000100:00100000:1.0:1716999791.369086:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808640 00000100:00100000:1.0:1716999791.369089:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808640 00000100:00100000:1.0:1716999791.369103:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46149 00000100:00100000:1.0:1716999791.369109:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+525:11584:x1800404480808576:12345-192.168.203.3@tcp:36:rm.0 00010000:00010000:1.0:1716999791.369146:0:6822:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1716999791.369166:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012facc480/0x6d188eabd8d6fb11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b141 expref: 525 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.369183:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012facdf80/0x6d188eabd8d6fa31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6b2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0fb expref: 524 pid: 6822 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.369194:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a8900b40/0x6d188eabd8d7a190 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b2:0x0].0x0 bits 0xc/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ea91 expref: 523 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.369208:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800920fad00/0x6d188eabd8d6fa1c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6b2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0f4 expref: 522 pid: 6823 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999791.369215:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b2:0x0].0x0 (ffff880099d1b900) 00010000:00010000:1.0:1716999791.369223:0:6822:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999791.369243:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369253:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369260:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369270:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc86eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6af:0x0].0x11854626 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369275:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc86eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6af:0x0].0x11854626 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369280:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc86eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6af:0x0].0x11854626 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369361:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc86f2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6b2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369366:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc86f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369371:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc86f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000040:00080000:1.0:1716999791.369769:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0x3:0x0].1556, 64 off107840 00000040:00080000:1.0:1716999791.369787:0:6822:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0x1:0xb:0x0].78, 192 off21520 00010000:00010000:1.0:1716999791.369853:0:6822:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6b2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999791.369858:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46150 00010000:00010000:1.0:1716999791.369860:0:6822:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999791.369864:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480808640:12345-192.168.203.3@tcp:53:lustre_rsync.0 00010000:00010000:1.0:1716999791.369866:0:6822:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6b2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369871:0:6822:0:(ldlm_lock.c:977:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6b2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369875:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86f9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6b2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00000004:00000080:3.0:1716999791.369895:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00010000:00010000:1.0:1716999791.369904:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6b2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369908:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369912:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999791.369915:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6b2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369921:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86f9 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x6b2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369927:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b2:0x0].0x0 (ffff8800a6d5f400) 00010000:00010000:1.0:1716999791.369929:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1716999791.369931:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86f9 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x6b2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00000004:00000080:3.0:1716999791.369933:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00010000:00010000:1.0:1716999791.369935:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc86f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6b2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369951:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc86f2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369955:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc86f2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369958:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc86f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369961:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c480 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.369964:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc86f2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.369968:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc86f2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999791.369973:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480808640:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 108us (972us total) trans 0 rc -2/-2 00010000:00010000:1.0:1716999791.369973:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6b2:0x0].0x0 (ffff8800a6d5f400) 00010000:00010000:1.0:1716999791.369975:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1716999791.369977:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc86f2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:3.0:1716999791.369979:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46150 00010000:00010000:1.0:1716999791.369981:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc86f2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6b2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.370008:0:6822:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.370012:0:6822:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.370016:0:6822:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.372869:0:6822:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695e640 already unused, calling callback (ffffffffa1389790) 00010000:00010000:1.0:1716999791.372874:0:6822:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.372899:0:6822:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.372912:0:6822:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6af:0x0].0x0 (ffff88009ab4aa00) 00010000:00010000:1.0:1716999791.372914:0:6822:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1716999791.372918:0:6822:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:1.0:1716999791.372923:0:6822:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc86e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6af:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000004:00010000:1.0:1716999791.372934:0:6822:0:(mdt_handler.c:4252:mdt_save_lock()) ### save lock request ffff880088b2d180 reply state ffff8800b5236000 transno 4294986642 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc86eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6af:0x0].0x11854626 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6822 initiator: MDT0 00000100:00100000:1.0:1716999791.372941:0:6822:0:(service.c:188:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1716999791.373007:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11584:x1800404480808576:12345-192.168.203.3@tcp:36:rm.0 Request processed in 3894us (4047us total) trans 4294986642 rc 0/0 00000100:00100000:1.0:1716999791.373013:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46149 00010000:00010000:2.0:1716999791.377035:0:3203:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc86eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6af:0x0].0x11854626 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.377047:0:3203:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc86eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6af:0x0].0x11854626 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.377054:0:3203:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc86eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6af:0x0].0x11854626 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.377059:0:3203:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c900 already unused, calling callback (ffffffffa1389790) 00010000:00010000:2.0:1716999791.377062:0:3203:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc86eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6af:0x0].0x11854626 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.377068:0:3203:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc86eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6af:0x0].0x11854626 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.377080:0:3203:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6af:0x0].0x11854626 (ffff8800a6d5f700) 00010000:00010000:2.0:1716999791.377083:0:3203:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1716999791.377085:0:3203:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc86eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6af:0x0].0x11854626 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00010000:00010000:2.0:1716999791.377090:0:3203:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc86eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6af:0x0].0x11854626 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6822 initiator: MDT0 00000100:00100000:0.0:1716999791.377221:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.377298:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.377358:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808704 00000100:00100000:1.0:1716999791.377365:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808704 00000100:00100000:1.0:1716999791.380138:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808768 00000100:00100000:1.0:1716999791.380147:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808768 00000100:00100000:1.0:1716999791.380331:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46151 00000100:00100000:3.0:1716999791.380337:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46152 00000100:00100000:1.0:1716999791.380338:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480808704:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000100:00100000:3.0:1716999791.380343:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11392:x1800404480808768:12345-192.168.203.3@tcp:101:bash.0 00010000:00010000:3.0:1716999791.380366:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00000080:1.0:1716999791.380368:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00010000:00010000:3.0:1716999791.380378:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc8700 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f663b8 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.380410:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8707 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380417:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8707 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380424:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8707 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00000080:1.0:1716999791.380428:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00010000:00010000:3.0:1716999791.380430:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc870e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380434:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc870e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380437:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc870e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000100:00100000:1.0:1716999791.380477:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+523:11581:x1800404480808704:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 139us (3258us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.380488:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46151 00010000:00010000:3.0:1716999791.380501:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380506:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380510:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:3.0:1716999791.380538:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6ac:0x0]: returning size 11776 00000004:00200000:3.0:1716999791.380541:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1716999791.380553:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380560:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8707 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380565:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8707 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380570:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8707 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380574:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.380581:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8707 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380586:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8707 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380595:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099d1b100) 00010000:00010000:3.0:1716999791.380596:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.380599:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8707 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380603:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380611:0:7785:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc870e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380615:0:7785:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc870e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380618:0:7785:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc870e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380623:0:7785:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52400 already unused, calling callback (ffffffffa1389790) 00010000:00010000:3.0:1716999791.380624:0:7785:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc870e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380629:0:7785:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc870e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380633:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7bcb6391 (ffff8800a5c6ea00) 00010000:00010000:3.0:1716999791.380635:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1716999791.380637:0:7785:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc870e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380641:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c52400/0x6d188eabd8dc870e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7bcb6391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7785 initiator: MDT0 00010000:00010000:3.0:1716999791.380660:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc8700 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663b8 expref: 523 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.380668:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131c51440/0x6d188eabd8dc8715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6ac:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663b8 expref: 522 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999791.380674:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6ac:0x0].0x0 (ffff8800a5c6ec00) 00010000:00010000:3.0:1716999791.380675:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1716999791.380677:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131c51440, rc 0) 00000100:00100000:3.0:1716999791.380714:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11392:x1800404480808768:12345-192.168.203.3@tcp:101:bash.0 Request processed in 370us (3415us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999791.380719:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46152 00000100:00100000:0.0:1716999791.381769:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.382772:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808832 00000100:00100000:3.0:1716999791.382778:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808832 00000100:00100000:3.0:1716999791.382824:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46153 00000100:00100000:3.0:1716999791.382830:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480808832:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.382851:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.382914:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:3.0:1716999791.382955:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480808832:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 124us (1187us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.382961:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46153 00000100:00100000:3.0:1716999791.386186:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.386223:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808896 00000100:00100000:0.0:1716999791.386231:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808896 00000100:00100000:0.0:1716999791.386267:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46154 00000100:00100000:0.0:1716999791.386273:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480808896:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.386296:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.386376:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:0.0:1716999791.386408:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480808896:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 135us (230us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.386414:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46154 00000100:00100000:0.0:1716999791.387964:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.388649:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480808960 00000100:00100000:1.0:1716999791.388655:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480808960 00000100:00100000:1.0:1716999791.388683:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46155 00000100:00100000:1.0:1716999791.388688:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480808960:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.388710:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.388765:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.389265:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480808960:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 575us (1303us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.389271:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46155 00000100:00100000:0.0:1716999791.391229:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.391292:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809024 00000100:00100000:1.0:1716999791.391298:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809024 00000100:00100000:1.0:1716999791.391323:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46156 00000100:00100000:1.0:1716999791.391327:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809024:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.391348:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.391401:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.391446:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809024:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (220us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.391453:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46156 00000100:00100000:3.0:1716999791.392985:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.393040:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809088 00000100:00100000:0.0:1716999791.393046:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809088 00000100:00100000:0.0:1716999791.393078:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46157 00000100:00100000:0.0:1716999791.393083:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809088:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.393100:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.393155:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:0.0:1716999791.393680:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809088:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 595us (694us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.393687:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46157 00000100:00100000:2.0:1716999791.395510:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.395731:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809152 00000100:00100000:0.0:1716999791.395737:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809152 00000100:00100000:0.0:1716999791.395809:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46158 00000100:00100000:0.0:1716999791.395815:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809152:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.395838:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.395921:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:0.0:1716999791.395961:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809152:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 145us (454us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.395967:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46158 00000100:00100000:3.0:1716999791.397302:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.397687:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809216 00000100:00100000:1.0:1716999791.397692:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809216 00000100:00100000:1.0:1716999791.397727:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46159 00000100:00100000:1.0:1716999791.397732:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809216:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.397750:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.397808:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:1.0:1716999791.397950:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809216:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 216us (649us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.397960:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46159 00000100:00100000:3.0:1716999791.398929:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.398988:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809280 00000100:00100000:1.0:1716999791.398992:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809280 00000100:00100000:1.0:1716999791.399018:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46160 00000100:00100000:1.0:1716999791.399022:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809280:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.399033:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.399065:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:1.0:1716999791.399099:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809280:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 76us (171us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.399106:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46160 00000100:00100000:2.0:1716999791.399944:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.400021:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809344 00000100:00100000:1.0:1716999791.400026:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809344 00000100:00100000:1.0:1716999791.400090:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46161 00000100:00100000:1.0:1716999791.400096:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809344:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.400108:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.400139:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.400168:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809344:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 71us (224us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.400173:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46161 00000100:00100000:3.0:1716999791.401432:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.401487:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809408 00000100:00100000:1.0:1716999791.401492:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809408 00000100:00100000:1.0:1716999791.401519:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46162 00000100:00100000:1.0:1716999791.401523:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809408:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.401540:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.401817:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.401989:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809408:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 456us (550us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.402202:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46162 00000100:00100000:3.0:1716999791.403343:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.403447:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809472 00000100:00100000:1.0:1716999791.403453:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809472 00000100:00100000:1.0:1716999791.403526:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46163 00000100:00100000:1.0:1716999791.403533:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809472:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.403551:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.403593:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:1.0:1716999791.403628:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809472:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (286us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.403634:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46163 00000100:00100000:2.0:1716999791.404743:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.404813:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809536 00000100:00100000:1.0:1716999791.404817:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809536 00000100:00100000:1.0:1716999791.404842:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46164 00000100:00100000:1.0:1716999791.404848:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809536:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.404861:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.404926:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:1.0:1716999791.404959:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809536:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 110us (217us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.404965:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46164 00000100:00100000:3.0:1716999791.407498:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.407563:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809600 00000100:00100000:1.0:1716999791.407570:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809600 00000100:00100000:1.0:1716999791.407594:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46165 00000100:00100000:1.0:1716999791.407600:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809600:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.407624:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.407674:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:1.0:1716999791.407715:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809600:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 114us (222us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.407721:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46165 00000100:00100000:3.0:1716999791.411574:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.411652:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809664 00000100:00100000:1.0:1716999791.411659:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809664 00000100:00100000:1.0:1716999791.411705:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46166 00000100:00100000:1.0:1716999791.411711:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809664:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.411734:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.411805:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:1.0:1716999791.411873:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809664:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 161us (305us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.411907:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46166 00000100:00100000:2.0:1716999791.413008:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.413057:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809728 00000100:00100000:1.0:1716999791.413062:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809728 00000100:00100000:1.0:1716999791.413593:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46167 00000100:00100000:1.0:1716999791.413599:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809728:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.413619:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.413669:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:1.0:1716999791.413704:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809728:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 105us (698us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.413710:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46167 00000100:00100000:3.0:1716999791.415075:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.415126:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809792 00000100:00100000:0.0:1716999791.415132:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809792 00000100:00100000:0.0:1716999791.415159:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46168 00000100:00100000:0.0:1716999791.415165:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809792:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.415182:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.415249:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:0.0:1716999791.415285:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809792:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 120us (212us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.415292:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46168 00000100:00100000:3.0:1716999791.417583:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.417656:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809856 00000100:00100000:0.0:1716999791.417662:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809856 00000100:00100000:0.0:1716999791.417700:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46169 00000100:00100000:0.0:1716999791.417707:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809856:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.417731:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.417814:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:0.0:1716999791.417856:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809856:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 149us (279us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.417862:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46169 00000100:00100000:2.0:1716999791.420226:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.420329:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809920 00000100:00100000:1.0:1716999791.420335:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809920 00000100:00100000:1.0:1716999791.420363:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46170 00000100:00100000:1.0:1716999791.420369:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809920:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.420389:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.420442:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:1.0:1716999791.420482:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809920:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 112us (261us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.420488:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46170 00000100:00100000:3.0:1716999791.423152:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.423214:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480809984 00000100:00100000:0.0:1716999791.423221:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480809984 00000100:00100000:0.0:1716999791.423257:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46171 00000100:00100000:0.0:1716999791.423263:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809984:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.423286:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.423354:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:0.0:1716999791.423400:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480809984:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 136us (252us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.423406:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46171 00000100:00100000:2.0:1716999791.425069:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.425353:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810048 00000100:00100000:1.0:1716999791.425359:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810048 00000100:00100000:1.0:1716999791.425383:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46172 00000100:00100000:1.0:1716999791.425388:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810048:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.425406:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.425461:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.426138:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810048:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 746us (1070us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.426145:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46172 00000100:00100000:2.0:1716999791.428276:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.428471:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810112 00000100:00100000:1.0:1716999791.428477:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810112 00000100:00100000:1.0:1716999791.428559:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46173 00000100:00100000:1.0:1716999791.428566:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810112:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.428702:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.428765:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:1.0:1716999791.428815:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810112:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 248us (543us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.428821:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46173 00000100:00100000:3.0:1716999791.430190:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.430248:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810176 00000100:00100000:1.0:1716999791.430253:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810176 00000100:00100000:1.0:1716999791.430284:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46174 00000100:00100000:1.0:1716999791.430289:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810176:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.430306:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.430348:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:1.0:1716999791.430384:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810176:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 94us (196us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.430390:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46174 00000100:00100000:2.0:1716999791.435039:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.435103:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810240 00000100:00100000:0.0:1716999791.435111:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810240 00000100:00100000:0.0:1716999791.435156:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46175 00000100:00100000:0.0:1716999791.435162:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810240:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.435189:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.435263:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:0.0:1716999791.435313:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810240:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 150us (281us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.435318:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46175 00000100:00100000:2.0:1716999791.436719:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.436850:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810304 00000100:00100000:1.0:1716999791.436855:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810304 00000100:00100000:1.0:1716999791.436904:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46176 00000100:00100000:1.0:1716999791.436909:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810304:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.436928:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.436981:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.437018:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810304:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 108us (301us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.437024:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46176 00000100:00100000:3.0:1716999791.441077:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.441160:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810368 00000100:00100000:1.0:1716999791.441168:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810368 00000100:00100000:1.0:1716999791.441201:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46177 00000100:00100000:1.0:1716999791.441207:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810368:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.441233:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.441297:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:1.0:1716999791.442448:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810368:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 1238us (1374us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.442455:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46177 00000100:00100000:2.0:1716999791.445188:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.445258:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810432 00000100:00100000:1.0:1716999791.445266:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810432 00000100:00100000:1.0:1716999791.445307:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46178 00000100:00100000:1.0:1716999791.445313:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810432:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.445337:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.445401:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:1.0:1716999791.445445:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810432:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 132us (263us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.445451:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46178 00000100:00100000:2.0:1716999791.447435:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.447494:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810496 00000100:00100000:0.0:1716999791.447500:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810496 00000100:00100000:0.0:1716999791.447534:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46179 00000100:00100000:0.0:1716999791.447540:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810496:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.447561:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.447662:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:0.0:1716999791.447696:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810496:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 155us (265us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.447703:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46179 00000100:00100000:3.0:1716999791.448821:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.449044:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810560 00000100:00100000:1.0:1716999791.449049:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810560 00000100:00100000:1.0:1716999791.449070:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46180 00000100:00100000:1.0:1716999791.449075:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810560:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.449091:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.449134:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:1.0:1716999791.449774:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810560:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 695us (952us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.449780:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46180 00000100:00100000:2.0:1716999791.451266:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.451554:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810624 00000100:00100000:1.0:1716999791.451559:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810624 00000100:00100000:1.0:1716999791.451588:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46181 00000100:00100000:1.0:1716999791.451592:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810624:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.451610:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.451660:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:1.0:1716999791.451695:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810624:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (431us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.451700:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46181 00000100:00100000:2.0:1716999791.453329:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.453388:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810688 00000100:00100000:0.0:1716999791.453395:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810688 00000100:00100000:0.0:1716999791.453427:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46182 00000100:00100000:0.0:1716999791.453432:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810688:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.453450:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.453864:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999791.453917:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810688:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 483us (590us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.453924:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46182 00000100:00100000:3.0:1716999791.455310:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.455362:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810752 00000100:00100000:0.0:1716999791.455368:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810752 00000100:00100000:0.0:1716999791.455396:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46183 00000100:00100000:0.0:1716999791.455401:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810752:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.455417:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.455468:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999791.455502:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810752:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 100us (194us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.455508:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46183 00000100:00100000:2.0:1716999791.456695:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.456811:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810816 00000100:00100000:1.0:1716999791.456816:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810816 00000100:00100000:1.0:1716999791.457013:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46184 00000100:00100000:1.0:1716999791.457019:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810816:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.457038:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.457081:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:1.0:1716999791.457117:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810816:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (424us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.457123:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46184 00000100:00100000:2.0:1716999791.458685:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.458735:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810880 00000100:00100000:0.0:1716999791.458740:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810880 00000100:00100000:0.0:1716999791.458773:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46185 00000100:00100000:0.0:1716999791.458779:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810880:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.458803:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.458862:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:0.0:1716999791.458921:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810880:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 142us (239us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.458928:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46185 00000100:00100000:3.0:1716999791.460256:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.460548:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480810944 00000100:00100000:1.0:1716999791.460554:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480810944 00000100:00100000:1.0:1716999791.460587:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46186 00000100:00100000:1.0:1716999791.460593:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810944:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.460608:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.460653:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:1.0:1716999791.460692:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480810944:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (439us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.460698:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46186 00000100:00100000:2.0:1716999791.462562:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.462649:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811008 00000100:00100000:0.0:1716999791.462654:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811008 00000100:00100000:0.0:1716999791.462686:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46187 00000100:00100000:0.0:1716999791.462711:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811008:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.462734:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.462804:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:0.0:1716999791.462841:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811008:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 149us (283us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.462847:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46187 00000100:00100000:3.0:1716999791.463972:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.464033:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811072 00000100:00100000:0.0:1716999791.464037:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811072 00000100:00100000:0.0:1716999791.464061:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46188 00000100:00100000:0.0:1716999791.464065:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811072:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.464077:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.464119:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:0.0:1716999791.464151:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811072:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 84us (180us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.464156:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46188 00000100:00100000:3.0:1716999791.465859:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.466092:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811136 00000100:00100000:2.0:1716999791.466098:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811136 00000100:00100000:2.0:1716999791.466148:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46189 00000100:00100000:2.0:1716999791.466154:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811136:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.466172:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.466238:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:2.0:1716999791.466273:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811136:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 119us (417us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.466279:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46189 00000100:00100000:3.0:1716999791.467697:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.467841:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811200 00000100:00100000:0.0:1716999791.467846:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811200 00000100:00100000:0.0:1716999791.468249:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46190 00000100:00100000:0.0:1716999791.468255:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811200:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.468272:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.468332:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999791.468370:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811200:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 115us (674us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.468375:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46190 00000100:00100000:3.0:1716999791.469762:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.470085:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811264 00000100:00100000:2.0:1716999791.470091:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811264 00000100:00100000:2.0:1716999791.470117:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46191 00000100:00100000:2.0:1716999791.470122:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811264:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.470137:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.470179:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:2.0:1716999791.470213:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811264:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 90us (452us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.470219:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46191 00000100:00100000:3.0:1716999791.472586:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.472815:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811328 00000100:00100000:2.0:1716999791.472822:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811328 00000100:00100000:2.0:1716999791.472860:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46192 00000100:00100000:2.0:1716999791.472866:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811328:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.472904:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.472959:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:2.0:1716999791.473774:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811328:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 905us (1190us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.473781:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46192 00000100:00100000:3.0:1716999791.475504:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.475578:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811392 00000100:00100000:1.0:1716999791.475584:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811392 00000100:00100000:1.0:1716999791.475704:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46193 00000100:00100000:1.0:1716999791.475710:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811392:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.475731:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.475812:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:1.0:1716999791.475850:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811392:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 140us (350us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.475858:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46193 00000100:00100000:3.0:1716999791.477064:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.477143:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811456 00000100:00100000:0.0:1716999791.477149:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811456 00000100:00100000:0.0:1716999791.477183:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46194 00000100:00100000:0.0:1716999791.477190:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811456:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.477207:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.477260:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999791.477296:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811456:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 105us (233us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.477302:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46194 00000100:00100000:3.0:1716999791.478197:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.478257:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811520 00000100:00100000:1.0:1716999791.478262:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811520 00000100:00100000:1.0:1716999791.478294:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46195 00000100:00100000:1.0:1716999791.478300:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811520:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.478315:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.478349:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:1.0:1716999791.478379:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811520:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 79us (183us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.478384:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46195 00000100:00100000:3.0:1716999791.479556:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.479686:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811584 00000100:00100000:1.0:1716999791.479691:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811584 00000100:00100000:1.0:1716999791.479717:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46196 00000100:00100000:1.0:1716999791.479721:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811584:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.479736:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.479773:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:1.0:1716999791.479806:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811584:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (251us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.479811:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46196 00000100:00100000:3.0:1716999791.480976:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.481008:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811648 00000100:00100000:0.0:1716999791.481012:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811648 00000100:00100000:0.0:1716999791.481037:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46197 00000100:00100000:0.0:1716999791.481042:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811648:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.481057:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.481105:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:0.0:1716999791.481130:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811648:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 87us (156us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.481136:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46197 00000100:00100000:3.0:1716999791.482013:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.482076:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811712 00000100:00100000:0.0:1716999791.482080:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811712 00000100:00100000:0.0:1716999791.482197:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46198 00000100:00100000:0.0:1716999791.482204:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811712:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.482223:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.482262:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:0.0:1716999791.482287:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811712:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (275us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.482293:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46198 00000100:00100000:3.0:1716999791.483240:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.483269:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811776 00000100:00100000:0.0:1716999791.483273:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811776 00000100:00100000:0.0:1716999791.483299:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46199 00000100:00100000:0.0:1716999791.483304:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811776:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.483317:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.483355:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:0.0:1716999791.483386:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811776:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 81us (146us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.483390:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46199 00000100:00100000:3.0:1716999791.484142:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.484252:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811840 00000100:00100000:0.0:1716999791.484255:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811840 00000100:00100000:0.0:1716999791.484279:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46200 00000100:00100000:0.0:1716999791.484284:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811840:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.484295:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.484327:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:0.0:1716999791.484347:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811840:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 63us (206us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.484352:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46200 00000100:00100000:3.0:1716999791.485963:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.486055:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811904 00000100:00100000:1.0:1716999791.486061:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811904 00000100:00100000:1.0:1716999791.486149:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46201 00000100:00100000:1.0:1716999791.486155:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811904:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.486173:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.486217:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:1.0:1716999791.486398:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811904:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 242us (437us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.486404:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46201 00000100:00100000:3.0:1716999791.487522:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.487601:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480811968 00000100:00100000:1.0:1716999791.487606:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480811968 00000100:00100000:1.0:1716999791.487832:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46202 00000100:00100000:1.0:1716999791.487837:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811968:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.487855:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.487944:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:1.0:1716999791.488325:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480811968:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 485us (802us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.488331:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46202 00000100:00100000:3.0:1716999791.491111:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.491193:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812032 00000100:00100000:1.0:1716999791.491200:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812032 00000100:00100000:1.0:1716999791.491234:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46203 00000100:00100000:1.0:1716999791.491239:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812032:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.491259:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.491320:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:1.0:1716999791.491352:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812032:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 112us (249us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.491358:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46203 00000100:00100000:3.0:1716999791.492473:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.492604:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812096 00000100:00100000:2.0:1716999791.492610:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812096 00000100:00100000:2.0:1716999791.492644:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46204 00000100:00100000:2.0:1716999791.492649:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812096:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.492667:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.492719:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:2.0:1716999791.492758:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812096:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 107us (286us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.492764:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46204 00000100:00100000:3.0:1716999791.497239:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.497353:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812160 00000100:00100000:1.0:1716999791.497361:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812160 00000100:00100000:1.0:1716999791.497403:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46205 00000100:00100000:1.0:1716999791.497410:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812160:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.497438:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.497518:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:1.0:1716999791.498903:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812160:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 144us (323us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.498916:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46205 00000100:00100000:3.0:1716999791.499477:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.499532:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812224 00000100:00100000:1.0:1716999791.499537:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812224 00000100:00100000:1.0:1716999791.499569:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46206 00000100:00100000:1.0:1716999791.499575:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812224:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.499595:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.499648:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:1.0:1716999791.499680:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812224:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 104us (204us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.499691:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46206 00000100:00100000:3.0:1716999791.501090:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.501176:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812288 00000100:00100000:2.0:1716999791.501182:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812288 00000100:00100000:2.0:1716999791.501212:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46207 00000100:00100000:2.0:1716999791.501217:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812288:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.501232:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.501445:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:2.0:1716999791.501740:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812288:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 521us (652us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.501747:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46207 00000100:00100000:3.0:1716999791.503117:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.503177:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812352 00000100:00100000:2.0:1716999791.503182:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812352 00000100:00100000:2.0:1716999791.503283:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46208 00000100:00100000:2.0:1716999791.503289:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812352:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.503308:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.503360:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:2.0:1716999791.503678:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812352:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 387us (561us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.503684:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46208 00000100:00100000:3.0:1716999791.505389:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.505492:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812416 00000100:00100000:2.0:1716999791.505498:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812416 00000100:00100000:2.0:1716999791.505705:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46209 00000100:00100000:2.0:1716999791.505711:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812416:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.505731:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.505784:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:2.0:1716999791.506037:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812416:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 325us (649us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.506044:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46209 00000100:00100000:3.0:1716999791.507597:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.507659:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812480 00000100:00100000:2.0:1716999791.507664:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812480 00000100:00100000:2.0:1716999791.507698:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46210 00000100:00100000:2.0:1716999791.507704:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812480:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.507723:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.507771:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:2.0:1716999791.507826:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812480:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 121us (232us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.507832:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46210 00000100:00100000:3.0:1716999791.509468:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.509544:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812544 00000100:00100000:2.0:1716999791.509549:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812544 00000100:00100000:2.0:1716999791.509581:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46211 00000100:00100000:2.0:1716999791.509587:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812544:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.509604:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.509647:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:2.0:1716999791.509680:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812544:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 93us (215us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.509686:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46211 00000100:00100000:3.0:1716999791.510821:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.511030:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812608 00000100:00100000:1.0:1716999791.511036:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812608 00000100:00100000:1.0:1716999791.511067:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46212 00000100:00100000:1.0:1716999791.511073:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812608:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.511091:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.511148:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:1.0:1716999791.511171:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812608:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (351us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.511176:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46212 00000100:00100000:3.0:1716999791.513595:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.513682:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812672 00000100:00100000:2.0:1716999791.513688:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812672 00000100:00100000:2.0:1716999791.513724:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46213 00000100:00100000:2.0:1716999791.513730:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812672:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.513750:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.513820:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999791.513860:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812672:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 130us (269us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.513866:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46213 00000100:00100000:3.0:1716999791.516308:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.516546:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812736 00000100:00100000:1.0:1716999791.516553:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812736 00000100:00100000:1.0:1716999791.516595:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46214 00000100:00100000:1.0:1716999791.516602:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812736:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.516627:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.516694:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:1.0:1716999791.516727:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812736:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 126us (425us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.516733:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46214 00000100:00100000:3.0:1716999791.520365:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.520504:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812800 00000100:00100000:2.0:1716999791.520511:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812800 00000100:00100000:2.0:1716999791.520551:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46215 00000100:00100000:2.0:1716999791.520558:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812800:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.520584:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.520644:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:2.0:1716999791.520677:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812800:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 119us (317us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.520682:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46215 00000100:00100000:3.0:1716999791.522332:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.522392:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812864 00000100:00100000:1.0:1716999791.522398:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812864 00000100:00100000:1.0:1716999791.522475:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46216 00000100:00100000:1.0:1716999791.522481:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812864:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.522501:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.522787:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:1.0:1716999791.523346:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812864:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 863us (1016us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.523353:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46216 00000100:00100000:3.0:1716999791.528950:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.529148:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812928 00000100:00100000:1.0:1716999791.529155:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812928 00000100:00100000:1.0:1716999791.529198:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46217 00000100:00100000:1.0:1716999791.529204:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812928:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.529228:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.529291:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:1.0:1716999791.529324:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812928:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 120us (381us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.529330:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46217 00000100:00100000:2.0:1716999791.530818:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.531310:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480812992 00000100:00100000:0.0:1716999791.531317:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480812992 00000100:00100000:0.0:1716999791.531356:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46218 00000100:00100000:0.0:1716999791.531362:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812992:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.531382:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.531458:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:0.0:1716999791.531494:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480812992:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 132us (679us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.531500:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46218 00000100:00100000:1.0:1716999791.533130:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.533186:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813056 00000100:00100000:2.0:1716999791.533191:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813056 00000100:00100000:2.0:1716999791.533223:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46219 00000100:00100000:2.0:1716999791.533228:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813056:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.533245:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.533674:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999791.533818:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813056:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 589us (690us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.533825:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46219 00000100:00100000:2.0:1716999791.535283:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.535442:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813120 00000100:00100000:0.0:1716999791.535448:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813120 00000100:00100000:0.0:1716999791.535479:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46220 00000100:00100000:0.0:1716999791.535484:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813120:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.535504:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.535861:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:0.0:1716999791.535920:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813120:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 434us (638us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.535927:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46220 00000100:00100000:0.0:1716999791.537143:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.537233:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813184 00000100:00100000:2.0:1716999791.537240:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813184 00000100:00100000:2.0:1716999791.537269:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46221 00000100:00100000:2.0:1716999791.537274:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813184:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.537292:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.537340:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999791.537374:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813184:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (232us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.537380:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46221 00000100:00100000:1.0:1716999791.538690:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.538857:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813248 00000100:00100000:0.0:1716999791.538863:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813248 00000100:00100000:0.0:1716999791.538917:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46222 00000100:00100000:0.0:1716999791.538922:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813248:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.538938:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.538995:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:0.0:1716999791.539029:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813248:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (340us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.539035:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46222 00000100:00100000:3.0:1716999791.540647:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.540709:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813312 00000100:00100000:2.0:1716999791.540714:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813312 00000100:00100000:2.0:1716999791.541010:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46223 00000100:00100000:2.0:1716999791.541016:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813312:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.541035:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.541080:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999791.541196:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813312:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 179us (550us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.541202:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46223 00000100:00100000:2.0:1716999791.542089:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.542204:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813376 00000100:00100000:3.0:1716999791.542209:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813376 00000100:00100000:3.0:1716999791.542238:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46224 00000100:00100000:3.0:1716999791.542243:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813376:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.542257:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.542305:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999791.542325:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813376:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 81us (237us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.542330:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46224 00000100:00100000:3.0:1716999791.543924:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.543991:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813440 00000100:00100000:0.0:1716999791.543996:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813440 00000100:00100000:0.0:1716999791.544016:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46225 00000100:00100000:0.0:1716999791.544021:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813440:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.544038:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.544095:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:0.0:1716999791.544115:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813440:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 93us (195us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.544124:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46225 00000100:00100000:2.0:1716999791.546859:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.546974:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813504 00000100:00100000:3.0:1716999791.546981:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813504 00000100:00100000:3.0:1716999791.547215:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46226 00000100:00100000:3.0:1716999791.547221:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813504:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.547244:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.547305:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999791.547348:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813504:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 127us (495us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.547354:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46226 00000100:00100000:1.0:1716999791.549551:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.549608:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813568 00000100:00100000:0.0:1716999791.549615:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813568 00000100:00100000:0.0:1716999791.549649:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46227 00000100:00100000:0.0:1716999791.549654:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813568:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.549676:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.549741:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:0.0:1716999791.549783:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813568:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 128us (237us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.549798:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46227 00000100:00100000:2.0:1716999791.551696:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.551767:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813632 00000100:00100000:3.0:1716999791.551773:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813632 00000100:00100000:3.0:1716999791.552030:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46228 00000100:00100000:3.0:1716999791.552036:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813632:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.552054:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.552100:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999791.552136:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813632:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 100us (446us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.552144:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46228 00000100:00100000:2.0:1716999791.553579:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.553623:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813696 00000100:00100000:0.0:1716999791.553627:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813696 00000100:00100000:0.0:1716999791.553725:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46229 00000100:00100000:0.0:1716999791.553732:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813696:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.553750:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x72e:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.553826:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x72e:0x0]: rc = -2 00000100:00100000:0.0:1716999791.553864:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813696:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 132us (287us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.553870:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46229 00000100:00100000:1.0:1716999791.555977:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.556236:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813760 00000100:00100000:3.0:1716999791.556243:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813760 00000100:00100000:3.0:1716999791.556280:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46230 00000100:00100000:3.0:1716999791.556286:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813760:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.556308:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x72e:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.556363:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x72e:0x0]: rc = -2 00000100:00100000:3.0:1716999791.556403:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813760:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (431us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.556409:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46230 00000100:00100000:2.0:1716999791.558591:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.558652:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813824 00000100:00100000:0.0:1716999791.558658:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813824 00000100:00100000:0.0:1716999791.558713:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46231 00000100:00100000:0.0:1716999791.558719:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813824:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.558738:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x72e:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.558809:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x72e:0x0]: rc = -2 00000100:00100000:0.0:1716999791.558849:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813824:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 130us (261us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.558855:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46231 00000100:00100000:2.0:1716999791.561116:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.561394:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813888 00000100:00100000:3.0:1716999791.561402:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813888 00000100:00100000:3.0:1716999791.561590:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46232 00000100:00100000:3.0:1716999791.561597:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813888:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.561617:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x72e:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.561672:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x72e:0x0]: rc = -2 00000100:00100000:3.0:1716999791.561711:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813888:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 114us (601us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.561717:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46232 00000100:00100000:1.0:1716999791.563403:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.563450:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480813952 00000100:00100000:0.0:1716999791.563456:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480813952 00000100:00100000:0.0:1716999791.563487:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46233 00000100:00100000:0.0:1716999791.563493:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813952:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.563510:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.563569:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:0.0:1716999791.563606:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480813952:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 112us (207us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.563612:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46233 00000100:00100000:2.0:1716999791.564972:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.565167:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814016 00000100:00100000:3.0:1716999791.565172:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814016 00000100:00100000:3.0:1716999791.565192:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46234 00000100:00100000:3.0:1716999791.565197:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814016:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.565213:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.565257:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999791.565291:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814016:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 93us (321us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.565297:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46234 00000100:00100000:2.0:1716999791.566634:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.566685:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814080 00000100:00100000:0.0:1716999791.566691:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814080 00000100:00100000:0.0:1716999791.566718:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46235 00000100:00100000:0.0:1716999791.566724:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814080:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.566737:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x72e:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.566799:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x72e:0x0]: rc = -2 00000100:00100000:0.0:1716999791.566831:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814080:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 107us (200us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.566837:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46235 00000100:00100000:1.0:1716999791.568142:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.568559:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814144 00000100:00100000:3.0:1716999791.568564:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814144 00000100:00100000:3.0:1716999791.568679:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46236 00000100:00100000:3.0:1716999791.568685:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814144:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.568703:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x72e:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.568748:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x72e:0x0]: rc = -2 00000100:00100000:3.0:1716999791.568784:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814144:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (644us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.568798:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46236 00000100:00100000:2.0:1716999791.570245:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.570293:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814208 00000100:00100000:0.0:1716999791.570299:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814208 00000100:00100000:0.0:1716999791.570371:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46237 00000100:00100000:0.0:1716999791.570378:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814208:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.570394:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x730:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.570448:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x730:0x0]: rc = -2 00000100:00100000:0.0:1716999791.570484:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814208:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (242us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.570489:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46237 00000100:00100000:2.0:1716999791.571991:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.572292:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814272 00000100:00100000:3.0:1716999791.572298:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814272 00000100:00100000:3.0:1716999791.572328:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46238 00000100:00100000:3.0:1716999791.572334:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814272:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.572351:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x730:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.572394:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x730:0x0]: rc = -2 00000100:00100000:3.0:1716999791.572428:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814272:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 94us (439us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.572434:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46238 00000100:00100000:1.0:1716999791.573753:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.573921:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814336 00000100:00100000:0.0:1716999791.573925:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814336 00000100:00100000:0.0:1716999791.574016:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46239 00000100:00100000:0.0:1716999791.574022:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814336:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.574038:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x730:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.574088:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x730:0x0]: rc = -2 00000100:00100000:0.0:1716999791.574121:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814336:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (370us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.574127:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46239 00000100:00100000:2.0:1716999791.575476:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.575534:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814400 00000100:00100000:3.0:1716999791.575539:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814400 00000100:00100000:3.0:1716999791.575568:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46240 00000100:00100000:3.0:1716999791.575574:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814400:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.575590:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x730:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.575631:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x730:0x0]: rc = -2 00000100:00100000:3.0:1716999791.575666:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814400:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 91us (191us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.575672:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46240 00000100:00100000:2.0:1716999791.577203:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.577270:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814464 00000100:00100000:0.0:1716999791.577275:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814464 00000100:00100000:0.0:1716999791.577355:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46241 00000100:00100000:0.0:1716999791.577361:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814464:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.577377:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x730:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.577426:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x730:0x0]: rc = -2 00000100:00100000:0.0:1716999791.577457:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814464:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (255us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.577463:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46241 00000100:00100000:1.0:1716999791.578841:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.579269:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814528 00000100:00100000:3.0:1716999791.579275:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814528 00000100:00100000:3.0:1716999791.579300:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46242 00000100:00100000:3.0:1716999791.579306:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814528:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.579323:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x730:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.579363:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x730:0x0]: rc = -2 00000100:00100000:3.0:1716999791.579398:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814528:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (559us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.579404:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46242 00000100:00100000:2.0:1716999791.581075:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.581148:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814592 00000100:00100000:0.0:1716999791.581154:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814592 00000100:00100000:0.0:1716999791.581181:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46243 00000100:00100000:0.0:1716999791.581187:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814592:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.581206:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc12:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.581260:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc12:0x0]: rc = -2 00000100:00100000:0.0:1716999791.581294:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814592:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 107us (221us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.581300:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46243 00000100:00100000:2.0:1716999791.582532:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.582721:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814656 00000100:00100000:3.0:1716999791.582726:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814656 00000100:00100000:3.0:1716999791.582922:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46244 00000100:00100000:3.0:1716999791.582928:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814656:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.582944:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.582985:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999791.583018:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814656:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 90us (488us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.583024:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46244 00000100:00100000:1.0:1716999791.585049:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.585098:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814720 00000100:00100000:0.0:1716999791.585104:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814720 00000100:00100000:0.0:1716999791.585136:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46245 00000100:00100000:0.0:1716999791.585141:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814720:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.585162:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.585230:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:0.0:1716999791.585269:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814720:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 127us (225us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.585275:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46245 00000100:00100000:2.0:1716999791.586426:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.586699:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814784 00000100:00100000:3.0:1716999791.586703:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814784 00000100:00100000:3.0:1716999791.586732:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46246 00000100:00100000:3.0:1716999791.586737:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814784:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.586756:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc13:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.586806:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc13:0x0]: rc = -2 00000100:00100000:3.0:1716999791.586839:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814784:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 101us (414us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.586846:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46246 00000100:00100000:2.0:1716999791.588541:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.588586:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814848 00000100:00100000:0.0:1716999791.588591:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814848 00000100:00100000:0.0:1716999791.588621:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46247 00000100:00100000:0.0:1716999791.588626:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814848:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.588645:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc14:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.588698:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc14:0x0]: rc = -2 00000100:00100000:0.0:1716999791.588730:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814848:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 104us (192us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.588736:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46247 00000100:00100000:1.0:1716999791.589908:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.590027:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814912 00000100:00100000:3.0:1716999791.590032:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814912 00000100:00100000:3.0:1716999791.590319:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46248 00000100:00100000:3.0:1716999791.590326:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814912:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.590342:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.590384:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:3.0:1716999791.590420:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814912:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 94us (514us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.590426:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46248 00000100:00100000:2.0:1716999791.591983:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.592367:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480814976 00000100:00100000:1.0:1716999791.592372:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480814976 00000100:00100000:1.0:1716999791.592408:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46249 00000100:00100000:1.0:1716999791.592413:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814976:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.592430:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.592495:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.592530:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480814976:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 116us (551us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.592536:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46249 00000100:00100000:2.0:1716999791.593717:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.594059:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815040 00000100:00100000:3.0:1716999791.594065:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815040 00000100:00100000:3.0:1716999791.594094:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46250 00000100:00100000:3.0:1716999791.594100:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815040:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.594117:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc15:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.594162:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc15:0x0]: rc = -2 00000100:00100000:3.0:1716999791.594197:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815040:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 97us (481us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.594203:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46250 00000100:00100000:0.0:1716999791.595541:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.595616:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815104 00000100:00100000:1.0:1716999791.595620:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815104 00000100:00100000:1.0:1716999791.595648:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46251 00000100:00100000:1.0:1716999791.595653:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815104:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.595671:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc16:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.595709:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc16:0x0]: rc = -2 00000100:00100000:1.0:1716999791.595741:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815104:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 86us (201us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.595747:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46251 00000100:00100000:2.0:1716999791.597138:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.597294:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815168 00000100:00100000:3.0:1716999791.597299:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815168 00000100:00100000:3.0:1716999791.597583:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46252 00000100:00100000:3.0:1716999791.597589:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815168:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.597606:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.597645:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999791.597678:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815168:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (542us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.597685:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46252 00000100:00100000:2.0:1716999791.599271:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.599327:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815232 00000100:00100000:1.0:1716999791.599331:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815232 00000100:00100000:1.0:1716999791.599351:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46253 00000100:00100000:1.0:1716999791.599356:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815232:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.599370:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.599407:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.599428:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815232:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 71us (159us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.599434:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46253 00000100:00100000:0.0:1716999791.600426:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.600558:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815296 00000100:00100000:2.0:1716999791.600563:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815296 00000100:00100000:2.0:1716999791.600590:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46254 00000100:00100000:2.0:1716999791.600596:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815296:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.600609:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.600658:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:2.0:1716999791.600681:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815296:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 84us (255us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.600687:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46254 00000100:00100000:3.0:1716999791.602617:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.602663:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815360 00000100:00100000:1.0:1716999791.602668:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815360 00000100:00100000:1.0:1716999791.602699:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46255 00000100:00100000:1.0:1716999791.602705:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815360:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.602722:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.602770:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.602809:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815360:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 103us (196us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.602815:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46255 00000100:00100000:2.0:1716999791.603973:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.604088:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815424 00000100:00100000:0.0:1716999791.604093:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815424 00000100:00100000:0.0:1716999791.604224:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46256 00000100:00100000:0.0:1716999791.604230:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815424:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.604247:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc17:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.604315:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc17:0x0]: rc = -2 00000100:00100000:0.0:1716999791.604348:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815424:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (377us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.604354:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46256 00000100:00100000:0.0:1716999791.606482:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.606609:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815488 00000100:00100000:1.0:1716999791.606615:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815488 00000100:00100000:1.0:1716999791.606642:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46257 00000100:00100000:1.0:1716999791.606647:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815488:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.606669:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.606723:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.606802:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815488:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 154us (323us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.606808:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46257 00000100:00100000:2.0:1716999791.608731:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.609841:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815552 00000100:00100000:0.0:1716999791.609849:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815552 00000100:00100000:0.0:1716999791.609905:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46258 00000100:00100000:0.0:1716999791.609911:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815552:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.609932:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.610017:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:0.0:1716999791.610055:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815552:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 144us (1327us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.610061:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46258 00000100:00100000:2.0:1716999791.611871:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.612234:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815616 00000100:00100000:1.0:1716999791.612241:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815616 00000100:00100000:1.0:1716999791.612267:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46259 00000100:00100000:1.0:1716999791.612272:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815616:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.612291:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc18:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.612343:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc18:0x0]: rc = -2 00000100:00100000:1.0:1716999791.612385:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815616:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 112us (518us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.612391:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46259 00000100:00100000:0.0:1716999791.615419:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.615938:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815680 00000100:00100000:2.0:1716999791.615945:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815680 00000100:00100000:2.0:1716999791.615992:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46260 00000100:00100000:2.0:1716999791.615998:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815680:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.616022:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.616098:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:2.0:1716999791.616132:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815680:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 134us (718us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.616138:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46260 00000100:00100000:3.0:1716999791.617751:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.617818:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815744 00000100:00100000:1.0:1716999791.617824:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815744 00000100:00100000:1.0:1716999791.617853:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46261 00000100:00100000:1.0:1716999791.617857:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815744:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.617872:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.617937:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.617963:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815744:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 105us (215us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.617968:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46261 00000100:00100000:2.0:1716999791.619120:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.619136:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815808 00000100:00100000:2.0:1716999791.619140:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815808 00000100:00100000:2.0:1716999791.619167:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46262 00000100:00100000:2.0:1716999791.619171:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815808:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.619187:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc19:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.619226:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc19:0x0]: rc = -2 00000100:00100000:2.0:1716999791.619552:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815808:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 378us (432us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.619558:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46262 00000100:00100000:0.0:1716999791.620711:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.620782:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815872 00000100:00100000:2.0:1716999791.620796:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815872 00000100:00100000:2.0:1716999791.620827:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46263 00000100:00100000:2.0:1716999791.620833:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815872:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.620850:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.620923:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:2.0:1716999791.620961:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815872:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 127us (251us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.620967:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46263 00000100:00100000:3.0:1716999791.622599:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.622637:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480815936 00000100:00100000:1.0:1716999791.622643:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480815936 00000100:00100000:1.0:1716999791.622679:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46264 00000100:00100000:1.0:1716999791.622685:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815936:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.622703:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.622747:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.622786:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480815936:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 101us (189us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.622800:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46264 00000100:00100000:3.0:1716999791.624820:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.624956:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816000 00000100:00100000:2.0:1716999791.624962:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816000 00000100:00100000:2.0:1716999791.624994:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46265 00000100:00100000:2.0:1716999791.624999:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816000:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.625019:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.625065:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:2.0:1716999791.625091:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816000:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 91us (274us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.625097:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46265 00000100:00100000:0.0:1716999791.626483:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.626622:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816064 00000100:00100000:1.0:1716999791.626626:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816064 00000100:00100000:1.0:1716999791.626658:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46266 00000100:00100000:1.0:1716999791.626663:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816064:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.626680:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.626724:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.626756:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816064:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 93us (275us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.626762:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46266 00000100:00100000:3.0:1716999791.628861:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.629115:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816128 00000100:00100000:2.0:1716999791.629121:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816128 00000100:00100000:2.0:1716999791.629159:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46267 00000100:00100000:2.0:1716999791.629165:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816128:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.629185:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc1a:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.629240:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc1a:0x0]: rc = -2 00000100:00100000:2.0:1716999791.629269:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816128:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 104us (411us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.629275:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46267 00000100:00100000:3.0:1716999791.631950:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.632001:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816192 00000100:00100000:1.0:1716999791.632008:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816192 00000100:00100000:1.0:1716999791.632047:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46268 00000100:00100000:1.0:1716999791.632052:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816192:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.632074:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.632127:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.632167:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816192:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 115us (221us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.632173:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46268 00000100:00100000:0.0:1716999791.633943:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.634052:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816256 00000100:00100000:3.0:1716999791.634057:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816256 00000100:00100000:3.0:1716999791.634088:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46269 00000100:00100000:3.0:1716999791.634094:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816256:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.634112:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.634158:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999791.634182:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816256:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 87us (242us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.634188:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46269 00000100:00100000:3.0:1716999791.637774:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.639107:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816320 00000100:00100000:0.0:1716999791.639115:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816320 00000100:00100000:0.0:1716999791.639166:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46270 00000100:00100000:0.0:1716999791.639173:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816320:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.639210:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc1b:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.639299:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc1b:0x0]: rc = -2 00000100:00100000:0.0:1716999791.639338:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816320:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 166us (1570us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.639345:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46270 00000100:00100000:0.0:1716999791.640762:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.640811:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816384 00000100:00100000:1.0:1716999791.640817:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816384 00000100:00100000:1.0:1716999791.640850:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46271 00000100:00100000:1.0:1716999791.640855:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816384:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.640870:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.640928:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.640963:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816384:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (203us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.640972:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46271 00000100:00100000:0.0:1716999791.643732:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.643786:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816448 00000100:00100000:2.0:1716999791.643800:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816448 00000100:00100000:2.0:1716999791.643841:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46272 00000100:00100000:2.0:1716999791.643847:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816448:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.643868:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.643973:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:2.0:1716999791.644008:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816448:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 160us (281us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.644014:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46272 00000100:00100000:3.0:1716999791.646488:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.647729:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816512 00000100:00100000:1.0:1716999791.647737:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816512 00000100:00100000:1.0:1716999791.647778:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46273 00000100:00100000:1.0:1716999791.647784:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816512:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.647814:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.648191:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.648237:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816512:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 452us (1753us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.648243:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46273 00000100:00100000:0.0:1716999791.649678:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.649808:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816576 00000100:00100000:1.0:1716999791.649814:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816576 00000100:00100000:1.0:1716999791.649849:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46274 00000100:00100000:1.0:1716999791.649854:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816576:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.649876:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.649943:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.649978:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816576:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 123us (302us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.649984:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46274 00000100:00100000:0.0:1716999791.651854:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.651932:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816640 00000100:00100000:2.0:1716999791.651938:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816640 00000100:00100000:2.0:1716999791.651970:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46275 00000100:00100000:2.0:1716999791.651976:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816640:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.651995:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.652547:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:2.0:1716999791.652657:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816640:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 679us (806us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.652664:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46275 00000100:00100000:3.0:1716999791.653719:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.654240:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816704 00000100:00100000:2.0:1716999791.654246:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816704 00000100:00100000:2.0:1716999791.654280:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46276 00000100:00100000:2.0:1716999791.654286:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816704:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.654304:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.654357:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:2.0:1716999791.654381:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816704:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 94us (662us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.654387:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46276 00000100:00100000:0.0:1716999791.655765:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.655916:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816768 00000100:00100000:1.0:1716999791.655921:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816768 00000100:00100000:1.0:1716999791.655951:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46277 00000100:00100000:1.0:1716999791.655957:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816768:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.655975:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc1c:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.656024:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc1c:0x0]: rc = -2 00000100:00100000:1.0:1716999791.656058:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816768:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 100us (295us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.656065:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46277 00000100:00100000:0.0:1716999791.657217:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.657351:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816832 00000100:00100000:2.0:1716999791.657356:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816832 00000100:00100000:2.0:1716999791.657387:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46278 00000100:00100000:2.0:1716999791.657392:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816832:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.657408:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc1d:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.657447:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc1d:0x0]: rc = -2 00000100:00100000:2.0:1716999791.657468:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816832:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 75us (253us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.657474:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46278 00000100:00100000:3.0:1716999791.659058:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.659152:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816896 00000100:00100000:1.0:1716999791.659157:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816896 00000100:00100000:1.0:1716999791.659188:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46279 00000100:00100000:1.0:1716999791.659194:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816896:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.659210:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.659254:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.659287:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816896:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (231us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.659293:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46279 00000100:00100000:0.0:1716999791.660393:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.660600:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480816960 00000100:00100000:2.0:1716999791.660605:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480816960 00000100:00100000:2.0:1716999791.660911:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46280 00000100:00100000:2.0:1716999791.660917:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816960:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.660933:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.660978:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:2.0:1716999791.661013:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480816960:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (620us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.661018:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46280 00000100:00100000:0.0:1716999791.662383:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.662467:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817024 00000100:00100000:1.0:1716999791.662473:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817024 00000100:00100000:1.0:1716999791.662504:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46281 00000100:00100000:1.0:1716999791.662510:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817024:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.662527:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.662568:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.662603:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817024:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (221us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.662609:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46281 00000100:00100000:3.0:1716999791.664020:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.664141:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817088 00000100:00100000:2.0:1716999791.664146:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817088 00000100:00100000:2.0:1716999791.664316:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46282 00000100:00100000:2.0:1716999791.664322:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817088:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.664340:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.664384:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:2.0:1716999791.664521:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817088:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 198us (503us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.664527:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46282 00000100:00100000:0.0:1716999791.665872:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.666070:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817152 00000100:00100000:2.0:1716999791.666075:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817152 00000100:00100000:2.0:1716999791.666239:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46283 00000100:00100000:2.0:1716999791.666245:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817152:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.666265:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc1e:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.666313:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc1e:0x0]: rc = -2 00000100:00100000:2.0:1716999791.666656:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817152:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 409us (784us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.666662:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46283 00000100:00100000:0.0:1716999791.667851:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.667976:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817216 00000100:00100000:2.0:1716999791.667982:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817216 00000100:00100000:2.0:1716999791.668089:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46284 00000100:00100000:2.0:1716999791.668095:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817216:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.668114:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.668167:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:2.0:1716999791.668191:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817216:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (341us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.668197:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46284 00000100:00100000:3.0:1716999791.669958:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.670107:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817280 00000100:00100000:1.0:1716999791.670113:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817280 00000100:00100000:1.0:1716999791.670144:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46285 00000100:00100000:1.0:1716999791.670149:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817280:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.670170:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.670217:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.670248:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817280:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (294us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.670254:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46285 00000100:00100000:0.0:1716999791.671092:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.671136:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817344 00000100:00100000:2.0:1716999791.671141:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817344 00000100:00100000:2.0:1716999791.671305:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46286 00000100:00100000:2.0:1716999791.671310:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817344:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.671325:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc1f:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.671363:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc1f:0x0]: rc = -2 00000100:00100000:2.0:1716999791.671449:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817344:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 137us (357us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.671455:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46286 00000100:00100000:0.0:1716999791.672760:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.672832:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817408 00000100:00100000:2.0:1716999791.672837:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817408 00000100:00100000:2.0:1716999791.673065:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46287 00000100:00100000:2.0:1716999791.673070:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817408:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.673089:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.673136:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:2.0:1716999791.673166:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817408:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (407us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.673172:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46287 00000100:00100000:3.0:1716999791.674081:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.674138:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817472 00000100:00100000:1.0:1716999791.674143:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817472 00000100:00100000:1.0:1716999791.674172:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46288 00000100:00100000:1.0:1716999791.674177:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817472:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.674316:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.674356:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.674386:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817472:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 208us (305us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.674392:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46288 00000100:00100000:0.0:1716999791.675698:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.675825:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817536 00000100:00100000:1.0:1716999791.675830:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817536 00000100:00100000:1.0:1716999791.675863:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46289 00000100:00100000:1.0:1716999791.675868:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817536:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.675907:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc20:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.675956:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc20:0x0]: rc = -2 00000100:00100000:1.0:1716999791.675989:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817536:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 120us (293us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.675995:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46289 00000100:00100000:0.0:1716999791.677247:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.677339:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817600 00000100:00100000:2.0:1716999791.677345:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817600 00000100:00100000:2.0:1716999791.677375:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46290 00000100:00100000:2.0:1716999791.677381:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817600:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.677400:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc21:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.677443:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc21:0x0]: rc = -2 00000100:00100000:2.0:1716999791.677477:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817600:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 96us (231us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.677513:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46290 00000100:00100000:3.0:1716999791.679504:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.679574:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817664 00000100:00100000:2.0:1716999791.679580:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817664 00000100:00100000:2.0:1716999791.679605:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46291 00000100:00100000:2.0:1716999791.679610:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817664:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.679627:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc22:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.679683:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc22:0x0]: rc = -2 00000100:00100000:2.0:1716999791.679912:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817664:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 300us (409us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.679919:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46291 00000100:00100000:0.0:1716999791.681031:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.681226:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817728 00000100:00100000:2.0:1716999791.681231:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817728 00000100:00100000:2.0:1716999791.681295:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46292 00000100:00100000:2.0:1716999791.681301:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817728:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.681328:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.681373:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:2.0:1716999791.681403:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817728:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (374us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.681409:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46292 00000100:00100000:0.0:1716999791.682589:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.682627:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817792 00000100:00100000:2.0:1716999791.682631:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817792 00000100:00100000:2.0:1716999791.682662:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46293 00000100:00100000:2.0:1716999791.682667:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817792:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.682681:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.682732:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:2.0:1716999791.682766:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817792:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (179us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.682773:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46293 00000100:00100000:3.0:1716999791.684015:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.684215:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817856 00000100:00100000:1.0:1716999791.684220:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817856 00000100:00100000:1.0:1716999791.684527:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46294 00000100:00100000:1.0:1716999791.684534:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817856:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.684565:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc23:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.684614:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc23:0x0]: rc = -2 00000100:00100000:1.0:1716999791.684651:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817856:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (638us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.684657:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46294 00000100:00100000:0.0:1716999791.685987:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.686438:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817920 00000100:00100000:2.0:1716999791.686444:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817920 00000100:00100000:2.0:1716999791.686477:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46295 00000100:00100000:2.0:1716999791.686482:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817920:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.686499:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.686546:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:2.0:1716999791.686583:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817920:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 100us (597us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.686589:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46295 00000100:00100000:0.0:1716999791.688201:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.688348:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480817984 00000100:00100000:1.0:1716999791.688353:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480817984 00000100:00100000:1.0:1716999791.688945:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46296 00000100:00100000:1.0:1716999791.688951:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817984:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.688969:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.689018:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.689053:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480817984:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (856us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.689058:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46296 00000100:00100000:3.0:1716999791.690702:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.690805:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818048 00000100:00100000:2.0:1716999791.690811:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818048 00000100:00100000:2.0:1716999791.690843:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46297 00000100:00100000:2.0:1716999791.690848:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818048:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.690863:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.690964:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:2.0:1716999791.690988:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818048:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 140us (289us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.690994:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46297 00000100:00100000:0.0:1716999791.692478:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.692571:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818112 00000100:00100000:1.0:1716999791.692576:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818112 00000100:00100000:1.0:1716999791.692605:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46298 00000100:00100000:1.0:1716999791.692610:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818112:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.692627:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.692669:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.693045:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818112:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 434us (570us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.693051:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46298 00000100:00100000:0.0:1716999791.694189:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.694292:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818176 00000100:00100000:1.0:1716999791.694297:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818176 00000100:00100000:1.0:1716999791.694323:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46299 00000100:00100000:1.0:1716999791.694328:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818176:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.694345:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.694386:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.694409:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818176:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 80us (221us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.694414:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46299 00000100:00100000:3.0:1716999791.695850:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.696184:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818240 00000100:00100000:2.0:1716999791.696189:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818240 00000100:00100000:2.0:1716999791.696223:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46300 00000100:00100000:2.0:1716999791.696228:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818240:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.696255:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.696296:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:2.0:1716999791.696321:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818240:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 91us (472us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.696327:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46300 00000100:00100000:0.0:1716999791.697668:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.697742:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818304 00000100:00100000:2.0:1716999791.697746:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818304 00000100:00100000:2.0:1716999791.697947:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46301 00000100:00100000:2.0:1716999791.697953:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818304:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.697968:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc24:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.698004:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc24:0x0]: rc = -2 00000100:00100000:2.0:1716999791.698036:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818304:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (372us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.698042:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46301 00000100:00100000:0.0:1716999791.699255:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.699344:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818368 00000100:00100000:1.0:1716999791.699349:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818368 00000100:00100000:1.0:1716999791.699468:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46302 00000100:00100000:1.0:1716999791.699474:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818368:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.699498:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc25:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.699538:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc25:0x0]: rc = -2 00000100:00100000:1.0:1716999791.699562:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818368:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 87us (309us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.699567:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46302 00000100:00100000:3.0:1716999791.701022:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.701153:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818432 00000100:00100000:2.0:1716999791.701157:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818432 00000100:00100000:2.0:1716999791.701184:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46303 00000100:00100000:2.0:1716999791.701189:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818432:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.701202:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.701240:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:2.0:1716999791.701270:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818432:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 81us (250us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.701276:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46303 00000100:00100000:0.0:1716999791.702262:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.702431:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818496 00000100:00100000:1.0:1716999791.702437:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818496 00000100:00100000:1.0:1716999791.702619:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46304 00000100:00100000:1.0:1716999791.702626:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818496:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.702641:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.702680:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.702714:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818496:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (453us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.702719:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46304 00000100:00100000:0.0:1716999791.704536:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.704619:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818560 00000100:00100000:2.0:1716999791.704626:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818560 00000100:00100000:2.0:1716999791.704658:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46305 00000100:00100000:2.0:1716999791.704664:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818560:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.704686:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.704737:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:2.0:1716999791.704772:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818560:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 107us (242us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.704778:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46305 00000100:00100000:3.0:1716999791.706624:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.706697:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818624 00000100:00100000:1.0:1716999791.706703:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818624 00000100:00100000:1.0:1716999791.707131:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46306 00000100:00100000:1.0:1716999791.707138:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818624:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.707157:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.707210:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.707241:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818624:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 103us (620us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.707246:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46306 00000100:00100000:0.0:1716999791.708808:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.708861:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818688 00000100:00100000:2.0:1716999791.708866:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818688 00000100:00100000:2.0:1716999791.709052:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46307 00000100:00100000:2.0:1716999791.709060:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818688:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.709088:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc26:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.709133:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc26:0x0]: rc = -2 00000100:00100000:2.0:1716999791.709412:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818688:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 352us (604us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.709418:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46307 00000100:00100000:0.0:1716999791.711141:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.711268:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818752 00000100:00100000:2.0:1716999791.711274:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818752 00000100:00100000:2.0:1716999791.711301:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46308 00000100:00100000:2.0:1716999791.711306:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818752:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.711323:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.711369:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:2.0:1716999791.711393:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818752:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 86us (255us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.711398:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46308 00000100:00100000:3.0:1716999791.712754:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.712820:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818816 00000100:00100000:1.0:1716999791.712824:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818816 00000100:00100000:1.0:1716999791.713233:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46309 00000100:00100000:1.0:1716999791.713239:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818816:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.713256:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.713297:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.713323:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818816:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 84us (571us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.713328:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46309 00000100:00100000:0.0:1716999791.714267:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.714447:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818880 00000100:00100000:3.0:1716999791.714451:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818880 00000100:00100000:3.0:1716999791.714479:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46310 00000100:00100000:3.0:1716999791.714484:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818880:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.714496:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc27:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.714543:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc27:0x0]: rc = -2 00000100:00100000:3.0:1716999791.714572:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818880:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 87us (306us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.714577:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46310 00000100:00100000:0.0:1716999791.715820:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.716149:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480818944 00000100:00100000:1.0:1716999791.716154:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480818944 00000100:00100000:1.0:1716999791.716184:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46311 00000100:00100000:1.0:1716999791.716189:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818944:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.716218:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.716258:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.716286:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480818944:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 96us (467us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.716292:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46311 00000100:00100000:2.0:1716999791.717650:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.718045:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819008 00000100:00100000:3.0:1716999791.718051:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819008 00000100:00100000:3.0:1716999791.718232:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46312 00000100:00100000:3.0:1716999791.718238:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819008:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.718267:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.718319:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999791.718468:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819008:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 229us (818us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.718475:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46312 00000100:00100000:0.0:1716999791.719988:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.720056:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819072 00000100:00100000:3.0:1716999791.720061:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819072 00000100:00100000:3.0:1716999791.720087:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46313 00000100:00100000:3.0:1716999791.720092:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819072:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.720107:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.720144:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:3.0:1716999791.720270:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819072:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 176us (282us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.720275:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46313 00000100:00100000:0.0:1716999791.721231:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.721501:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819136 00000100:00100000:3.0:1716999791.721505:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819136 00000100:00100000:3.0:1716999791.721619:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46314 00000100:00100000:3.0:1716999791.721624:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819136:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.721637:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.721670:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:3.0:1716999791.721693:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819136:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 68us (462us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.721698:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46314 00000100:00100000:2.0:1716999791.723647:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.724263:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819200 00000100:00100000:1.0:1716999791.724270:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819200 00000100:00100000:1.0:1716999791.724305:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46315 00000100:00100000:1.0:1716999791.724311:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819200:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.724330:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc28:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.724382:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc28:0x0]: rc = -2 00000100:00100000:1.0:1716999791.724422:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819200:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 110us (777us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.724428:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46315 00000100:00100000:0.0:1716999791.725605:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.725738:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819264 00000100:00100000:3.0:1716999791.725742:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819264 00000100:00100000:3.0:1716999791.725773:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46316 00000100:00100000:3.0:1716999791.725778:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819264:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.725804:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.725843:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:3.0:1716999791.726725:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819264:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 944us (1119us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.726732:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46316 00000100:00100000:0.0:1716999791.727934:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.728559:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819328 00000100:00100000:3.0:1716999791.728565:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819328 00000100:00100000:3.0:1716999791.728599:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46317 00000100:00100000:3.0:1716999791.728605:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819328:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.728637:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.728691:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:3.0:1716999791.729479:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819328:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 871us (1544us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.729486:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46317 00000100:00100000:2.0:1716999791.731288:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.731669:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819392 00000100:00100000:3.0:1716999791.731675:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819392 00000100:00100000:3.0:1716999791.731709:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46318 00000100:00100000:3.0:1716999791.731715:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819392:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.731735:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc29:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.731805:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc29:0x0]: rc = -2 00000100:00100000:3.0:1716999791.731846:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819392:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 130us (560us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.731852:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46318 00000100:00100000:0.0:1716999791.733281:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.733384:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819456 00000100:00100000:1.0:1716999791.733389:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819456 00000100:00100000:1.0:1716999791.733417:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46319 00000100:00100000:1.0:1716999791.733422:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819456:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.733436:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.733474:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999791.733508:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819456:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 85us (228us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.733514:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46319 00000100:00100000:0.0:1716999791.734446:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.734539:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819520 00000100:00100000:3.0:1716999791.734543:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819520 00000100:00100000:3.0:1716999791.734570:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46320 00000100:00100000:3.0:1716999791.734574:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819520:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.734588:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.734618:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999791.734636:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819520:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 61us (191us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.734645:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46320 00000100:00100000:2.0:1716999791.736693:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.736778:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819584 00000100:00100000:1.0:1716999791.736784:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819584 00000100:00100000:1.0:1716999791.736831:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46321 00000100:00100000:1.0:1716999791.736837:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819584:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.736856:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.737017:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.737048:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819584:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 211us (361us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.737054:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46321 00000100:00100000:0.0:1716999791.738145:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.738373:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819648 00000100:00100000:1.0:1716999791.738377:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819648 00000100:00100000:1.0:1716999791.738406:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46322 00000100:00100000:1.0:1716999791.738411:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819648:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.738436:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.738471:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:1.0:1716999791.739419:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819648:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 1005us (1272us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.739426:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46322 00000100:00100000:0.0:1716999791.740721:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.740812:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819712 00000100:00100000:1.0:1716999791.740818:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819712 00000100:00100000:1.0:1716999791.740847:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46323 00000100:00100000:1.0:1716999791.740852:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819712:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.740873:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc2a:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.740950:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc2a:0x0]: rc = -2 00000100:00100000:1.0:1716999791.740977:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819712:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 124us (258us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.740983:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46323 00000100:00100000:2.0:1716999791.742031:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.742274:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819776 00000100:00100000:3.0:1716999791.742278:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819776 00000100:00100000:3.0:1716999791.742304:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46324 00000100:00100000:3.0:1716999791.742309:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819776:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.742324:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc2b:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.742362:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc2b:0x0]: rc = -2 00000100:00100000:3.0:1716999791.742382:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819776:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 72us (352us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.742387:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46324 00000100:00100000:0.0:1716999791.743460:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.743515:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819840 00000100:00100000:1.0:1716999791.743519:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819840 00000100:00100000:1.0:1716999791.743542:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46325 00000100:00100000:1.0:1716999791.743547:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819840:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.743560:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc2c:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.743594:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc2c:0x0]: rc = -2 00000100:00100000:1.0:1716999791.743622:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819840:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 74us (163us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.743631:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46325 00000100:00100000:0.0:1716999791.744735:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.744795:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819904 00000100:00100000:3.0:1716999791.744800:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819904 00000100:00100000:1.0:1716999791.745223:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46326 00000100:00100000:1.0:1716999791.745228:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819904:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.745244:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.745285:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:1.0:1716999791.745307:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819904:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 78us (573us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.745313:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46326 00000100:00100000:2.0:1716999791.747578:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.747677:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480819968 00000100:00100000:3.0:1716999791.747683:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480819968 00000100:00100000:3.0:1716999791.747716:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46327 00000100:00100000:3.0:1716999791.747722:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819968:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.747750:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.747812:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:3.0:1716999791.747840:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480819968:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (267us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.747846:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46327 00000100:00100000:0.0:1716999791.749390:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.749447:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820032 00000100:00100000:1.0:1716999791.749453:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820032 00000100:00100000:1.0:1716999791.749486:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46328 00000100:00100000:1.0:1716999791.749492:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820032:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.749517:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc2d:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.749563:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc2d:0x0]: rc = -2 00000100:00100000:1.0:1716999791.749596:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820032:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 103us (209us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.749602:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46328 00000100:00100000:0.0:1716999791.751249:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.751458:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820096 00000100:00100000:3.0:1716999791.751463:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820096 00000100:00100000:3.0:1716999791.751547:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46329 00000100:00100000:3.0:1716999791.751553:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820096:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.751571:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc2e:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.751618:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc2e:0x0]: rc = -2 00000100:00100000:3.0:1716999791.751658:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820096:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 104us (410us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.751663:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46329 00000100:00100000:2.0:1716999791.753263:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.753459:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820160 00000100:00100000:1.0:1716999791.753465:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820160 00000100:00100000:1.0:1716999791.753488:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46330 00000100:00100000:1.0:1716999791.753492:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820160:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.753508:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.753554:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:1.0:1716999791.753579:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820160:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 85us (318us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.753588:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46330 00000100:00100000:0.0:1716999791.755146:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.755291:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820224 00000100:00100000:2.0:1716999791.755296:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820224 00000100:00100000:2.0:1716999791.755329:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46331 00000100:00100000:2.0:1716999791.755334:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820224:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.755355:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.755424:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999791.755451:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820224:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (308us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.755457:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46331 00000100:00100000:0.0:1716999791.756731:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.756798:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820288 00000100:00100000:1.0:1716999791.756804:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820288 00000100:00100000:1.0:1716999791.756860:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46332 00000100:00100000:1.0:1716999791.756865:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820288:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.756903:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc2f:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.756946:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc2f:0x0]: rc = -2 00000100:00100000:1.0:1716999791.756969:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820288:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 103us (239us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.756975:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46332 00000100:00100000:2.0:1716999791.758279:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.758342:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820352 00000100:00100000:0.0:1716999791.758346:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820352 00000100:00100000:0.0:1716999791.758377:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46333 00000100:00100000:0.0:1716999791.758383:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820352:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.758400:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.758468:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:0.0:1716999791.758494:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820352:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 111us (218us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.758503:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46333 00000100:00100000:0.0:1716999791.760048:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.760201:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820416 00000100:00100000:1.0:1716999791.760206:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820416 00000100:00100000:1.0:1716999791.760231:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46334 00000100:00100000:1.0:1716999791.760236:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820416:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.760255:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.760308:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:1.0:1716999791.760674:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820416:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 436us (627us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.760681:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46334 00000100:00100000:1.0:1716999791.762570:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.762698:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820480 00000100:00100000:2.0:1716999791.762704:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820480 00000100:00100000:2.0:1716999791.762785:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46335 00000100:00100000:2.0:1716999791.762799:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820480:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.762819:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.762897:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.762931:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820480:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 133us (364us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.762936:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46335 00000100:00100000:2.0:1716999791.764413:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.764628:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820544 00000100:00100000:0.0:1716999791.764634:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820544 00000100:00100000:0.0:1716999791.764658:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46336 00000100:00100000:0.0:1716999791.764664:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820544:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.764692:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.764763:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:0.0:1716999791.764802:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820544:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 138us (392us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.764808:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46336 00000100:00100000:1.0:1716999791.766743:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.766823:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820608 00000100:00100000:2.0:1716999791.766829:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820608 00000100:00100000:2.0:1716999791.766862:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46337 00000100:00100000:2.0:1716999791.766869:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820608:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.766928:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.767065:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999791.767107:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820608:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 237us (367us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.767114:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46337 00000100:00100000:1.0:1716999791.768359:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.768402:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820672 00000100:00100000:0.0:1716999791.768406:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820672 00000100:00100000:0.0:1716999791.768436:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46338 00000100:00100000:0.0:1716999791.768440:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820672:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.768457:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.768521:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:0.0:1716999791.768550:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820672:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 109us (194us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.768556:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46338 00000100:00100000:3.0:1716999791.771985:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.772093:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820736 00000100:00100000:2.0:1716999791.772100:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820736 00000100:00100000:2.0:1716999791.772140:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46339 00000100:00100000:2.0:1716999791.772146:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820736:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.772170:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc30:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.772245:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc30:0x0]: rc = -2 00000100:00100000:2.0:1716999791.772290:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820736:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 144us (311us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.772297:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46339 00000100:00100000:1.0:1716999791.774506:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.774568:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820800 00000100:00100000:0.0:1716999791.774575:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820800 00000100:00100000:2.0:1716999791.774985:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46340 00000100:00100000:2.0:1716999791.774992:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820800:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.775013:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.775078:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999791.775120:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820800:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 128us (618us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.775127:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46340 00000100:00100000:1.0:1716999791.776660:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.776702:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820864 00000100:00100000:0.0:1716999791.776707:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820864 00000100:00100000:0.0:1716999791.776735:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46341 00000100:00100000:0.0:1716999791.776740:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820864:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.776756:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.776931:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:0.0:1716999791.776968:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820864:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 224us (307us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.776974:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46341 00000100:00100000:3.0:1716999791.778159:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.778273:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820928 00000100:00100000:0.0:1716999791.778279:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820928 00000100:00100000:0.0:1716999791.778314:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46342 00000100:00100000:0.0:1716999791.778319:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820928:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.778338:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc31:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.778392:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc31:0x0]: rc = -2 00000100:00100000:0.0:1716999791.778428:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820928:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 108us (271us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.778433:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46342 00000100:00100000:1.0:1716999791.779928:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.779947:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480820992 00000100:00100000:2.0:1716999791.779952:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480820992 00000100:00100000:2.0:1716999791.780044:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46343 00000100:00100000:2.0:1716999791.780050:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820992:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.780068:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.780115:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.780154:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480820992:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 104us (229us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.780160:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46343 00000100:00100000:1.0:1716999791.782529:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.782596:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821056 00000100:00100000:0.0:1716999791.782603:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821056 00000100:00100000:0.0:1716999791.782642:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46344 00000100:00100000:0.0:1716999791.782648:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821056:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.782678:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.782746:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:0.0:1716999791.782777:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821056:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 129us (254us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.782783:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46344 00000100:00100000:3.0:1716999791.784417:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.784496:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821120 00000100:00100000:2.0:1716999791.784502:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821120 00000100:00100000:2.0:1716999791.784567:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46345 00000100:00100000:2.0:1716999791.784573:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821120:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.784599:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.784646:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.784836:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821120:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 262us (421us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.784843:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46345 00000100:00100000:1.0:1716999791.786872:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.786956:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821184 00000100:00100000:2.0:1716999791.786962:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821184 00000100:00100000:2.0:1716999791.787278:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46346 00000100:00100000:2.0:1716999791.787284:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821184:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.787303:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.787356:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.787397:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821184:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 112us (528us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.787403:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46346 00000100:00100000:1.0:1716999791.789315:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.789367:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821248 00000100:00100000:0.0:1716999791.789373:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821248 00000100:00100000:0.0:1716999791.789533:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46347 00000100:00100000:0.0:1716999791.789539:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821248:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.789557:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.789614:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:0.0:1716999791.789650:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821248:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 110us (337us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.789656:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46347 00000100:00100000:3.0:1716999791.790773:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.790989:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821312 00000100:00100000:2.0:1716999791.790994:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821312 00000100:00100000:2.0:1716999791.791018:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46348 00000100:00100000:2.0:1716999791.791024:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821312:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.791039:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.791075:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999791.791107:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821312:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 82us (335us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.791113:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46348 00000100:00100000:1.0:1716999791.792493:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.792549:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821376 00000100:00100000:0.0:1716999791.792554:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821376 00000100:00100000:0.0:1716999791.792624:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46349 00000100:00100000:0.0:1716999791.792630:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821376:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.792646:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc32:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.792695:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc32:0x0]: rc = -2 00000100:00100000:0.0:1716999791.792729:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821376:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (237us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.792735:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46349 00000100:00100000:1.0:1716999791.793797:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.794273:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821440 00000100:00100000:2.0:1716999791.794279:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821440 00000100:00100000:2.0:1716999791.794317:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46350 00000100:00100000:2.0:1716999791.794322:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821440:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.794341:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.794392:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999791.794431:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821440:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 108us (645us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.794437:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46350 00000100:00100000:3.0:1716999791.795708:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.795753:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821504 00000100:00100000:0.0:1716999791.795758:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821504 00000100:00100000:0.0:1716999791.795847:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46351 00000100:00100000:0.0:1716999791.795852:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821504:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.795867:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.796033:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:0.0:1716999791.796085:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821504:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 232us (379us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.796092:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46351 00000100:00100000:1.0:1716999791.797184:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.797451:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821568 00000100:00100000:0.0:1716999791.797457:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821568 00000100:00100000:0.0:1716999791.797487:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46352 00000100:00100000:0.0:1716999791.797492:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821568:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.797519:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc33:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.797564:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc33:0x0]: rc = -2 00000100:00100000:0.0:1716999791.797601:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821568:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 107us (418us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.797607:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46352 00000100:00100000:1.0:1716999791.799518:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.799589:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821632 00000100:00100000:2.0:1716999791.799594:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821632 00000100:00100000:2.0:1716999791.799679:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46353 00000100:00100000:2.0:1716999791.799685:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821632:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.799711:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.799756:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.800010:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821632:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 324us (493us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.800017:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46353 00000100:00100000:3.0:1716999791.801515:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.801564:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821696 00000100:00100000:2.0:1716999791.801570:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821696 00000100:00100000:2.0:1716999791.801598:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46354 00000100:00100000:2.0:1716999791.801602:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821696:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.801617:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.801653:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.801680:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821696:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 78us (169us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.801685:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46354 00000100:00100000:1.0:1716999791.803862:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.804009:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821760 00000100:00100000:2.0:1716999791.804016:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821760 00000100:00100000:2.0:1716999791.805082:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46355 00000100:00100000:2.0:1716999791.805091:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821760:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.805116:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc34:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.805180:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc34:0x0]: rc = -2 00000100:00100000:2.0:1716999791.805217:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821760:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 127us (1361us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.805224:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46355 00000100:00100000:1.0:1716999791.807773:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.808263:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821824 00000100:00100000:0.0:1716999791.808270:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821824 00000100:00100000:0.0:1716999791.808307:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46356 00000100:00100000:0.0:1716999791.808313:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821824:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.808335:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc35:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.808403:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc35:0x0]: rc = -2 00000100:00100000:0.0:1716999791.808434:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821824:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 121us (667us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.808440:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46356 00000100:00100000:2.0:1716999791.810283:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.810349:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821888 00000100:00100000:1.0:1716999791.810355:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821888 00000100:00100000:1.0:1716999791.810484:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46357 00000100:00100000:1.0:1716999791.810490:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821888:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.810519:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc36:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.810567:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc36:0x0]: rc = -2 00000100:00100000:1.0:1716999791.810741:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821888:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 251us (463us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.810747:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46357 00000100:00100000:1.0:1716999791.812362:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.812517:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480821952 00000100:00100000:2.0:1716999791.812524:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480821952 00000100:00100000:2.0:1716999791.812618:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46358 00000100:00100000:2.0:1716999791.812624:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821952:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.812645:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.812701:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999791.812864:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480821952:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 239us (506us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.812872:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46358 00000100:00100000:2.0:1716999791.814406:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999791.814477:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822016 00000100:00100000:0.0:1716999791.814482:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822016 00000100:00100000:0.0:1716999791.814510:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46359 00000100:00100000:0.0:1716999791.814516:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822016:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999791.814533:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999791.814589:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:0.0:1716999791.814623:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822016:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (220us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999791.814629:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46359 00000100:00100000:3.0:1716999791.815641:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.815959:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822080 00000100:00100000:2.0:1716999791.815964:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822080 00000100:00100000:2.0:1716999791.815990:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46360 00000100:00100000:2.0:1716999791.815995:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822080:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.816023:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.816067:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.816102:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822080:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (463us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.816108:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46360 00000100:00100000:0.0:1716999791.817398:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.817518:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822144 00000100:00100000:2.0:1716999791.817523:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822144 00000100:00100000:2.0:1716999791.817551:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46361 00000100:00100000:2.0:1716999791.817556:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822144:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.817571:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.817609:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.817640:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822144:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (244us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.817646:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46361 00000100:00100000:0.0:1716999791.818616:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.819148:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822208 00000100:00100000:2.0:1716999791.819153:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822208 00000100:00100000:2.0:1716999791.819173:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46362 00000100:00100000:2.0:1716999791.819177:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822208:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.819193:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc37:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.819233:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc37:0x0]: rc = -2 00000100:00100000:2.0:1716999791.819266:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822208:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 87us (651us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.819273:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46362 00000100:00100000:0.0:1716999791.820441:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.820528:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822272 00000100:00100000:2.0:1716999791.820533:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822272 00000100:00100000:2.0:1716999791.820554:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46363 00000100:00100000:2.0:1716999791.820558:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822272:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.820573:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.820613:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.820647:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822272:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 87us (207us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.820652:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46363 00000100:00100000:0.0:1716999791.821627:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.821760:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822336 00000100:00100000:2.0:1716999791.821765:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822336 00000100:00100000:2.0:1716999791.821782:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46364 00000100:00100000:2.0:1716999791.821796:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822336:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.821822:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.821855:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.821909:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822336:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 120us (282us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.821915:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46364 00000100:00100000:0.0:1716999791.823416:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.823546:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822400 00000100:00100000:2.0:1716999791.823551:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822400 00000100:00100000:2.0:1716999791.823600:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46365 00000100:00100000:2.0:1716999791.823606:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822400:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.823622:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc38:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.823663:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc38:0x0]: rc = -2 00000100:00100000:2.0:1716999791.823696:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822400:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 90us (283us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.823701:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46365 00000100:00100000:0.0:1716999791.824666:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.824969:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822464 00000100:00100000:2.0:1716999791.824974:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822464 00000100:00100000:2.0:1716999791.825003:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46366 00000100:00100000:2.0:1716999791.825008:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822464:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.825022:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.825063:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999791.825093:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822464:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 84us (427us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.825099:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46366 00000100:00100000:0.0:1716999791.826459:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.826554:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822528 00000100:00100000:3.0:1716999791.826559:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822528 00000100:00100000:3.0:1716999791.826590:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46367 00000100:00100000:3.0:1716999791.826595:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822528:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.826611:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.826654:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:3.0:1716999791.826686:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822528:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 90us (229us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.826692:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46367 00000100:00100000:1.0:1716999791.828447:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.828595:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822592 00000100:00100000:2.0:1716999791.828600:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822592 00000100:00100000:2.0:1716999791.828634:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46368 00000100:00100000:2.0:1716999791.828640:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822592:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.828659:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.828708:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999791.828746:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822592:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 105us (302us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.828752:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46368 00000100:00100000:0.0:1716999791.830279:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.830501:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822656 00000100:00100000:3.0:1716999791.830505:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822656 00000100:00100000:3.0:1716999791.830539:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46369 00000100:00100000:3.0:1716999791.830546:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822656:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.830563:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.830610:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:3.0:1716999791.830645:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822656:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (368us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.830651:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46369 00000100:00100000:0.0:1716999791.832019:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.832156:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822720 00000100:00100000:2.0:1716999791.832161:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822720 00000100:00100000:2.0:1716999791.832192:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46370 00000100:00100000:2.0:1716999791.832197:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822720:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.832223:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.832267:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.832290:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822720:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 93us (274us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.832296:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46370 00000100:00100000:0.0:1716999791.833827:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.834058:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822784 00000100:00100000:3.0:1716999791.834063:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822784 00000100:00100000:3.0:1716999791.834243:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46371 00000100:00100000:3.0:1716999791.834249:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822784:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.834275:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.834321:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:3.0:1716999791.834356:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822784:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (531us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.834362:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46371 00000100:00100000:0.0:1716999791.835831:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.836434:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822848 00000100:00100000:2.0:1716999791.836440:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822848 00000100:00100000:2.0:1716999791.836534:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46372 00000100:00100000:2.0:1716999791.836541:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822848:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.836560:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc39:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.836612:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc39:0x0]: rc = -2 00000100:00100000:2.0:1716999791.836838:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822848:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 296us (1008us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.836844:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46372 00000100:00100000:0.0:1716999791.838480:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.838542:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822912 00000100:00100000:2.0:1716999791.838548:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822912 00000100:00100000:2.0:1716999791.838725:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46373 00000100:00100000:2.0:1716999791.838731:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822912:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.838750:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.838813:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.838849:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822912:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 118us (372us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.838855:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46373 00000100:00100000:0.0:1716999791.839988:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.840272:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480822976 00000100:00100000:3.0:1716999791.840277:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480822976 00000100:00100000:3.0:1716999791.840298:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46374 00000100:00100000:3.0:1716999791.840303:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822976:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.840317:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.840357:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:3.0:1716999791.840392:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480822976:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 88us (405us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.840398:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46374 00000100:00100000:0.0:1716999791.841549:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.841615:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823040 00000100:00100000:2.0:1716999791.841620:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823040 00000100:00100000:2.0:1716999791.841646:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46375 00000100:00100000:2.0:1716999791.841652:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823040:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.841668:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc3a:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.841703:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc3a:0x0]: rc = -2 00000100:00100000:2.0:1716999791.841732:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823040:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 80us (184us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.841738:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46375 00000100:00100000:0.0:1716999791.843154:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.843323:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823104 00000100:00100000:3.0:1716999791.843328:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823104 00000100:00100000:3.0:1716999791.843358:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46376 00000100:00100000:3.0:1716999791.843364:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823104:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.843379:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.843419:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:3.0:1716999791.843440:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823104:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 76us (287us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.843446:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46376 00000100:00100000:0.0:1716999791.844763:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.844831:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823168 00000100:00100000:2.0:1716999791.844836:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823168 00000100:00100000:2.0:1716999791.844866:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46377 00000100:00100000:2.0:1716999791.844871:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823168:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.844923:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.844963:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.844986:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823168:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 114us (225us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.844992:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46377 00000100:00100000:0.0:1716999791.846627:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.846858:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823232 00000100:00100000:3.0:1716999791.846863:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823232 00000100:00100000:3.0:1716999791.846912:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46378 00000100:00100000:3.0:1716999791.846917:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823232:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.846933:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.846975:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:3.0:1716999791.847004:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823232:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 86us (379us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.847010:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46378 00000100:00100000:0.0:1716999791.848445:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.848563:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823296 00000100:00100000:2.0:1716999791.848568:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823296 00000100:00100000:2.0:1716999791.848596:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46379 00000100:00100000:2.0:1716999791.848600:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823296:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.848615:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.848658:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999791.848691:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823296:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (247us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.848696:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46379 00000100:00100000:0.0:1716999791.849767:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.849913:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823360 00000100:00100000:3.0:1716999791.849917:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823360 00000100:00100000:3.0:1716999791.849947:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46380 00000100:00100000:3.0:1716999791.849951:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823360:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.849975:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.850013:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:3.0:1716999791.850034:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823360:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 81us (268us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.850041:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46380 00000100:00100000:0.0:1716999791.851271:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.851335:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823424 00000100:00100000:2.0:1716999791.851340:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823424 00000100:00100000:2.0:1716999791.851368:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46381 00000100:00100000:2.0:1716999791.851374:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823424:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.851388:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.851427:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999791.851458:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823424:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (188us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.851463:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46381 00000100:00100000:0.0:1716999791.852569:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.852704:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823488 00000100:00100000:3.0:1716999791.852708:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823488 00000100:00100000:3.0:1716999791.852736:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46382 00000100:00100000:3.0:1716999791.852740:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823488:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.852755:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc3b:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.852804:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc3b:0x0]: rc = -2 00000100:00100000:3.0:1716999791.852825:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823488:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (257us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.852830:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46382 00000100:00100000:0.0:1716999791.854302:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.854361:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823552 00000100:00100000:2.0:1716999791.854366:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823552 00000100:00100000:2.0:1716999791.854394:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46383 00000100:00100000:2.0:1716999791.854400:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823552:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.854416:0:6822:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.854458:0:6822:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:2.0:1716999791.854479:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823552:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 79us (180us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.854485:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46383 00000100:00100000:0.0:1716999791.856014:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.856155:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823616 00000100:00100000:3.0:1716999791.856161:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823616 00000100:00100000:3.0:1716999791.856192:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46384 00000100:00100000:3.0:1716999791.856199:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823616:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.856216:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.856265:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:3.0:1716999791.856289:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823616:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 91us (278us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.856296:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46384 00000100:00100000:2.0:1716999791.857307:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6183665d-a269-4a7c-8dd8-59206e554b99:3220:1800404483017664:0@lo:400:kworker.0 00000100:00100000:2.0:1716999791.857341:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999791.857354:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3220:1800404483017920:0@lo:400:kworker.0 00000100:00100000:2.0:1716999791.857369:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999791.857380:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1716999791.857384:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483017856:0@lo:400:kworker.0 00000100:00100000:2.0:1716999791.857400:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999791.857416:0:6822:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483017920 00000100:00100000:2.0:1716999791.857419:0:6822:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483017920 00000100:00080000:2.0:1716999791.857431:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1716999761 00000100:00100000:2.0:1716999791.857447:0:6822:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1716999791.857451:0:6822:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3220:x1800404483017920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1716999791.857476:0:6822:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3220:x1800404483017920:12345-0@lo:400:kworker.0 Request processed in 24us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.857481:0:6822:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1716999791.857502:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3220:1800404483017920:0@lo:400:kworker.0 00000100:00100000:1.0:1716999791.857568:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483017856 00000100:00100000:1.0:1716999791.857572:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483017856 00000100:00100000:1.0:1716999791.857601:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1716999791.857605:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3220:x1800404483017856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1716999791.857633:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3220:x1800404483017856:12345-0@lo:400:kworker.0 Request processed in 27us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.857638:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1716999791.857658:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3218:1800404483017792:0@lo:400:kworker.0 00000100:00100000:1.0:1716999791.857674:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999791.857684:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1716999791.857688:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009c2c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3218:1800404483017728:0@lo:400:kworker.0 00000100:00100000:1.0:1716999791.857699:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999791.857707:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483017984:0@lo:400:kworker.0 00000100:00100000:1.0:1716999791.857719:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999791.857730:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483017984 00000100:00100000:1.0:1716999791.857732:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483017984 00000100:00100000:1.0:1716999791.857745:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1716999791.857749:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3218:x1800404483017984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1716999791.857770:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3218:x1800404483017984:12345-0@lo:400:kworker.0 Request processed in 20us (50us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.857774:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1716999791.857799:0:3218:0:(client.c:2952:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970195 gen 2 00000004:00080000:1.0:1716999791.857804:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009143d180, transno 4294970189 00000004:00080000:1.0:1716999791.857809:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009143ed80, transno 4294970190 00000004:00080000:1.0:1716999791.857811:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009143ca80, transno 4294970191 00000004:00080000:1.0:1716999791.857813:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009143d500, transno 4294970192 00000004:00080000:1.0:1716999791.857815:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009143ea00, transno 4294970193 00000004:00080000:1.0:1716999791.857817:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009143e680, transno 4294970194 00000004:00080000:1.0:1716999791.857819:0:3218:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009143fb80, transno 4294970195 00000100:00100000:1.0:1716999791.857822:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483017984:0@lo:400:kworker.0 00000004:00080000:1.0:1716999791.857961:0:10149:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 74 changes, 0 in progress, 0 in flight, 7 done 00000100:00100000:1.0:1716999791.857982:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483017792 00000100:00100000:1.0:1716999791.857984:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483017792 00000100:00100000:1.0:1716999791.857996:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483017728 00000100:00100000:1.0:1716999791.857998:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483017728 00000100:00100000:1.0:1716999791.858013:0:6821:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1716999791.858017:0:6821:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3218:x1800404483017792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1716999791.858040:0:6821:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3218:x1800404483017792:12345-0@lo:400:kworker.0 Request processed in 23us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.858045:0:6821:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1716999791.858054:0:6821:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1716999791.858057:0:6821:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3218:x1800404483017728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1716999791.858075:0:6821:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3218:x1800404483017728:12345-0@lo:400:kworker.0 Request processed in 17us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999791.858079:0:6821:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1716999791.858094:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009c2c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3218:1800404483017728:0@lo:400:kworker.0 00000100:00100000:1.0:1716999791.858101:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009c2c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3218:1800404483017792:0@lo:400:kworker.0 00000100:00100000:0.0:1716999791.858150:0:6816:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483017664 00000100:00100000:0.0:1716999791.858153:0:6816:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483017664 00000100:00100000:0.0:1716999791.858177:0:6816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1716999791.858180:0:6816:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6183665d-a269-4a7c-8dd8-59206e554b99+18:3220:x1800404483017664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1716999791.858206:0:6816:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6183665d-a269-4a7c-8dd8-59206e554b99+18:3220:x1800404483017664:12345-0@lo:400:kworker.0 Request processed in 25us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999791.858213:0:6816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:2.0:1716999791.858641:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1716999761 00000100:00080000:2.0:1716999791.858644:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1716999761 00000100:00080000:2.0:1716999791.858646:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1716999761 00000100:00080000:2.0:1716999791.858647:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1716999761 00000100:00100000:2.0:1716999791.858663:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483017856:0@lo:400:kworker.0 00000100:00100000:2.0:1716999791.858670:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009c2c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6183665d-a269-4a7c-8dd8-59206e554b99:3220:1800404483017664:0@lo:400:kworker.0 00000100:00100000:2.0:1716999791.859706:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.859776:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823680 00000100:00100000:3.0:1716999791.859781:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823680 00000100:00100000:3.0:1716999791.859838:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46385 00000100:00100000:3.0:1716999791.859844:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823680:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.859862:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.859948:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:3.0:1716999791.859983:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823680:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 138us (279us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.859989:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46385 00000100:00100000:0.0:1716999791.861495:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.861551:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823744 00000100:00100000:1.0:1716999791.861556:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823744 00000100:00100000:1.0:1716999791.861585:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46386 00000100:00100000:1.0:1716999791.861591:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823744:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.861607:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.861664:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:1.0:1716999791.861686:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823744:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (194us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.861692:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46386 00000100:00100000:0.0:1716999791.862736:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.862805:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823808 00000100:00100000:3.0:1716999791.862810:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823808 00000100:00100000:3.0:1716999791.862838:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46387 00000100:00100000:3.0:1716999791.862844:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823808:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.862871:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.862935:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:3.0:1716999791.862956:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823808:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 112us (221us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.862962:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46387 00000100:00100000:0.0:1716999791.863923:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.863995:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823872 00000100:00100000:1.0:1716999791.863999:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823872 00000100:00100000:1.0:1716999791.864025:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46388 00000100:00100000:1.0:1716999791.864030:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823872:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.864048:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.864086:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:1.0:1716999791.864108:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823872:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 77us (187us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.864114:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46388 00000100:00100000:0.0:1716999791.865359:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.865946:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480823936 00000100:00100000:3.0:1716999791.865952:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480823936 00000100:00100000:3.0:1716999791.865986:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46389 00000100:00100000:3.0:1716999791.865991:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823936:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.866009:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc3c:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.866063:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc3c:0x0]: rc = -2 00000100:00100000:3.0:1716999791.866096:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480823936:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 105us (739us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.866102:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46389 00000100:00100000:0.0:1716999791.867649:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.867960:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824000 00000100:00100000:1.0:1716999791.867966:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824000 00000100:00100000:1.0:1716999791.868002:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46390 00000100:00100000:1.0:1716999791.868008:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824000:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.868026:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.868076:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:1.0:1716999791.868108:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824000:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 100us (462us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.868114:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46390 00000100:00100000:0.0:1716999791.869200:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.871254:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824064 00000100:00100000:3.0:1716999791.871262:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824064 00000100:00100000:3.0:1716999791.871304:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46391 00000100:00100000:3.0:1716999791.871310:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824064:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.871334:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.871394:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:3.0:1716999791.871433:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824064:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 123us (2235us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.871440:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46391 00000100:00100000:0.0:1716999791.873995:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.875666:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824128 00000100:00100000:1.0:1716999791.875674:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824128 00000100:00100000:1.0:1716999791.875717:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46392 00000100:00100000:1.0:1716999791.875723:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824128:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.875757:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.875831:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:1.0:1716999791.875872:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824128:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 148us (1883us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.875900:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46392 00000100:00100000:0.0:1716999791.877828:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.879897:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824192 00000100:00100000:3.0:1716999791.879905:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824192 00000100:00100000:1.0:1716999791.881323:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46393 00000100:00100000:1.0:1716999791.881332:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824192:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.881362:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.881423:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:1.0:1716999791.881471:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824192:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 140us (3647us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.881477:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46393 00000100:00100000:0.0:1716999791.885210:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.885431:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824256 00000100:00100000:3.0:1716999791.885439:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824256 00000100:00100000:1.0:1716999791.886660:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46394 00000100:00100000:1.0:1716999791.886669:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824256:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.886693:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc3d:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.886756:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc3d:0x0]: rc = -2 00000100:00100000:1.0:1716999791.886812:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824256:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 143us (1607us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.886818:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46394 00000100:00100000:0.0:1716999791.888481:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.888554:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824320 00000100:00100000:3.0:1716999791.888561:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824320 00000100:00100000:3.0:1716999791.889132:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46395 00000100:00100000:3.0:1716999791.889138:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824320:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.889159:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc3e:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.889215:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc3e:0x0]: rc = -2 00000100:00100000:3.0:1716999791.889244:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824320:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (768us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.889250:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46395 00000100:00100000:0.0:1716999791.890380:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.890700:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824384 00000100:00100000:1.0:1716999791.890706:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824384 00000100:00100000:1.0:1716999791.890741:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46396 00000100:00100000:1.0:1716999791.890746:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824384:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.890763:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc3f:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.891489:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc3f:0x0]: rc = -2 00000100:00100000:1.0:1716999791.891530:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824384:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 781us (1151us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.891536:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46396 00000100:00100000:0.0:1716999791.893252:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.893338:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824448 00000100:00100000:3.0:1716999791.893344:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824448 00000100:00100000:3.0:1716999791.893461:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46397 00000100:00100000:3.0:1716999791.893467:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824448:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.893498:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc40:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.894345:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc40:0x0]: rc = -2 00000100:00100000:3.0:1716999791.894381:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824448:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 913us (1131us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.894388:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46397 00000100:00100000:0.0:1716999791.897391:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.897578:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824512 00000100:00100000:3.0:1716999791.897586:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824512 00000100:00100000:3.0:1716999791.897863:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46398 00000100:00100000:3.0:1716999791.897870:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824512:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.898018:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.898079:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999791.898264:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824512:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 393us (877us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.898274:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46398 00000100:00100000:2.0:1716999791.901989:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.902054:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824576 00000100:00100000:3.0:1716999791.902060:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824576 00000100:00100000:3.0:1716999791.902205:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46399 00000100:00100000:3.0:1716999791.902212:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824576:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.902234:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.902289:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999791.902330:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824576:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 118us (347us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.902336:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46399 00000100:00100000:0.0:1716999791.903980:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.904038:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824640 00000100:00100000:1.0:1716999791.904044:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824640 00000100:00100000:1.0:1716999791.904074:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46400 00000100:00100000:1.0:1716999791.904079:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824640:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.904107:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.904150:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:1.0:1716999791.904182:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824640:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (204us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.904187:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46400 00000100:00100000:0.0:1716999791.906108:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.906280:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824704 00000100:00100000:3.0:1716999791.906285:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824704 00000100:00100000:3.0:1716999791.906520:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46401 00000100:00100000:3.0:1716999791.906526:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824704:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.906547:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.906602:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999791.906641:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824704:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 115us (537us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.906648:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46401 00000100:00100000:1.0:1716999791.908050:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.908183:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824768 00000100:00100000:2.0:1716999791.908188:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824768 00000100:00100000:2.0:1716999791.908217:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46402 00000100:00100000:2.0:1716999791.908222:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824768:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.908248:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc41:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.908302:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc41:0x0]: rc = -2 00000100:00100000:2.0:1716999791.908324:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824768:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (277us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.908331:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46402 00000100:00100000:0.0:1716999791.909761:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.909840:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824832 00000100:00100000:3.0:1716999791.909845:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824832 00000100:00100000:3.0:1716999791.909875:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46403 00000100:00100000:3.0:1716999791.909905:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824832:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.909927:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc42:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.909970:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc42:0x0]: rc = -2 00000100:00100000:3.0:1716999791.910171:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824832:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 266us (410us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.910178:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46403 00000100:00100000:0.0:1716999791.912062:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.912244:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824896 00000100:00100000:3.0:1716999791.912250:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824896 00000100:00100000:3.0:1716999791.912282:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46404 00000100:00100000:3.0:1716999791.912288:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824896:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.912305:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.912354:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999791.912380:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824896:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (322us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.912386:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46404 00000100:00100000:0.0:1716999791.913824:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.913906:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480824960 00000100:00100000:2.0:1716999791.913920:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480824960 00000100:00100000:2.0:1716999791.913950:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46405 00000100:00100000:2.0:1716999791.913955:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824960:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.913972:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.914015:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999791.914049:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480824960:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 93us (227us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.914055:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46405 00000100:00100000:0.0:1716999791.915681:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.915821:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825024 00000100:00100000:3.0:1716999791.915825:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825024 00000100:00100000:3.0:1716999791.915853:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46406 00000100:00100000:3.0:1716999791.915859:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825024:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.915875:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.915944:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999791.915975:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825024:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 115us (297us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.915981:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46406 00000100:00100000:0.0:1716999791.917830:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.917917:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825088 00000100:00100000:2.0:1716999791.917923:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825088 00000100:00100000:2.0:1716999791.917953:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46407 00000100:00100000:2.0:1716999791.917958:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825088:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.917975:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.918019:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999791.918056:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825088:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 97us (229us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.918063:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46407 00000100:00100000:0.0:1716999791.919370:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.919514:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825152 00000100:00100000:3.0:1716999791.919519:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825152 00000100:00100000:3.0:1716999791.919550:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46408 00000100:00100000:3.0:1716999791.919555:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825152:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.919571:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc43:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.919617:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc43:0x0]: rc = -2 00000100:00100000:3.0:1716999791.919641:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825152:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 85us (272us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.919647:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46408 00000100:00100000:1.0:1716999791.921761:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.925913:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825216 00000100:00100000:2.0:1716999791.925924:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825216 00000100:00100000:2.0:1716999791.925972:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46409 00000100:00100000:2.0:1716999791.925977:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825216:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.926001:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc44:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.926067:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc44:0x0]: rc = -2 00000100:00100000:2.0:1716999791.926119:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825216:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 141us (4362us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.926125:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46409 00000100:00100000:0.0:1716999791.929435:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.929518:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825280 00000100:00100000:3.0:1716999791.929524:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825280 00000100:00100000:3.0:1716999791.929553:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46410 00000100:00100000:3.0:1716999791.929559:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825280:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.929592:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc45:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.929651:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc45:0x0]: rc = -2 00000100:00100000:3.0:1716999791.932658:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825280:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 3091us (3220us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.932670:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46410 00000100:00100000:0.0:1716999791.935497:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.935617:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825344 00000100:00100000:3.0:1716999791.935624:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825344 00000100:00100000:3.0:1716999791.935957:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46411 00000100:00100000:3.0:1716999791.935963:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825344:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.935989:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc46:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.936392:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc46:0x0]: rc = -2 00000100:00100000:3.0:1716999791.936868:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825344:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 902us (1375us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.936875:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46411 00000004:00080000:2.0:1716999791.937864:0:10150:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311136982275ns, next at 312136980885ns, rc = 0 00000100:00100000:0.0:1716999791.937916:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483018048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1716999791.937953:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999791.938036:0:8344:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018048 00000100:00100000:2.0:1716999791.938042:0:8344:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018048 00000100:00100000:2.0:1716999791.938063:0:8344:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1716999791.938067:0:8344:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1800404483018048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1716999791.938092:0:8344:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 28966912 granted 244121600 pending 0 free 3834642432 avail 3832545280 00000100:00100000:2.0:1716999791.938128:0:8344:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091105500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3218:x1800404483018048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999791.938133:0:8344:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1716999791.938194:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483018048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1716999791.942067:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.942287:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825408 00000100:00100000:3.0:1716999791.942295:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825408 00000100:00100000:3.0:1716999791.942641:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46412 00000100:00100000:3.0:1716999791.942648:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825408:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.942677:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.942760:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999791.942818:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825408:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 169us (757us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.942824:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46412 00000100:00100000:0.0:1716999791.949104:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.949174:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825472 00000100:00100000:2.0:1716999791.949182:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825472 00000100:00100000:2.0:1716999791.949279:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46413 00000100:00100000:2.0:1716999791.949287:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825472:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.949326:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.949398:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999791.949444:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825472:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 158us (346us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.949450:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46413 00000100:00100000:0.0:1716999791.954704:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.960143:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825536 00000100:00100000:3.0:1716999791.960154:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825536 00000100:00100000:3.0:1716999791.960205:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46414 00000100:00100000:3.0:1716999791.960212:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825536:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.960240:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.960320:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999791.960372:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825536:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 160us (5675us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.960379:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46414 00000100:00100000:0.0:1716999791.963223:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.963336:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825600 00000100:00100000:2.0:1716999791.963342:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825600 00000100:00100000:2.0:1716999791.963571:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46415 00000100:00100000:2.0:1716999791.963577:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825600:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.963597:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.964346:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999791.964541:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825600:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 962us (1320us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.964548:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46415 00000100:00100000:0.0:1716999791.968869:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.969140:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825664 00000100:00100000:3.0:1716999791.969148:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825664 00000100:00100000:3.0:1716999791.969192:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46416 00000100:00100000:3.0:1716999791.969198:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825664:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.969228:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc47:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.969292:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc47:0x0]: rc = -2 00000100:00100000:3.0:1716999791.969326:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825664:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 127us (464us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.969332:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46416 00000100:00100000:0.0:1716999791.973653:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.973751:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825728 00000100:00100000:2.0:1716999791.973759:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825728 00000100:00100000:2.0:1716999791.976093:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46417 00000100:00100000:2.0:1716999791.976105:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825728:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999791.976132:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999791.976218:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999791.976276:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825728:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 173us (2628us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999791.976282:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46417 00000100:00100000:2.0:1716999791.977579:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.977654:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825792 00000100:00100000:3.0:1716999791.977665:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825792 00000100:00100000:3.0:1716999791.977706:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46418 00000100:00100000:3.0:1716999791.977714:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825792:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.977740:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.977836:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999791.978035:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825792:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 320us (457us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.978042:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46418 00000100:00100000:1.0:1716999791.980844:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999791.981059:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825856 00000100:00100000:2.0:1716999791.981066:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825856 00000100:00100000:1.0:1716999791.981185:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46419 00000100:00100000:1.0:1716999791.981192:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825856:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.981217:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc48:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.981291:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc48:0x0]: rc = -2 00000100:00100000:1.0:1716999791.981327:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825856:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 135us (488us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.981333:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46419 00000100:00100000:0.0:1716999791.986616:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.986875:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825920 00000100:00100000:3.0:1716999791.986906:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825920 00000100:00100000:3.0:1716999791.987297:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46420 00000100:00100000:3.0:1716999791.987304:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825920:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.987330:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.987488:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999791.987679:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825920:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 373us (1067us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.987685:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46420 00000100:00100000:0.0:1716999791.989319:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.989410:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480825984 00000100:00100000:3.0:1716999791.989416:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480825984 00000100:00100000:3.0:1716999791.989447:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46421 00000100:00100000:3.0:1716999791.989453:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825984:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.989470:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.989514:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999791.989539:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480825984:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 85us (225us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.989544:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46421 00000100:00100000:0.0:1716999791.990633:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.990760:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826048 00000100:00100000:1.0:1716999791.990765:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826048 00000100:00100000:3.0:1716999791.991107:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46422 00000100:00100000:3.0:1716999791.991113:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826048:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.991141:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc49:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.991180:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc49:0x0]: rc = -2 00000100:00100000:3.0:1716999791.991203:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826048:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 90us (572us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.991209:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46422 00000100:00100000:0.0:1716999791.992653:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.992784:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826112 00000100:00100000:1.0:1716999791.992798:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826112 00000100:00100000:1.0:1716999791.992829:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46423 00000100:00100000:1.0:1716999791.992835:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826112:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.992851:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc4a:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.992937:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc4a:0x0]: rc = -2 00000100:00100000:1.0:1716999791.992962:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826112:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 127us (312us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.992969:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46423 00000100:00100000:0.0:1716999791.994255:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.995138:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826176 00000100:00100000:3.0:1716999791.995144:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826176 00000100:00100000:3.0:1716999791.995274:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46424 00000100:00100000:3.0:1716999791.995281:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826176:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.995301:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc4b:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.995351:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc4b:0x0]: rc = -2 00000100:00100000:3.0:1716999791.996013:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826176:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 732us (1760us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.996021:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46424 00000100:00100000:0.0:1716999791.997324:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999791.997383:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826240 00000100:00100000:3.0:1716999791.997387:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826240 00000100:00100000:3.0:1716999791.997564:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46425 00000100:00100000:3.0:1716999791.997570:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826240:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999791.997585:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc4c:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999791.997629:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc4c:0x0]: rc = -2 00000100:00100000:3.0:1716999791.997662:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826240:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (340us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999791.997668:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46425 00000100:00100000:0.0:1716999791.999168:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999791.999443:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826304 00000100:00100000:1.0:1716999791.999448:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826304 00000100:00100000:1.0:1716999791.999477:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46426 00000100:00100000:1.0:1716999791.999482:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826304:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999791.999498:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc4d:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999791.999544:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc4d:0x0]: rc = -2 00000100:00100000:1.0:1716999791.999566:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826304:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 84us (400us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999791.999571:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46426 00000100:00100000:0.0:1716999792.000826:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.001147:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826368 00000100:00100000:3.0:1716999792.001152:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826368 00000100:00100000:3.0:1716999792.001330:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46427 00000100:00100000:3.0:1716999792.001337:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826368:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.001353:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.001393:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.001423:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826368:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 87us (599us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.001429:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46427 00000100:00100000:0.0:1716999792.003079:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.003276:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826432 00000100:00100000:1.0:1716999792.003281:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826432 00000100:00100000:1.0:1716999792.003424:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46428 00000100:00100000:1.0:1716999792.003429:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826432:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.003456:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.003494:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:1.0:1716999792.003525:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826432:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 96us (450us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.003531:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46428 00000100:00100000:0.0:1716999792.004842:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.005067:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826496 00000100:00100000:3.0:1716999792.005072:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826496 00000100:00100000:3.0:1716999792.005089:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46429 00000100:00100000:3.0:1716999792.005094:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826496:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.005115:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc4e:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.005152:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc4e:0x0]: rc = -2 00000100:00100000:3.0:1716999792.005172:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826496:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 77us (332us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.005177:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46429 00000100:00100000:0.0:1716999792.006103:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.006535:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826560 00000100:00100000:1.0:1716999792.006540:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826560 00000100:00100000:1.0:1716999792.006724:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46430 00000100:00100000:1.0:1716999792.006729:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826560:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.006743:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.006777:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:1.0:1716999792.006815:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826560:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 86us (714us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.006821:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46430 00000100:00100000:0.0:1716999792.008062:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.008193:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826624 00000100:00100000:3.0:1716999792.008198:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826624 00000100:00100000:3.0:1716999792.008265:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46431 00000100:00100000:3.0:1716999792.008270:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826624:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.008286:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.008324:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.008352:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826624:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 82us (292us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.008357:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46431 00000100:00100000:0.0:1716999792.009563:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.010232:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826688 00000100:00100000:1.0:1716999792.010238:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826688 00000100:00100000:1.0:1716999792.010376:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46432 00000100:00100000:1.0:1716999792.010382:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826688:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.010400:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc4f:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.010447:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc4f:0x0]: rc = -2 00000100:00100000:1.0:1716999792.010573:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826688:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 190us (1011us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.010579:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46432 00000100:00100000:0.0:1716999792.011799:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.011859:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826752 00000100:00100000:1.0:1716999792.011863:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826752 00000100:00100000:3.0:1716999792.012054:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46433 00000100:00100000:3.0:1716999792.012060:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826752:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.012076:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc50:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.012120:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc50:0x0]: rc = -2 00000100:00100000:3.0:1716999792.012143:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826752:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (355us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.012148:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46433 00000100:00100000:0.0:1716999792.013394:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.013526:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826816 00000100:00100000:1.0:1716999792.013531:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826816 00000100:00100000:1.0:1716999792.013556:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46434 00000100:00100000:1.0:1716999792.013562:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826816:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.013574:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.013611:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:1.0:1716999792.013630:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826816:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 68us (238us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.013635:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46434 00000100:00100000:0.0:1716999792.014979:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.015427:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826880 00000100:00100000:3.0:1716999792.015432:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826880 00000100:00100000:3.0:1716999792.015480:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46435 00000100:00100000:3.0:1716999792.015485:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826880:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.015500:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.015541:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.015872:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826880:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 386us (894us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.015894:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46435 00000100:00100000:0.0:1716999792.017128:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.017253:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480826944 00000100:00100000:3.0:1716999792.017258:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480826944 00000100:00100000:3.0:1716999792.017282:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46436 00000100:00100000:3.0:1716999792.017287:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826944:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.017307:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.017345:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.017367:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480826944:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 79us (240us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.017372:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46436 00000100:00100000:0.0:1716999792.018863:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.018939:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827008 00000100:00100000:1.0:1716999792.018943:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827008 00000100:00100000:1.0:1716999792.018973:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46437 00000100:00100000:1.0:1716999792.018979:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827008:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.019002:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.019047:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:1.0:1716999792.019071:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827008:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (209us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.019077:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46437 00000100:00100000:0.0:1716999792.020345:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.020531:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827072 00000100:00100000:3.0:1716999792.020536:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827072 00000100:00100000:3.0:1716999792.020567:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46438 00000100:00100000:3.0:1716999792.020573:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827072:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.020587:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.020629:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.020651:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827072:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 77us (307us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.020656:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46438 00000100:00100000:0.0:1716999792.022249:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.022331:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827136 00000100:00100000:1.0:1716999792.022336:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827136 00000100:00100000:1.0:1716999792.022367:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46439 00000100:00100000:1.0:1716999792.022372:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827136:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.022390:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.022435:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:1.0:1716999792.022471:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827136:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (225us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.022477:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46439 00000100:00100000:0.0:1716999792.023954:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.024312:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827200 00000100:00100000:3.0:1716999792.024317:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827200 00000100:00100000:3.0:1716999792.024338:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46440 00000100:00100000:3.0:1716999792.024343:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827200:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.024358:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.024399:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.024423:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827200:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 80us (473us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.024429:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46440 00000100:00100000:0.0:1716999792.025484:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.025699:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827264 00000100:00100000:1.0:1716999792.025704:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827264 00000100:00100000:1.0:1716999792.025729:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46441 00000100:00100000:1.0:1716999792.025734:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827264:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.025747:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.025781:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:1.0:1716999792.025820:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827264:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 85us (336us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.025825:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46441 00000100:00100000:0.0:1716999792.026945:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.027217:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827328 00000100:00100000:3.0:1716999792.027222:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827328 00000100:00100000:3.0:1716999792.027243:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46442 00000100:00100000:3.0:1716999792.027248:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827328:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.027264:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc51:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.027304:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc51:0x0]: rc = -2 00000100:00100000:3.0:1716999792.027327:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827328:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 79us (385us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.027333:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46442 00000100:00100000:0.0:1716999792.028538:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.028697:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827392 00000100:00100000:1.0:1716999792.028702:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827392 00000100:00100000:1.0:1716999792.028732:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46443 00000100:00100000:1.0:1716999792.028738:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827392:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.028755:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc52:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.028812:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc52:0x0]: rc = -2 00000100:00100000:1.0:1716999792.028848:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827392:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 108us (311us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.028854:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46443 00000100:00100000:2.0:1716999792.030129:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.030181:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827456 00000100:00100000:3.0:1716999792.030185:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827456 00000100:00100000:3.0:1716999792.030552:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46444 00000100:00100000:3.0:1716999792.030559:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827456:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.030587:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.030631:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.030666:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827456:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (537us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.030672:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46444 00000100:00100000:0.0:1716999792.031968:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.032026:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827520 00000100:00100000:1.0:1716999792.032031:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827520 00000100:00100000:1.0:1716999792.032060:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46445 00000100:00100000:1.0:1716999792.032066:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827520:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.032089:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.032130:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:1.0:1716999792.032166:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827520:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (199us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.032172:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46445 00000100:00100000:0.0:1716999792.033608:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.033901:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827584 00000100:00100000:3.0:1716999792.033907:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827584 00000100:00100000:3.0:1716999792.033939:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46446 00000100:00100000:3.0:1716999792.033945:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880094779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827584:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.033964:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.034015:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.034052:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880094779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827584:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (447us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.034058:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46446 00000100:00100000:0.0:1716999792.035450:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.035510:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827648 00000100:00100000:1.0:1716999792.035515:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827648 00000100:00100000:1.0:1716999792.035542:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46447 00000100:00100000:1.0:1716999792.035547:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009477a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827648:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.035563:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.035603:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:1.0:1716999792.035633:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009477a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827648:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 86us (185us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.035639:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46447 00000100:00100000:0.0:1716999792.036734:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.036796:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827712 00000100:00100000:3.0:1716999792.036800:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827712 00000100:00100000:1.0:1716999792.037143:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46448 00000100:00100000:1.0:1716999792.037149:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009477a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827712:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.037166:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc53:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.037207:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc53:0x0]: rc = -2 00000100:00100000:1.0:1716999792.037231:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009477a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827712:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (498us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.037237:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46448 00000100:00100000:0.0:1716999792.038759:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.038862:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827776 00000100:00100000:3.0:1716999792.038868:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827776 00000100:00100000:3.0:1716999792.039109:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46449 00000100:00100000:3.0:1716999792.039115:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009477aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827776:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.039131:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc54:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.039177:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc54:0x0]: rc = -2 00000100:00100000:3.0:1716999792.039204:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009477aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827776:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (448us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.039213:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46449 00000100:00100000:0.0:1716999792.040514:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.040567:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827840 00000100:00100000:1.0:1716999792.040572:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827840 00000100:00100000:1.0:1716999792.040597:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46450 00000100:00100000:1.0:1716999792.040601:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827840:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.040616:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc55:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.040654:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc55:0x0]: rc = -2 00000100:00100000:1.0:1716999792.040675:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009477ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827840:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 73us (164us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.040681:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46450 00000100:00100000:2.0:1716999792.042078:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.042185:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827904 00000100:00100000:3.0:1716999792.042190:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827904 00000100:00100000:3.0:1716999792.042216:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46451 00000100:00100000:3.0:1716999792.042221:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827904:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.042235:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc56:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.042276:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc56:0x0]: rc = -2 00000100:00100000:3.0:1716999792.042304:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827904:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (230us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.042309:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46451 00000100:00100000:0.0:1716999792.043325:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.043375:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480827968 00000100:00100000:1.0:1716999792.043379:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480827968 00000100:00100000:1.0:1716999792.043407:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46452 00000100:00100000:1.0:1716999792.043413:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009477b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827968:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.043438:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0xc57:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.043472:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0xc57:0x0]: rc = -2 00000100:00100000:1.0:1716999792.043500:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009477b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480827968:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 87us (176us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.043505:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46452 00000100:00100000:0.0:1716999792.045018:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.045258:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828032 00000100:00100000:3.0:1716999792.045263:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828032 00000100:00100000:3.0:1716999792.045294:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46453 00000100:00100000:3.0:1716999792.045300:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828032:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.045326:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b5:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.045371:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b5:0x0]: rc = -2 00000100:00100000:3.0:1716999792.045405:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009477b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828032:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 105us (390us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.045411:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46453 00000100:00100000:0.0:1716999792.046709:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.046765:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828096 00000100:00100000:1.0:1716999792.046769:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828096 00000100:00100000:1.0:1716999792.046804:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46454 00000100:00100000:1.0:1716999792.046810:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009477b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828096:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.046825:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b5:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.046864:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b5:0x0]: rc = -2 00000100:00100000:1.0:1716999792.046920:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009477b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828096:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (202us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.046926:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46454 00000100:00100000:2.0:1716999792.048708:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.048782:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828160 00000100:00100000:3.0:1716999792.048798:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828160 00000100:00100000:3.0:1716999792.048831:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46455 00000100:00100000:3.0:1716999792.048836:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828160:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.048854:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b4:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.048982:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b4:0x0]: rc = -2 00000100:00100000:3.0:1716999792.049010:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828160:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 172us (306us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.049016:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46455 00000100:00100000:0.0:1716999792.050298:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.050419:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828224 00000100:00100000:1.0:1716999792.050424:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828224 00000100:00100000:1.0:1716999792.050458:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46456 00000100:00100000:1.0:1716999792.050464:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828224:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.050481:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.050523:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b4:0x0]: rc = -2 00000100:00100000:1.0:1716999792.051000:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009477bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828224:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 535us (704us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.051006:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46456 00000100:00100000:0.0:1716999792.052337:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.052406:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828288 00000100:00100000:1.0:1716999792.052412:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828288 00000100:00100000:1.0:1716999792.052441:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46457 00000100:00100000:1.0:1716999792.052446:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828288:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.052465:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.052516:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b4:0x0]: rc = -2 00000100:00100000:1.0:1716999792.052548:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828288:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (214us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.052554:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46457 00000100:00100000:0.0:1716999792.053559:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.053674:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828352 00000100:00100000:3.0:1716999792.053678:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828352 00000100:00100000:3.0:1716999792.053703:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46458 00000100:00100000:3.0:1716999792.053707:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828352:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.053722:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b4:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.053759:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b4:0x0]: rc = -2 00000100:00100000:3.0:1716999792.053778:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828352:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 71us (222us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.053783:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46458 00000100:00100000:0.0:1716999792.055131:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.055237:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828416 00000100:00100000:1.0:1716999792.055242:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828416 00000100:00100000:1.0:1716999792.055269:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46459 00000100:00100000:1.0:1716999792.055273:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828416:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.055298:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.055336:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:1.0:1716999792.055364:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828416:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 90us (235us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.055369:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46459 00000100:00100000:0.0:1716999792.056434:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.056486:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828480 00000100:00100000:3.0:1716999792.056490:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828480 00000100:00100000:3.0:1716999792.056646:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46460 00000100:00100000:3.0:1716999792.056652:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828480:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.056668:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.056712:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:3.0:1716999792.057081:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828480:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 427us (646us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.057088:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46460 00000100:00100000:0.0:1716999792.058539:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.058616:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828544 00000100:00100000:3.0:1716999792.058622:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828544 00000100:00100000:3.0:1716999792.058691:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46461 00000100:00100000:3.0:1716999792.058697:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828544:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.058724:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.058772:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:3.0:1716999792.059384:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828544:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 686us (846us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.059391:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46461 00000100:00100000:0.0:1716999792.061269:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.061440:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828608 00000100:00100000:3.0:1716999792.061446:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828608 00000100:00100000:3.0:1716999792.061484:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46462 00000100:00100000:3.0:1716999792.061490:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828608:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.061511:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.061567:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:3.0:1716999792.061608:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828608:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (343us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.061614:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46462 00000100:00100000:0.0:1716999792.064135:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.064280:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828672 00000100:00100000:1.0:1716999792.064286:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828672 00000100:00100000:1.0:1716999792.064323:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46463 00000100:00100000:1.0:1716999792.064329:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828672:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.064348:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.064400:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:1.0:1716999792.064440:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828672:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 111us (310us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.064447:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46463 00000100:00100000:0.0:1716999792.066205:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.066358:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828736 00000100:00100000:3.0:1716999792.066363:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828736 00000100:00100000:3.0:1716999792.066387:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46464 00000100:00100000:3.0:1716999792.066392:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828736:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.066409:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.066631:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fc:0x0]: rc = -2 00000100:00100000:3.0:1716999792.066749:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828736:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 355us (546us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.066755:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46464 00000100:00100000:0.0:1716999792.068055:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.068132:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828800 00000100:00100000:3.0:1716999792.068136:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828800 00000100:00100000:3.0:1716999792.068156:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46465 00000100:00100000:3.0:1716999792.068161:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828800:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.068180:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.068221:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999792.068344:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828800:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 181us (290us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.068351:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46465 00000100:00100000:0.0:1716999792.069607:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.069666:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828864 00000100:00100000:3.0:1716999792.069670:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828864 00000100:00100000:3.0:1716999792.069698:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46466 00000100:00100000:3.0:1716999792.069703:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828864:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.069729:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.069771:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999792.069816:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828864:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 111us (211us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.069822:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46466 00000100:00100000:0.0:1716999792.071171:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.071220:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828928 00000100:00100000:2.0:1716999792.071224:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828928 00000100:00100000:2.0:1716999792.071256:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46467 00000100:00100000:2.0:1716999792.071262:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828928:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.071277:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.071322:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:2.0:1716999792.071357:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828928:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 94us (188us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.071364:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46467 00000100:00100000:0.0:1716999792.075606:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.075692:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480828992 00000100:00100000:2.0:1716999792.075701:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480828992 00000100:00100000:2.0:1716999792.075740:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46468 00000100:00100000:2.0:1716999792.075747:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828992:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.075822:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.076007:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:2.0:1716999792.076057:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480828992:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 309us (457us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.076063:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46468 00000100:00100000:0.0:1716999792.080648:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.080736:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829056 00000100:00100000:2.0:1716999792.080743:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829056 00000100:00100000:2.0:1716999792.080839:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46469 00000100:00100000:2.0:1716999792.080845:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829056:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.080870:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.081108:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:2.0:1716999792.081153:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829056:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 308us (511us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.081160:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46469 00000100:00100000:0.0:1716999792.084124:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.084334:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829120 00000100:00100000:3.0:1716999792.084340:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829120 00000100:00100000:3.0:1716999792.084368:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46470 00000100:00100000:3.0:1716999792.084373:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829120:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.084395:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.084449:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:3.0:1716999792.085045:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829120:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 670us (924us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.085053:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46470 00000100:00100000:0.0:1716999792.087034:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.087113:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829184 00000100:00100000:3.0:1716999792.087118:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829184 00000100:00100000:3.0:1716999792.087143:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46471 00000100:00100000:3.0:1716999792.087148:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829184:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.087168:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.087218:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999792.087453:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829184:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 303us (422us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.087459:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46471 00000100:00100000:0.0:1716999792.089575:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.089765:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829248 00000100:00100000:3.0:1716999792.089772:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829248 00000100:00100000:3.0:1716999792.089808:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46472 00000100:00100000:3.0:1716999792.089813:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829248:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.089831:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.089902:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999792.089949:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829248:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 134us (377us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.090863:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46472 00000100:00100000:0.0:1716999792.092422:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.092507:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829312 00000100:00100000:3.0:1716999792.092513:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829312 00000100:00100000:3.0:1716999792.092542:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46473 00000100:00100000:3.0:1716999792.092546:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829312:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.092575:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.092624:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999792.092767:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829312:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 218us (566us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.092773:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46473 00000100:00100000:0.0:1716999792.095503:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.095852:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829376 00000100:00100000:2.0:1716999792.095868:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829376 00000100:00100000:3.0:1716999792.096042:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46474 00000100:00100000:3.0:1716999792.096048:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ce97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829376:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.096073:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.096126:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999792.096168:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ce97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829376:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 120us (669us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.096174:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46474 00000100:00100000:0.0:1716999792.097717:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.097779:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829440 00000100:00100000:2.0:1716999792.097810:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829440 00000100:00100000:2.0:1716999792.097839:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46475 00000100:00100000:2.0:1716999792.097844:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829440:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.097864:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.098080:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:2.0:1716999792.098181:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829440:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 336us (465us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.098188:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46475 00010000:00010000:3.0:1716999792.099080:0:6811:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1716999792.099249:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.099357:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829504 00000100:00100000:2.0:1716999792.099362:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829504 00000100:00100000:2.0:1716999792.099391:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46476 00000100:00100000:2.0:1716999792.099396:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012fefec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829504:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.099412:0:6823:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.099447:0:6823:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:2.0:1716999792.099478:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012fefec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829504:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 80us (229us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.099484:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46476 00000100:00100000:1.0:1716999792.102496:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.103431:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829568 00000100:00100000:3.0:1716999792.103438:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829568 00000100:00100000:3.0:1716999792.103521:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46477 00000100:00100000:3.0:1716999792.103528:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829568:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.103553:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.103617:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999792.103724:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829568:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 196us (1232us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.103732:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46477 00000100:00100000:0.0:1716999792.106387:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.106497:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829632 00000100:00100000:3.0:1716999792.106503:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829632 00000100:00100000:3.0:1716999792.110212:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46478 00000100:00100000:3.0:1716999792.110222:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829632:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.110252:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.110331:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999792.110388:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829632:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 167us (4512us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.110394:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46478 00000100:00100000:0.0:1716999792.112522:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.112844:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829696 00000100:00100000:1.0:1716999792.112852:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829696 00000100:00100000:3.0:1716999792.113128:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46479 00000100:00100000:3.0:1716999792.113135:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829696:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.113157:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.113214:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:3.0:1716999792.113260:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829696:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 124us (743us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.113266:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46479 00000100:00100000:0.0:1716999792.114536:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.115740:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829760 00000100:00100000:1.0:1716999792.115747:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829760 00000100:00100000:1.0:1716999792.115796:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46480 00000100:00100000:1.0:1716999792.115802:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829760:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.115822:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f5:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.115898:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f5:0x0]: rc = -2 00000100:00100000:1.0:1716999792.115928:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829760:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 126us (1394us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.115942:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46480 00000100:00100000:0.0:1716999792.119221:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.119334:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829824 00000100:00100000:3.0:1716999792.119341:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829824 00000100:00100000:3.0:1716999792.119379:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46481 00000100:00100000:3.0:1716999792.119385:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829824:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.119407:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.119464:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:3.0:1716999792.119506:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829824:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 121us (290us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.119512:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46481 00000100:00100000:0.0:1716999792.122468:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.122614:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829888 00000100:00100000:1.0:1716999792.122621:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829888 00000100:00100000:1.0:1716999792.122663:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46482 00000100:00100000:1.0:1716999792.122672:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829888:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.122694:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.122753:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999792.122799:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829888:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 127us (337us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.123217:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46482 00000100:00100000:2.0:1716999792.125872:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.126567:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480829952 00000100:00100000:1.0:1716999792.126573:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480829952 00000100:00100000:1.0:1716999792.127576:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46483 00000100:00100000:1.0:1716999792.127582:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829952:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.127604:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.127662:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999792.127704:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480829952:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 122us (1837us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.127709:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46483 00000100:00100000:0.0:1716999792.132105:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.132171:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830016 00000100:00100000:1.0:1716999792.132180:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830016 00000100:00100000:1.0:1716999792.132758:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46484 00000100:00100000:1.0:1716999792.132765:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830016:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.132800:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d0:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.132864:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d0:0x0]: rc = -2 00000100:00100000:1.0:1716999792.132994:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830016:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 229us (895us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.133001:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46484 00000100:00100000:0.0:1716999792.135169:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.135367:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830080 00000100:00100000:3.0:1716999792.135374:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830080 00000100:00100000:3.0:1716999792.135624:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46485 00000100:00100000:3.0:1716999792.135631:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830080:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.135654:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.135712:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:3.0:1716999792.135742:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830080:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 112us (577us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.135748:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46485 00000100:00100000:0.0:1716999792.137844:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.137944:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830144 00000100:00100000:1.0:1716999792.137950:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830144 00000100:00100000:1.0:1716999792.137989:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46486 00000100:00100000:1.0:1716999792.137995:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830144:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.138015:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.138064:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:1.0:1716999792.138092:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830144:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 97us (251us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.138098:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46486 00000100:00100000:0.0:1716999792.142181:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.142317:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830208 00000100:00100000:3.0:1716999792.142324:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830208 00000100:00100000:3.0:1716999792.142404:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46487 00000100:00100000:3.0:1716999792.142412:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830208:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.142437:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.142501:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.142721:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830208:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 308us (545us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.142728:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46487 00000100:00100000:0.0:1716999792.144939:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.145168:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830272 00000100:00100000:3.0:1716999792.145174:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830272 00000100:00100000:3.0:1716999792.145211:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46488 00000100:00100000:3.0:1716999792.145217:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830272:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.145238:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.145289:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.145318:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830272:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 101us (383us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.145323:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46488 00000100:00100000:0.0:1716999792.146595:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.146652:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830336 00000100:00100000:1.0:1716999792.146658:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830336 00000100:00100000:1.0:1716999792.146727:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46489 00000100:00100000:1.0:1716999792.146733:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830336:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.146747:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.146934:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:1.0:1716999792.147261:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830336:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 526us (666us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.147267:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46489 00000100:00100000:0.0:1716999792.148056:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.148268:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830400 00000100:00100000:1.0:1716999792.148272:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830400 00000100:00100000:1.0:1716999792.148435:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46490 00000100:00100000:1.0:1716999792.148440:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830400:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.148454:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6cb:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.148489:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6cb:0x0]: rc = -2 00000100:00100000:1.0:1716999792.148519:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830400:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 79us (463us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.148524:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46490 00000100:00100000:0.0:1716999792.149954:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.150313:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830464 00000100:00100000:3.0:1716999792.150317:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830464 00000100:00100000:3.0:1716999792.150342:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46491 00000100:00100000:3.0:1716999792.150346:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830464:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.150360:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.150395:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.150423:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830464:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 76us (470us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.150428:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46491 00000100:00100000:0.0:1716999792.151629:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.151819:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830528 00000100:00100000:1.0:1716999792.151823:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830528 00000100:00100000:1.0:1716999792.152069:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46492 00000100:00100000:1.0:1716999792.152075:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830528:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.152173:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.152241:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:0.0:1716999792.152275:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830528:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 199us (646us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.152281:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46492 00000100:00100000:0.0:1716999792.153374:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.153432:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830592 00000100:00100000:2.0:1716999792.153437:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830592 00000100:00100000:2.0:1716999792.153502:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46493 00000100:00100000:2.0:1716999792.153507:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830592:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.153526:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.153656:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.153757:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830592:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 248us (383us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.153763:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46493 00000100:00100000:0.0:1716999792.155353:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.155400:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830656 00000100:00100000:2.0:1716999792.155404:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830656 00000100:00100000:2.0:1716999792.155475:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46494 00000100:00100000:2.0:1716999792.155481:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830656:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.155496:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.155535:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.155567:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830656:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 86us (216us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.155576:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46494 00000100:00100000:0.0:1716999792.156876:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.157362:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830720 00000100:00100000:3.0:1716999792.157367:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830720 00000100:00100000:3.0:1716999792.157588:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46495 00000100:00100000:3.0:1716999792.157594:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830720:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.157612:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.157650:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.157685:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830720:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 90us (809us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.157691:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46495 00000100:00100000:0.0:1716999792.159047:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.159179:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830784 00000100:00100000:2.0:1716999792.159184:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830784 00000100:00100000:2.0:1716999792.159234:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46496 00000100:00100000:2.0:1716999792.159240:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830784:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.159254:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.159288:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.159427:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830784:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 186us (380us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.159434:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46496 00000100:00100000:2.0:1716999792.163808:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.163867:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830848 00000100:00100000:0.0:1716999792.163874:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830848 00000100:00100000:0.0:1716999792.163939:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46497 00000100:00100000:0.0:1716999792.163945:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830848:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.163966:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x730:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.164054:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x730:0x0]: rc = -2 00000100:00100000:0.0:1716999792.164096:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830848:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 150us (292us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.164102:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46497 00000100:00100000:0.0:1716999792.166151:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.166255:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830912 00000100:00100000:2.0:1716999792.166261:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830912 00000100:00100000:2.0:1716999792.166285:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46498 00000100:00100000:2.0:1716999792.166291:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830912:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.166312:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x730:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.166367:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x730:0x0]: rc = -2 00000100:00100000:2.0:1716999792.166394:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830912:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 103us (246us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.166400:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46498 00000100:00100000:0.0:1716999792.170772:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.170825:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480830976 00000100:00100000:3.0:1716999792.170833:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480830976 00000100:00100000:3.0:1716999792.172225:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46499 00000100:00100000:3.0:1716999792.172232:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830976:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.172260:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.172740:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.172838:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480830976:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 605us (2071us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.172845:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46499 00000100:00100000:0.0:1716999792.174846:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.174923:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831040 00000100:00100000:3.0:1716999792.174930:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831040 00000100:00100000:3.0:1716999792.174969:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46500 00000100:00100000:3.0:1716999792.174975:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831040:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.174994:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.175052:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.175080:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831040:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (239us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.175086:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46500 00000100:00100000:0.0:1716999792.176254:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.176354:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831104 00000100:00100000:2.0:1716999792.176359:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831104 00000100:00100000:2.0:1716999792.176388:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46501 00000100:00100000:2.0:1716999792.176393:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831104:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.176408:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.176444:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.176465:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831104:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 72us (214us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.176471:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46501 00000100:00100000:0.0:1716999792.177532:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.177569:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831168 00000100:00100000:3.0:1716999792.177574:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831168 00000100:00100000:3.0:1716999792.177602:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46502 00000100:00100000:3.0:1716999792.177607:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831168:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.177621:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.177656:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.177688:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831168:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 80us (158us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.177694:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46502 00000100:00100000:0.0:1716999792.179214:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.179251:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831232 00000100:00100000:2.0:1716999792.179256:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831232 00000100:00100000:2.0:1716999792.179304:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46503 00000100:00100000:2.0:1716999792.179309:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831232:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.179324:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.179363:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.179535:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831232:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 223us (331us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.179541:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46503 00000100:00100000:0.0:1716999792.180804:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.180978:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831296 00000100:00100000:2.0:1716999792.180983:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831296 00000100:00100000:2.0:1716999792.181065:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46504 00000100:00100000:2.0:1716999792.181070:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831296:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.181086:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.181127:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.181160:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831296:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (357us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.181166:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46504 00000100:00100000:0.0:1716999792.182557:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.182778:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831360 00000100:00100000:3.0:1716999792.182783:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831360 00000100:00100000:3.0:1716999792.182820:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46505 00000100:00100000:3.0:1716999792.182826:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831360:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.182844:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.183266:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.183437:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831360:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 610us (882us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.183443:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46505 00000100:00100000:0.0:1716999792.184699:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.184767:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831424 00000100:00100000:3.0:1716999792.184771:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831424 00000100:00100000:3.0:1716999792.184806:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46506 00000100:00100000:3.0:1716999792.184812:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831424:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.184828:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.184868:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.184909:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831424:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 97us (212us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.184915:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46506 00000100:00100000:0.0:1716999792.186121:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.186277:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831488 00000100:00100000:2.0:1716999792.186282:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831488 00000100:00100000:2.0:1716999792.186311:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46507 00000100:00100000:2.0:1716999792.186316:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831488:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.186336:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.186377:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.186399:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831488:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (280us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.186405:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46507 00000100:00100000:0.0:1716999792.187469:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.187598:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831552 00000100:00100000:3.0:1716999792.187603:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831552 00000100:00100000:3.0:1716999792.187630:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46508 00000100:00100000:3.0:1716999792.187635:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831552:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.187649:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.187688:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.187710:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831552:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 74us (243us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.187716:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46508 00000100:00100000:0.0:1716999792.189400:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.189455:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831616 00000100:00100000:2.0:1716999792.189459:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831616 00000100:00100000:2.0:1716999792.189490:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46509 00000100:00100000:2.0:1716999792.189495:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831616:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.189510:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.189548:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.189570:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831616:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 75us (173us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.189576:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46509 00000100:00100000:0.0:1716999792.190984:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.191047:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831680 00000100:00100000:3.0:1716999792.191053:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831680 00000100:00100000:3.0:1716999792.191115:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46510 00000100:00100000:3.0:1716999792.191120:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831680:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.191135:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.191174:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.191293:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831680:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 171us (311us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.191298:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46510 00000100:00100000:0.0:1716999792.192713:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.192776:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831744 00000100:00100000:3.0:1716999792.192781:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831744 00000100:00100000:3.0:1716999792.192876:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46511 00000100:00100000:3.0:1716999792.193094:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831744:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.193116:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.193166:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.193193:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831744:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 101us (482us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.193533:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46511 00000100:00100000:0.0:1716999792.194373:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.194621:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831808 00000100:00100000:3.0:1716999792.194627:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831808 00000100:00100000:3.0:1716999792.194804:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46512 00000100:00100000:3.0:1716999792.194810:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831808:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.194827:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.194871:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.195242:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831808:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 430us (868us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.195249:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46512 00000100:00100000:0.0:1716999792.196727:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.196803:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831872 00000100:00100000:3.0:1716999792.196810:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831872 00000100:00100000:3.0:1716999792.196945:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46513 00000100:00100000:3.0:1716999792.196950:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831872:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.196970:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.197019:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.197045:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800917b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831872:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (322us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.197051:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46513 00000100:00100000:0.0:1716999792.198318:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.198545:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480831936 00000100:00100000:2.0:1716999792.198551:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480831936 00000100:00100000:2.0:1716999792.198583:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46514 00000100:00100000:2.0:1716999792.198588:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831936:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.198606:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.198649:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.198671:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480831936:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (356us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.198676:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46514 00000100:00100000:0.0:1716999792.200042:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.200109:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832000 00000100:00100000:2.0:1716999792.200113:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832000 00000100:00100000:2.0:1716999792.200138:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46515 00000100:00100000:2.0:1716999792.200143:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832000:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.200156:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.200189:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.200208:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832000:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 65us (169us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.200213:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46515 00000100:00100000:0.0:1716999792.201066:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.201220:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832064 00000100:00100000:3.0:1716999792.201224:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832064 00000100:00100000:3.0:1716999792.201250:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46516 00000100:00100000:3.0:1716999792.201254:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832064:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.201267:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.201300:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.201321:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832064:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 65us (257us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.201325:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46516 00000100:00100000:0.0:1716999792.202758:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.202828:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832128 00000100:00100000:2.0:1716999792.202833:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832128 00000100:00100000:2.0:1716999792.202866:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46517 00000100:00100000:2.0:1716999792.202871:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832128:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.202909:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.202954:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.202980:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832128:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 108us (224us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.202985:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46517 00000100:00100000:0.0:1716999792.203962:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.204320:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832192 00000100:00100000:3.0:1716999792.204325:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832192 00000100:00100000:3.0:1716999792.204356:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46518 00000100:00100000:3.0:1716999792.204361:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832192:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.204381:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.204424:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.204449:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832192:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 87us (488us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.204455:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46518 00000100:00100000:0.0:1716999792.205570:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.205671:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832256 00000100:00100000:2.0:1716999792.205678:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832256 00000100:00100000:2.0:1716999792.205707:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46519 00000100:00100000:2.0:1716999792.205712:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832256:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.205727:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.205768:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.205802:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832256:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (234us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.205808:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46519 00000100:00100000:0.0:1716999792.206806:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.206998:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832320 00000100:00100000:3.0:1716999792.207004:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832320 00000100:00100000:3.0:1716999792.207036:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46520 00000100:00100000:3.0:1716999792.207041:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832320:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.207167:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.207208:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.207295:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832320:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 252us (490us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.207301:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46520 00000100:00100000:0.0:1716999792.208376:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.208448:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832384 00000100:00100000:3.0:1716999792.208453:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832384 00000100:00100000:3.0:1716999792.208480:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46521 00000100:00100000:3.0:1716999792.208485:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832384:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.208499:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.208535:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.208568:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832384:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 82us (193us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.208574:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46521 00000100:00100000:0.0:1716999792.209395:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.209445:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832448 00000100:00100000:2.0:1716999792.209449:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832448 00000100:00100000:2.0:1716999792.209477:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46522 00000100:00100000:2.0:1716999792.209481:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832448:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.209494:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.209526:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.209545:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832448:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 63us (151us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.209550:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46522 00000100:00100000:0.0:1716999792.210750:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.210819:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832512 00000100:00100000:3.0:1716999792.210824:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832512 00000100:00100000:3.0:1716999792.210850:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46523 00000100:00100000:3.0:1716999792.210855:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832512:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.210871:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.210933:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.210957:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832512:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (209us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.210962:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46523 00000100:00100000:0.0:1716999792.211915:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.212069:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832576 00000100:00100000:2.0:1716999792.212074:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832576 00000100:00100000:2.0:1716999792.212100:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46524 00000100:00100000:2.0:1716999792.212106:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832576:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.212120:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.212152:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.212179:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832576:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 73us (266us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.212185:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46524 00000100:00100000:0.0:1716999792.214318:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.214361:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832640 00000100:00100000:3.0:1716999792.214366:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832640 00000100:00100000:3.0:1716999792.214478:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46525 00000100:00100000:3.0:1716999792.214483:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832640:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.214501:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.214554:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.214590:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832640:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (275us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.214596:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46525 00000100:00100000:0.0:1716999792.215612:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.215743:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832704 00000100:00100000:3.0:1716999792.215749:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832704 00000100:00100000:3.0:1716999792.215776:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46526 00000100:00100000:3.0:1716999792.215781:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832704:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.215809:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.215846:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.215934:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832704:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 150us (322us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.215940:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46526 00000100:00100000:0.0:1716999792.217020:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.217208:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832768 00000100:00100000:2.0:1716999792.217213:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832768 00000100:00100000:2.0:1716999792.217242:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46527 00000100:00100000:2.0:1716999792.217247:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832768:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.217261:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.217295:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.217320:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832768:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 73us (301us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.217326:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46527 00000100:00100000:0.0:1716999792.218420:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.218534:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832832 00000100:00100000:3.0:1716999792.218539:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832832 00000100:00100000:3.0:1716999792.218571:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46528 00000100:00100000:3.0:1716999792.218576:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832832:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.218591:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.218633:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.218666:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832832:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (247us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.218672:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46528 00000100:00100000:0.0:1716999792.219998:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.220133:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832896 00000100:00100000:3.0:1716999792.220139:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832896 00000100:00100000:3.0:1716999792.220169:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46529 00000100:00100000:3.0:1716999792.220174:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832896:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.220191:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.220232:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.220257:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832896:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 82us (261us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.220263:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46529 00000100:00100000:0.0:1716999792.221057:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.221520:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480832960 00000100:00100000:2.0:1716999792.221525:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480832960 00000100:00100000:2.0:1716999792.221552:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46530 00000100:00100000:2.0:1716999792.221557:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832960:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.221570:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.221604:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.221635:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480832960:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 77us (578us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.221640:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46530 00000100:00100000:0.0:1716999792.222854:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.223018:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833024 00000100:00100000:3.0:1716999792.223023:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833024 00000100:00100000:3.0:1716999792.223057:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46531 00000100:00100000:3.0:1716999792.223063:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833024:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.223079:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.223119:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.223154:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833024:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 91us (302us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.223160:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46531 00000100:00100000:0.0:1716999792.224197:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.224236:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833088 00000100:00100000:2.0:1716999792.224241:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833088 00000100:00100000:2.0:1716999792.224274:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46532 00000100:00100000:2.0:1716999792.224278:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833088:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.224294:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.224334:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.224357:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833088:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 77us (160us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.224363:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46532 00000100:00100000:0.0:1716999792.225655:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.225782:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833152 00000100:00100000:3.0:1716999792.225797:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833152 00000100:00100000:3.0:1716999792.225828:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46533 00000100:00100000:3.0:1716999792.225834:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833152:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.225852:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.225928:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.225964:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833152:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 129us (310us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.225970:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46533 00000100:00100000:0.0:1716999792.227479:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.227601:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833216 00000100:00100000:3.0:1716999792.227606:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833216 00000100:00100000:3.0:1716999792.227636:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46534 00000100:00100000:3.0:1716999792.227641:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833216:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.227658:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.227700:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.227724:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833216:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 82us (247us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.227730:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46534 00000100:00100000:0.0:1716999792.228983:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.229048:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833280 00000100:00100000:3.0:1716999792.229052:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833280 00000100:00100000:3.0:1716999792.229077:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46535 00000100:00100000:3.0:1716999792.229081:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833280:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.229098:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.229134:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.229487:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833280:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 403us (505us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.229493:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46535 00000100:00100000:0.0:1716999792.230565:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.230705:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833344 00000100:00100000:3.0:1716999792.230710:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833344 00000100:00100000:3.0:1716999792.230742:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46536 00000100:00100000:3.0:1716999792.230746:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833344:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.230763:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.230817:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.230855:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833344:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 107us (291us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.230861:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46536 00000100:00100000:1.0:1716999792.235851:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.235989:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833408 00000100:00100000:3.0:1716999792.236139:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833408 00000100:00100000:3.0:1716999792.236184:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46537 00000100:00100000:3.0:1716999792.236190:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833408:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.236217:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.237573:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.237636:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833408:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 1443us (1788us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.237643:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46537 00000100:00100000:0.0:1716999792.243444:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.243605:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833472 00000100:00100000:3.0:1716999792.243614:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833472 00000100:00100000:3.0:1716999792.243658:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46538 00000100:00100000:3.0:1716999792.243665:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833472:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.243693:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.243758:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.243811:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833472:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 146us (373us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.243817:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46538 00000100:00100000:0.0:1716999792.246188:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.246261:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833536 00000100:00100000:2.0:1716999792.246268:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833536 00000100:00100000:2.0:1716999792.246306:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46539 00000100:00100000:2.0:1716999792.246312:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833536:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.246336:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.246400:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.246438:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833536:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 126us (255us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.246445:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46539 00000100:00100000:1.0:1716999792.248377:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.248445:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833600 00000100:00100000:3.0:1716999792.248451:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833600 00000100:00100000:3.0:1716999792.248484:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46540 00000100:00100000:3.0:1716999792.248489:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833600:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.248507:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.248556:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.248588:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833600:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (216us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.248593:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46540 00000100:00100000:0.0:1716999792.249774:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.249842:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833664 00000100:00100000:2.0:1716999792.249846:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833664 00000100:00100000:3.0:1716999792.249978:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46541 00000100:00100000:3.0:1716999792.249984:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833664:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.250001:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.250035:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.250068:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833664:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 84us (296us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.250073:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46541 00000100:00100000:1.0:1716999792.253416:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.253637:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833728 00000100:00100000:2.0:1716999792.253644:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833728 00000100:00100000:2.0:1716999792.253684:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46542 00000100:00100000:2.0:1716999792.253690:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833728:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.253712:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.253782:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.253834:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833728:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 144us (425us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.253840:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46542 00000100:00100000:1.0:1716999792.255491:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.255610:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833792 00000100:00100000:3.0:1716999792.255615:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833792 00000100:00100000:3.0:1716999792.255648:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46543 00000100:00100000:3.0:1716999792.255653:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833792:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.255672:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.255715:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.255745:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833792:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 91us (256us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.255750:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46543 00000100:00100000:0.0:1716999792.257669:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.257941:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833856 00000100:00100000:2.0:1716999792.257948:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833856 00000100:00100000:2.0:1716999792.257984:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46544 00000100:00100000:2.0:1716999792.257990:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833856:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.258016:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.258334:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.258376:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833856:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 386us (711us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.258382:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46544 00000100:00100000:0.0:1716999792.259964:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.260053:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833920 00000100:00100000:2.0:1716999792.260058:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833920 00000100:00100000:2.0:1716999792.260089:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46545 00000100:00100000:2.0:1716999792.260094:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833920:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.260112:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.260158:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.260184:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833920:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (222us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.260190:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46545 00000100:00100000:1.0:1716999792.261539:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.261739:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480833984 00000100:00100000:3.0:1716999792.261744:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480833984 00000100:00100000:3.0:1716999792.261771:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46546 00000100:00100000:3.0:1716999792.261775:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833984:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.261799:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.261840:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.261873:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480833984:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (335us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.261902:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46546 00000100:00100000:0.0:1716999792.263226:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.263306:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834048 00000100:00100000:2.0:1716999792.263312:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834048 00000100:00100000:2.0:1716999792.263343:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46547 00000100:00100000:2.0:1716999792.263348:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834048:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.263366:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.263408:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.263442:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cdece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834048:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (217us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.263447:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46547 00000100:00100000:0.0:1716999792.264619:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.264748:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834112 00000100:00100000:3.0:1716999792.264753:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834112 00000100:00100000:2.0:1716999792.265055:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46548 00000100:00100000:2.0:1716999792.265060:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834112:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.265077:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.265118:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.265142:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834112:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 81us (525us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.265146:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46548 00000100:00100000:1.0:1716999792.267160:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.267357:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834176 00000100:00100000:3.0:1716999792.267363:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834176 00000100:00100000:3.0:1716999792.267399:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46549 00000100:00100000:3.0:1716999792.267405:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834176:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.267424:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.267474:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.267512:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834176:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 107us (355us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.267518:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46549 00000100:00100000:0.0:1716999792.268697:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.268909:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834240 00000100:00100000:2.0:1716999792.268914:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834240 00000100:00100000:2.0:1716999792.268994:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46550 00000100:00100000:2.0:1716999792.268999:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834240:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.269018:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.269060:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.269095:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834240:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (399us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.269104:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46550 00000100:00100000:0.0:1716999792.270398:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.270491:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834304 00000100:00100000:3.0:1716999792.270497:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834304 00000100:00100000:3.0:1716999792.270527:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46551 00000100:00100000:3.0:1716999792.270532:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834304:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.270551:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.270593:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.270616:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834304:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (221us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.270622:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46551 00000100:00100000:1.0:1716999792.271899:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.272106:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834368 00000100:00100000:2.0:1716999792.272111:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834368 00000100:00100000:2.0:1716999792.272141:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46552 00000100:00100000:2.0:1716999792.272146:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834368:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.272163:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.272206:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.272238:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834368:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 90us (356us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.272243:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46552 00000100:00100000:0.0:1716999792.273677:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.273740:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834432 00000100:00100000:3.0:1716999792.273745:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834432 00000100:00100000:3.0:1716999792.273777:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46553 00000100:00100000:3.0:1716999792.273791:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834432:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.273808:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.273854:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.273914:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834432:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 130us (238us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.273920:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46553 00000100:00100000:0.0:1716999792.275542:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.275610:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834496 00000100:00100000:2.0:1716999792.275616:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834496 00000100:00100000:2.0:1716999792.275648:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46554 00000100:00100000:2.0:1716999792.275653:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834496:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.275672:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.275722:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.275750:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834496:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 96us (211us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.275756:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46554 00000100:00100000:1.0:1716999792.277584:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.277677:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834560 00000100:00100000:3.0:1716999792.277684:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834560 00000100:00100000:3.0:1716999792.277741:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46555 00000100:00100000:3.0:1716999792.277747:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834560:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.277770:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.277832:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.277871:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834560:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 123us (292us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.277896:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46555 00000100:00100000:0.0:1716999792.279321:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.279747:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834624 00000100:00100000:2.0:1716999792.279753:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834624 00000100:00100000:2.0:1716999792.279796:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46556 00000100:00100000:2.0:1716999792.279802:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834624:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.279823:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.279908:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.279951:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834624:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 148us (633us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.279957:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46556 00000100:00100000:0.0:1716999792.281448:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.281556:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834688 00000100:00100000:3.0:1716999792.281561:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834688 00000100:00100000:3.0:1716999792.281638:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46557 00000100:00100000:3.0:1716999792.281644:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834688:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.281662:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.281707:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.281742:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834688:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (296us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.281748:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46557 00000100:00100000:1.0:1716999792.282793:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.283130:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834752 00000100:00100000:2.0:1716999792.283134:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834752 00000100:00100000:2.0:1716999792.283165:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46558 00000100:00100000:2.0:1716999792.283169:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834752:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.283186:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.283224:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.283256:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834752:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 86us (472us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.283261:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46558 00000100:00100000:0.0:1716999792.284370:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.284417:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834816 00000100:00100000:3.0:1716999792.284421:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834816 00000100:00100000:3.0:1716999792.284477:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46559 00000100:00100000:3.0:1716999792.284481:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834816:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.284497:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.284535:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.284567:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834816:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 84us (198us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.284572:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46559 00000100:00100000:0.0:1716999792.285724:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.285797:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834880 00000100:00100000:2.0:1716999792.285801:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834880 00000100:00100000:2.0:1716999792.285832:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46560 00000100:00100000:2.0:1716999792.285836:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834880:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.285848:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.285918:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.285946:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834880:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 109us (223us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.285952:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46560 00000100:00100000:1.0:1716999792.287485:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.287592:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480834944 00000100:00100000:3.0:1716999792.287598:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480834944 00000100:00100000:3.0:1716999792.287628:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46561 00000100:00100000:3.0:1716999792.287634:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834944:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.287653:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.287697:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.287734:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480834944:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 100us (251us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.287740:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46561 00000100:00100000:0.0:1716999792.289143:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.289201:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835008 00000100:00100000:2.0:1716999792.289207:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835008 00000100:00100000:2.0:1716999792.289235:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46562 00000100:00100000:2.0:1716999792.289240:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835008:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.289256:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.289299:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.289333:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835008:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (192us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.289338:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46562 00000100:00100000:0.0:1716999792.290554:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.290631:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835072 00000100:00100000:3.0:1716999792.290635:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835072 00000100:00100000:3.0:1716999792.290667:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46563 00000100:00100000:3.0:1716999792.290671:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835072:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.290686:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.290724:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.290757:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835072:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 84us (204us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.290763:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46563 00000100:00100000:1.0:1716999792.292495:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.292665:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835136 00000100:00100000:2.0:1716999792.292670:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835136 00000100:00100000:2.0:1716999792.292704:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46564 00000100:00100000:2.0:1716999792.292710:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835136:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.292728:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.292779:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.292827:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835136:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 116us (336us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.292832:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46564 00000100:00100000:0.0:1716999792.294401:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.294477:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835200 00000100:00100000:3.0:1716999792.294482:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835200 00000100:00100000:3.0:1716999792.294652:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46565 00000100:00100000:3.0:1716999792.294657:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835200:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.294674:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.294718:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.294755:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835200:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (357us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.294761:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46565 00000100:00100000:0.0:1716999792.295906:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.295962:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835264 00000100:00100000:2.0:1716999792.295967:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835264 00000100:00100000:2.0:1716999792.295996:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46566 00000100:00100000:2.0:1716999792.296000:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835264:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.296015:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.296053:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.296075:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835264:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 74us (195us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.296081:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46566 00000100:00100000:1.0:1716999792.297606:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.297681:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835328 00000100:00100000:3.0:1716999792.297686:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835328 00000100:00100000:3.0:1716999792.297717:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46567 00000100:00100000:3.0:1716999792.297722:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835328:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.297738:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.297778:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.297825:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835328:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (221us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.297831:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46567 00000100:00100000:0.0:1716999792.298644:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.298676:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835392 00000100:00100000:2.0:1716999792.298680:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835392 00000100:00100000:2.0:1716999792.298711:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46568 00000100:00100000:2.0:1716999792.298715:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835392:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.298734:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.298769:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.298812:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835392:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (167us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.298818:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46568 00000100:00100000:0.0:1716999792.299663:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.299848:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835456 00000100:00100000:3.0:1716999792.299854:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835456 00000100:00100000:3.0:1716999792.299902:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46569 00000100:00100000:3.0:1716999792.299907:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835456:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.299921:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.299957:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.300105:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835456:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 195us (440us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.300110:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46569 00000100:00100000:1.0:1716999792.301026:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.301187:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835520 00000100:00100000:3.0:1716999792.301191:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835520 00000100:00100000:3.0:1716999792.301300:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46570 00000100:00100000:3.0:1716999792.301305:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835520:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.301319:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.301353:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.301455:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835520:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 149us (428us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.301461:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46570 00000100:00100000:0.0:1716999792.302352:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.302412:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835584 00000100:00100000:3.0:1716999792.302416:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835584 00000100:00100000:3.0:1716999792.302562:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46571 00000100:00100000:3.0:1716999792.302571:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835584:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.302589:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.302634:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.302668:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835584:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 97us (316us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.303952:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46571 00000100:00100000:0.0:1716999792.304049:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.304421:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835648 00000100:00100000:3.0:1716999792.304426:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835648 00000100:00100000:3.0:1716999792.304998:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46572 00000100:00100000:3.0:1716999792.305005:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835648:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.305026:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.305078:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.305122:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835648:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (1073us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.305127:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46572 00000100:00100000:1.0:1716999792.306768:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.307091:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835712 00000100:00100000:2.0:1716999792.307097:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835712 00000100:00100000:2.0:1716999792.307143:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46573 00000100:00100000:2.0:1716999792.307149:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835712:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.307170:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.307225:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.307264:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835712:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 114us (499us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.307270:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46573 00000100:00100000:0.0:1716999792.310638:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.310909:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835776 00000100:00100000:3.0:1716999792.310917:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835776 00000100:00100000:3.0:1716999792.310960:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46574 00000100:00100000:3.0:1716999792.310967:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835776:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.310991:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.311055:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.311095:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835776:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 128us (464us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.311101:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46574 00000100:00100000:0.0:1716999792.313591:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.313740:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835840 00000100:00100000:3.0:1716999792.313746:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835840 00000100:00100000:3.0:1716999792.313782:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46575 00000100:00100000:3.0:1716999792.313797:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835840:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.313818:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.313875:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.313930:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835840:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 133us (343us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.313936:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46575 00000100:00100000:1.0:1716999792.316439:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.316582:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835904 00000100:00100000:0.0:1716999792.316588:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835904 00000100:00100000:0.0:1716999792.316626:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46576 00000100:00100000:0.0:1716999792.316631:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835904:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.316651:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.316732:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:0.0:1716999792.316850:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835904:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 217us (416us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.316857:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46576 00000100:00100000:0.0:1716999792.318552:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.318626:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480835968 00000100:00100000:2.0:1716999792.318632:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480835968 00000100:00100000:2.0:1716999792.318876:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46577 00000100:00100000:2.0:1716999792.318906:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835968:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.318928:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.318985:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.319015:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480835968:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 111us (474us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.319021:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46577 00000100:00100000:0.0:1716999792.320654:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.320720:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836032 00000100:00100000:3.0:1716999792.320726:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836032 00000100:00100000:3.0:1716999792.320764:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46578 00000100:00100000:3.0:1716999792.320769:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836032:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.320799:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.320845:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.320897:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836032:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 111us (229us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.320904:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46578 00000100:00100000:1.0:1716999792.325172:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.325260:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836096 00000100:00100000:2.0:1716999792.325267:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836096 00000100:00100000:2.0:1716999792.325312:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46579 00000100:00100000:2.0:1716999792.325319:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836096:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.325345:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.325413:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.325452:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836096:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 133us (286us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.325458:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46579 00000100:00100000:0.0:1716999792.327324:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.329889:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836160 00000100:00100000:3.0:1716999792.329898:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836160 00000100:00100000:3.0:1716999792.329945:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46580 00000100:00100000:3.0:1716999792.329952:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836160:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.329980:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.330040:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.330077:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836160:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 126us (2758us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.330083:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46580 00000100:00100000:0.0:1716999792.332546:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.332594:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836224 00000100:00100000:3.0:1716999792.332601:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836224 00000100:00100000:3.0:1716999792.332639:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46581 00000100:00100000:3.0:1716999792.332644:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836224:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.332664:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.332726:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.332770:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836224:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 124us (227us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.332776:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46581 00000100:00100000:1.0:1716999792.334602:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.334838:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836288 00000100:00100000:3.0:1716999792.334844:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836288 00000100:00100000:3.0:1716999792.335024:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46582 00000100:00100000:3.0:1716999792.335031:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836288:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.335051:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.335103:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.335139:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836288:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 108us (539us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.335146:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46582 00000100:00100000:0.0:1716999792.336512:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.336796:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836352 00000100:00100000:2.0:1716999792.336802:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836352 00000100:00100000:2.0:1716999792.336856:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46583 00000100:00100000:2.0:1716999792.336862:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836352:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.336916:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.336964:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:2.0:1716999792.336996:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836352:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 134us (486us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.337002:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46583 00000100:00100000:0.0:1716999792.338409:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.338528:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836416 00000100:00100000:3.0:1716999792.338533:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836416 00000100:00100000:3.0:1716999792.338560:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46584 00000100:00100000:3.0:1716999792.338564:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836416:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.338579:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x705:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.338620:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x705:0x0]: rc = -2 00000100:00100000:3.0:1716999792.338644:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836416:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 78us (236us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.338649:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46584 00000100:00100000:1.0:1716999792.340512:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.340576:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836480 00000100:00100000:3.0:1716999792.340582:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836480 00000100:00100000:3.0:1716999792.340614:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46585 00000100:00100000:3.0:1716999792.340620:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836480:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.340638:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.340682:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.340709:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836480:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (199us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.340715:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46585 00000100:00100000:0.0:1716999792.342354:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.342817:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836544 00000100:00100000:2.0:1716999792.342823:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836544 00000100:00100000:2.0:1716999792.343208:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46586 00000100:00100000:2.0:1716999792.343215:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836544:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.343236:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.343292:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.343479:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836544:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 263us (1127us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.343485:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46586 00000100:00100000:1.0:1716999792.344951:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.345078:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836608 00000100:00100000:2.0:1716999792.345084:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836608 00000100:00100000:2.0:1716999792.345314:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46587 00000100:00100000:2.0:1716999792.345320:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836608:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.345339:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.345390:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.345672:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836608:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 350us (722us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.345678:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46587 00000100:00100000:1.0:1716999792.347030:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.347188:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836672 00000100:00100000:2.0:1716999792.347194:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836672 00000100:00100000:2.0:1716999792.347430:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46588 00000100:00100000:2.0:1716999792.347437:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836672:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.347455:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.347506:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.347546:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836672:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 109us (518us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.347552:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46588 00000100:00100000:0.0:1716999792.348942:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.349113:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836736 00000100:00100000:3.0:1716999792.349119:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836736 00000100:00100000:3.0:1716999792.349139:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46589 00000100:00100000:3.0:1716999792.349144:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836736:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.349158:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.349200:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.349231:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836736:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 87us (292us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.349237:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46589 00000100:00100000:1.0:1716999792.350505:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.350675:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836800 00000100:00100000:0.0:1716999792.350680:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836800 00000100:00100000:0.0:1716999792.350706:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46590 00000100:00100000:0.0:1716999792.350711:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836800:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.350726:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.350791:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:0.0:1716999792.350815:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836800:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 103us (311us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.350821:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46590 00000100:00100000:1.0:1716999792.352737:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.352817:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836864 00000100:00100000:3.0:1716999792.352824:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836864 00000100:00100000:3.0:1716999792.353381:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46591 00000100:00100000:3.0:1716999792.353388:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836864:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.353408:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.353463:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.353504:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836864:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (771us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.353511:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46591 00000100:00100000:0.0:1716999792.355051:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.355187:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836928 00000100:00100000:1.0:1716999792.355192:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836928 00000100:00100000:1.0:1716999792.355212:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46592 00000100:00100000:1.0:1716999792.355216:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836928:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.355230:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.355271:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:1.0:1716999792.355293:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836928:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 76us (245us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.355297:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46592 00000100:00100000:1.0:1716999792.356543:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.356687:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480836992 00000100:00100000:3.0:1716999792.356691:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480836992 00000100:00100000:3.0:1716999792.356715:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46593 00000100:00100000:3.0:1716999792.356720:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836992:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.356734:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.356770:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:3.0:1716999792.356806:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480836992:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 86us (265us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.356812:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46593 00000100:00100000:1.0:1716999792.358229:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.358476:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837056 00000100:00100000:2.0:1716999792.358481:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837056 00000100:00100000:2.0:1716999792.358508:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46594 00000100:00100000:2.0:1716999792.358513:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837056:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.358528:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.358578:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:2.0:1716999792.358599:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837056:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 86us (372us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.358604:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46594 00000100:00100000:0.0:1716999792.360578:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.360688:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837120 00000100:00100000:3.0:1716999792.360694:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837120 00000100:00100000:3.0:1716999792.360730:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46595 00000100:00100000:3.0:1716999792.360736:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837120:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.361084:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.361139:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.361383:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837120:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 646us (808us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.361390:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46595 00000100:00100000:1.0:1716999792.363116:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.363281:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837184 00000100:00100000:3.0:1716999792.363285:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837184 00000100:00100000:3.0:1716999792.363318:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46596 00000100:00100000:3.0:1716999792.363323:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837184:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.363342:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.363391:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.363419:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c2c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837184:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (307us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.363427:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46596 00000100:00100000:1.0:1716999792.365399:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.365513:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837248 00000100:00100000:2.0:1716999792.365518:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837248 00000100:00100000:2.0:1716999792.365546:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46597 00000100:00100000:2.0:1716999792.365551:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837248:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.365570:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.365616:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:2.0:1716999792.365648:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837248:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 96us (252us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.365653:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46597 00000100:00100000:0.0:1716999792.366774:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.366915:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837312 00000100:00100000:3.0:1716999792.366920:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837312 00000100:00100000:3.0:1716999792.366948:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46598 00000100:00100000:3.0:1716999792.366952:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837312:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.366966:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6ca:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.366999:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6ca:0x0]: rc = -2 00000100:00100000:3.0:1716999792.367030:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801339fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837312:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 77us (256us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.367035:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46598 00000100:00100000:1.0:1716999792.368543:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.368604:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837376 00000100:00100000:2.0:1716999792.368608:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837376 00000100:00100000:2.0:1716999792.368632:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46599 00000100:00100000:2.0:1716999792.368636:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837376:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.368651:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.368686:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.368716:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837376:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 78us (174us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.368720:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46599 00000100:00100000:1.0:1716999792.369599:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.369748:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837440 00000100:00100000:3.0:1716999792.369753:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837440 00000100:00100000:3.0:1716999792.369781:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46600 00000100:00100000:3.0:1716999792.369797:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837440:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.369811:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.369847:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.369877:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837440:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 80us (278us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.369910:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46600 00000100:00100000:0.0:1716999792.371384:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.371469:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837504 00000100:00100000:2.0:1716999792.371474:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837504 00000100:00100000:2.0:1716999792.371526:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46601 00000100:00100000:2.0:1716999792.371531:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837504:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.371548:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.371591:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:2.0:1716999792.371627:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e601180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837504:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (245us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.371633:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46601 00000100:00100000:1.0:1716999792.372690:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.372741:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837568 00000100:00100000:3.0:1716999792.372746:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837568 00000100:00100000:3.0:1716999792.372769:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46602 00000100:00100000:3.0:1716999792.372774:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837568:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.372796:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x704:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.372830:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x704:0x0]: rc = -2 00000100:00100000:3.0:1716999792.372858:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837568:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (169us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.372863:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46602 00000100:00100000:1.0:1716999792.374554:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.374611:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837632 00000100:00100000:2.0:1716999792.374617:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837632 00000100:00100000:2.0:1716999792.374709:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46603 00000100:00100000:2.0:1716999792.374714:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837632:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.374733:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.374777:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:2.0:1716999792.374977:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837632:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 262us (426us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.374983:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46603 00000100:00100000:0.0:1716999792.376074:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.376381:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837696 00000100:00100000:2.0:1716999792.376386:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837696 00000100:00100000:2.0:1716999792.376534:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46604 00000100:00100000:2.0:1716999792.376540:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837696:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.376558:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.376601:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:2.0:1716999792.376979:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e603b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837696:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 437us (905us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.376985:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46604 00000100:00100000:1.0:1716999792.378563:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.379312:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837760 00000100:00100000:2.0:1716999792.379318:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837760 00000100:00100000:2.0:1716999792.379604:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46605 00000100:00100000:2.0:1716999792.379609:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837760:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.379632:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.379689:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:2.0:1716999792.379763:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837760:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 153us (1202us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.379772:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46605 00000100:00100000:1.0:1716999792.381623:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.381810:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837824 00000100:00100000:3.0:1716999792.381817:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837824 00000100:00100000:3.0:1716999792.381858:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46606 00000100:00100000:3.0:1716999792.381864:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837824:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.381916:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.381974:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.382014:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837824:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 149us (395us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.382021:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46606 00000100:00100000:0.0:1716999792.383606:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.383740:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837888 00000100:00100000:2.0:1716999792.383745:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837888 00000100:00100000:2.0:1716999792.383856:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46607 00000100:00100000:2.0:1716999792.383863:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837888:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.383902:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.383956:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:2.0:1716999792.383996:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e600e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837888:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 134us (393us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.384002:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46607 00000100:00100000:1.0:1716999792.385254:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.385393:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480837952 00000100:00100000:3.0:1716999792.385398:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480837952 00000100:00100000:3.0:1716999792.385521:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46608 00000100:00100000:3.0:1716999792.385527:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837952:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.385544:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.385581:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.385614:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480837952:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 86us (362us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.385619:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46608 00000100:00100000:1.0:1716999792.387027:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.387109:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838016 00000100:00100000:2.0:1716999792.387114:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838016 00000100:00100000:2.0:1716999792.387142:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46609 00000100:00100000:2.0:1716999792.387148:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838016:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.387163:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.387211:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:2.0:1716999792.387242:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838016:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 94us (218us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.387248:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46609 00000100:00100000:0.0:1716999792.388397:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.388510:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838080 00000100:00100000:3.0:1716999792.388514:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838080 00000100:00100000:3.0:1716999792.388620:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46610 00000100:00100000:3.0:1716999792.388625:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838080:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.388640:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6fd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.388678:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6fd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.389147:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e601500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838080:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 520us (750us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.389153:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46610 00000100:00100000:1.0:1716999792.390948:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.391071:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838144 00000100:00100000:3.0:1716999792.391077:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838144 00000100:00100000:3.0:1716999792.391101:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46611 00000100:00100000:3.0:1716999792.391107:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838144:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.391127:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.391180:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.391210:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838144:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (266us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.391215:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46611 00000100:00100000:1.0:1716999792.393138:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.393254:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838208 00000100:00100000:0.0:1716999792.393260:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838208 00000100:00100000:0.0:1716999792.393296:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46612 00000100:00100000:0.0:1716999792.393302:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838208:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.393322:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.393398:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999792.393429:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838208:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 127us (295us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.393435:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46612 00000100:00100000:1.0:1716999792.395554:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.395648:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838272 00000100:00100000:3.0:1716999792.395654:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838272 00000100:00100000:3.0:1716999792.395771:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46613 00000100:00100000:3.0:1716999792.395778:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838272:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.395807:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.395864:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.395922:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838272:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 143us (371us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.395928:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46613 00000100:00100000:1.0:1716999792.397452:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.397523:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838336 00000100:00100000:0.0:1716999792.397527:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838336 00000100:00100000:0.0:1716999792.397554:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46614 00000100:00100000:0.0:1716999792.397558:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009143fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838336:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.397574:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.397629:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999792.397659:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009143fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838336:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 100us (209us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.397664:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46614 00000100:00100000:1.0:1716999792.398973:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.399031:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838400 00000100:00100000:3.0:1716999792.399035:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838400 00000100:00100000:3.0:1716999792.399078:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46615 00000100:00100000:3.0:1716999792.399083:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838400:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.399100:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.399137:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:3.0:1716999792.399168:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838400:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (195us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.399173:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46615 00000100:00100000:1.0:1716999792.400380:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.400431:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838464 00000100:00100000:0.0:1716999792.400436:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838464 00000100:00100000:0.0:1716999792.400464:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46616 00000100:00100000:0.0:1716999792.400469:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838464:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.400485:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.400529:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:0.0:1716999792.400558:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838464:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 88us (180us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.400563:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46616 00000100:00100000:1.0:1716999792.402408:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.402474:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838528 00000100:00100000:3.0:1716999792.402479:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838528 00000100:00100000:3.0:1716999792.402501:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46617 00000100:00100000:3.0:1716999792.402507:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838528:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.402524:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.402566:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.402598:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838528:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 91us (193us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.402604:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46617 00000100:00100000:1.0:1716999792.403700:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.403743:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838592 00000100:00100000:0.0:1716999792.403747:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838592 00000100:00100000:0.0:1716999792.403777:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46618 00000100:00100000:0.0:1716999792.403782:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838592:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.403807:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.403860:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999792.403918:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838592:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 125us (210us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.403924:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46618 00000100:00100000:1.0:1716999792.405935:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.406072:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838656 00000100:00100000:3.0:1716999792.406077:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838656 00000100:00100000:3.0:1716999792.406109:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46619 00000100:00100000:3.0:1716999792.406115:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838656:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.406133:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.406181:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:3.0:1716999792.406222:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838656:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 107us (291us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.406227:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46619 00000100:00100000:1.0:1716999792.407799:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.408098:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838720 00000100:00100000:0.0:1716999792.408104:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838720 00000100:00100000:0.0:1716999792.408138:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46620 00000100:00100000:0.0:1716999792.408144:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838720:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.408162:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.408222:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:0.0:1716999792.408254:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838720:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 110us (457us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.408260:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46620 00000100:00100000:1.0:1716999792.409514:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.409586:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838784 00000100:00100000:3.0:1716999792.409590:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838784 00000100:00100000:3.0:1716999792.409660:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46621 00000100:00100000:3.0:1716999792.409665:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838784:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.409679:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.409717:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:3.0:1716999792.409746:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838784:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 80us (233us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.409751:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46621 00000100:00100000:1.0:1716999792.411064:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.411105:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838848 00000100:00100000:0.0:1716999792.411110:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838848 00000100:00100000:0.0:1716999792.411140:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46622 00000100:00100000:0.0:1716999792.411145:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838848:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.411161:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.411212:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:0.0:1716999792.411246:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838848:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 100us (184us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.411252:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46622 00000100:00100000:1.0:1716999792.412700:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.412856:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838912 00000100:00100000:3.0:1716999792.412861:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838912 00000100:00100000:0.0:1716999792.413004:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46623 00000100:00100000:0.0:1716999792.413010:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838912:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.413026:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.413074:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999792.413105:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838912:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 94us (406us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.413110:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46623 00000100:00100000:1.0:1716999792.414287:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.414347:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480838976 00000100:00100000:3.0:1716999792.414351:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480838976 00000100:00100000:3.0:1716999792.414376:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46624 00000100:00100000:3.0:1716999792.414381:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838976:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.414396:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.414433:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.414465:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480838976:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 84us (180us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.414471:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46624 00000100:00100000:1.0:1716999792.415805:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.415854:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839040 00000100:00100000:0.0:1716999792.415859:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839040 00000100:00100000:0.0:1716999792.416024:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46625 00000100:00100000:0.0:1716999792.416031:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839040:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.416048:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.416102:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:0.0:1716999792.416131:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839040:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 101us (327us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.416136:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46625 00000100:00100000:1.0:1716999792.417318:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.417598:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839104 00000100:00100000:0.0:1716999792.417602:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839104 00000100:00100000:0.0:1716999792.417630:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46626 00000100:00100000:0.0:1716999792.417635:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839104:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.417649:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.417698:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:0.0:1716999792.417731:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839104:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 94us (414us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.417737:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46626 00000100:00100000:1.0:1716999792.419198:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.419421:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839168 00000100:00100000:3.0:1716999792.419425:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839168 00000100:00100000:3.0:1716999792.419454:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46627 00000100:00100000:3.0:1716999792.419459:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839168:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.419474:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.419514:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.419544:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839168:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 85us (348us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.419549:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46627 00000100:00100000:1.0:1716999792.420736:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.420780:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839232 00000100:00100000:0.0:1716999792.420794:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839232 00000100:00100000:0.0:1716999792.420825:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46628 00000100:00100000:0.0:1716999792.420830:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839232:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.420844:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.420927:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999792.420957:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135029180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839232:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 127us (224us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.420963:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46628 00000100:00100000:1.0:1716999792.422741:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.423020:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839296 00000100:00100000:3.0:1716999792.423025:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839296 00000100:00100000:3.0:1716999792.423049:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46629 00000100:00100000:3.0:1716999792.423054:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839296:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.423072:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.423118:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:3.0:1716999792.423154:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880135028a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839296:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (415us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.423160:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46629 00000100:00100000:1.0:1716999792.424316:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.424360:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839360 00000100:00100000:0.0:1716999792.424364:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839360 00000100:00100000:0.0:1716999792.424390:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46630 00000100:00100000:0.0:1716999792.424395:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839360:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.424410:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c2:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.424459:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c2:0x0]: rc = -2 00000100:00100000:0.0:1716999792.424487:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88013502bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839360:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (173us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.424492:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46630 00000100:00100000:1.0:1716999792.426104:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.426151:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839424 00000100:00100000:3.0:1716999792.426155:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839424 00000100:00100000:3.0:1716999792.426182:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46631 00000100:00100000:3.0:1716999792.426187:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839424:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.426202:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.426243:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.426274:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839424:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 87us (173us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.426279:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46631 00000100:00100000:1.0:1716999792.427403:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.427515:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839488 00000100:00100000:0.0:1716999792.427519:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839488 00000100:00100000:0.0:1716999792.427685:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46632 00000100:00100000:0.0:1716999792.427691:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839488:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.427707:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.427762:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999792.427805:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839488:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 112us (402us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.427810:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46632 00000100:00100000:1.0:1716999792.429622:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.429702:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839552 00000100:00100000:3.0:1716999792.429707:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839552 00000100:00100000:3.0:1716999792.429777:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46633 00000100:00100000:3.0:1716999792.429791:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839552:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.429810:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.429856:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.430034:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839552:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 250us (414us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.430042:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46633 00000100:00100000:1.0:1716999792.431102:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.431458:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839616 00000100:00100000:3.0:1716999792.431462:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839616 00000100:00100000:3.0:1716999792.431488:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46634 00000100:00100000:3.0:1716999792.431494:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839616:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.431508:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.431546:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.431567:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839616:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 73us (466us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.431571:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46634 00000100:00100000:1.0:1716999792.433187:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.433304:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839680 00000100:00100000:0.0:1716999792.433309:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839680 00000100:00100000:0.0:1716999792.433342:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46635 00000100:00100000:0.0:1716999792.433347:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839680:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.433368:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.433429:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:0.0:1716999792.433467:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839680:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 119us (282us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.433473:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46635 00000100:00100000:1.0:1716999792.434635:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.434748:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839744 00000100:00100000:3.0:1716999792.434753:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839744 00000100:00100000:3.0:1716999792.434792:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46636 00000100:00100000:3.0:1716999792.434798:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839744:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.434813:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.434856:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:3.0:1716999792.434914:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839744:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 115us (279us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.434919:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46636 00000100:00100000:1.0:1716999792.436548:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.436609:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839808 00000100:00100000:0.0:1716999792.436614:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839808 00000100:00100000:0.0:1716999792.436690:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46637 00000100:00100000:0.0:1716999792.436695:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839808:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.436713:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.436771:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999792.437025:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839808:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 328us (478us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.437031:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46637 00000100:00100000:1.0:1716999792.438298:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.438369:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839872 00000100:00100000:0.0:1716999792.438374:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839872 00000100:00100000:0.0:1716999792.438498:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46638 00000100:00100000:0.0:1716999792.438503:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839872:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.438519:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.438564:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999792.438594:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839872:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 91us (298us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.438600:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46638 00000100:00100000:1.0:1716999792.439758:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.440118:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480839936 00000100:00100000:3.0:1716999792.440123:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480839936 00000100:00100000:3.0:1716999792.440201:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46639 00000100:00100000:3.0:1716999792.440206:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839936:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.440223:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.440258:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:3.0:1716999792.440470:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480839936:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 263us (712us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.440477:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46639 00000100:00100000:1.0:1716999792.441541:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.441683:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840000 00000100:00100000:3.0:1716999792.441688:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840000 00000100:00100000:3.0:1716999792.441711:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46640 00000100:00100000:3.0:1716999792.441716:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840000:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.441730:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.441766:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:3.0:1716999792.441801:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840000:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 84us (261us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.441806:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46640 00000100:00100000:1.0:1716999792.443339:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.443439:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840064 00000100:00100000:0.0:1716999792.443445:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840064 00000100:00100000:0.0:1716999792.443501:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46641 00000100:00100000:0.0:1716999792.443507:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009155b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840064:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.443526:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.443582:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999792.443619:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009155b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840064:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 111us (282us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.443625:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46641 00000100:00100000:1.0:1716999792.445124:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.445344:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840128 00000100:00100000:3.0:1716999792.445350:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840128 00000100:00100000:3.0:1716999792.445401:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46642 00000100:00100000:3.0:1716999792.445408:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840128:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.445424:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.445468:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.445507:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840128:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (385us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.445513:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46642 00000100:00100000:1.0:1716999792.447103:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.447319:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840192 00000100:00100000:0.0:1716999792.447325:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840192 00000100:00100000:0.0:1716999792.447407:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46643 00000100:00100000:0.0:1716999792.447413:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840192:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.447430:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.447492:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:0.0:1716999792.447531:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840192:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (431us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.447537:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46643 00000100:00100000:1.0:1716999792.448955:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.449049:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840256 00000100:00100000:3.0:1716999792.449054:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840256 00000100:00100000:3.0:1716999792.449075:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46644 00000100:00100000:3.0:1716999792.449080:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840256:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.449098:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.449140:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:3.0:1716999792.449165:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840256:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (212us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.449170:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46644 00000100:00100000:1.0:1716999792.450756:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.450818:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840320 00000100:00100000:0.0:1716999792.450823:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840320 00000100:00100000:0.0:1716999792.450854:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46645 00000100:00100000:0.0:1716999792.450860:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840320:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.450875:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.450953:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:0.0:1716999792.450985:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840320:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 124us (231us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.450992:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46645 00000100:00100000:1.0:1716999792.452021:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.452454:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840384 00000100:00100000:3.0:1716999792.452459:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840384 00000100:00100000:3.0:1716999792.452490:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46646 00000100:00100000:3.0:1716999792.452496:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840384:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.452511:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dd:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.452550:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dd:0x0]: rc = -2 00000100:00100000:3.0:1716999792.452583:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840384:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 86us (563us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.452589:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46646 00000100:00100000:1.0:1716999792.454176:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.454231:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840448 00000100:00100000:0.0:1716999792.454236:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840448 00000100:00100000:0.0:1716999792.454306:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46647 00000100:00100000:0.0:1716999792.454312:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840448:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.454328:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.454378:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:0.0:1716999792.454524:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099580380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840448:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 211us (349us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.454530:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46647 00000100:00100000:1.0:1716999792.455511:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.455712:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840512 00000100:00100000:0.0:1716999792.455716:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840512 00000100:00100000:0.0:1716999792.455740:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46648 00000100:00100000:0.0:1716999792.455745:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840512:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.455757:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.455806:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:0.0:1716999792.455827:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840512:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 82us (317us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.455832:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46648 00000100:00100000:1.0:1716999792.457367:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.457703:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840576 00000100:00100000:3.0:1716999792.457709:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840576 00000100:00100000:3.0:1716999792.457737:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46649 00000100:00100000:3.0:1716999792.457742:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840576:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.457763:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.457823:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:3.0:1716999792.458160:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840576:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 416us (795us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.458167:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46649 00000100:00100000:1.0:1716999792.459484:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.459527:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840640 00000100:00100000:3.0:1716999792.459531:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840640 00000100:00100000:3.0:1716999792.459673:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46650 00000100:00100000:3.0:1716999792.459679:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840640:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.459697:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.459736:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:3.0:1716999792.459768:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840640:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (286us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.459773:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46650 00000100:00100000:1.0:1716999792.461253:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.461296:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840704 00000100:00100000:0.0:1716999792.461301:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840704 00000100:00100000:0.0:1716999792.461327:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46651 00000100:00100000:0.0:1716999792.461332:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840704:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.461349:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.461403:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:0.0:1716999792.461424:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840704:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (174us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.461429:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46651 00000100:00100000:1.0:1716999792.462576:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.462622:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840768 00000100:00100000:3.0:1716999792.462626:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840768 00000100:00100000:3.0:1716999792.462643:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46652 00000100:00100000:3.0:1716999792.462647:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840768:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.462659:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.462690:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:3.0:1716999792.462709:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840768:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 62us (135us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.462714:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46652 00000100:00100000:1.0:1716999792.463877:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.463951:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840832 00000100:00100000:0.0:1716999792.463956:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840832 00000100:00100000:0.0:1716999792.463986:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46653 00000100:00100000:0.0:1716999792.463991:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840832:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.464007:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.464060:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:0.0:1716999792.464093:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099580e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840832:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (218us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.464099:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46653 00000100:00100000:1.0:1716999792.465241:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.465573:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840896 00000100:00100000:2.0:1716999792.465578:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840896 00000100:00100000:2.0:1716999792.465644:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46654 00000100:00100000:2.0:1716999792.465649:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840896:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.465665:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.465715:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999792.465975:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099583800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840896:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 325us (734us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.465981:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46654 00000100:00100000:1.0:1716999792.467350:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.467434:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480840960 00000100:00100000:2.0:1716999792.467438:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480840960 00000100:00100000:2.0:1716999792.467479:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46655 00000100:00100000:2.0:1716999792.467484:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840960:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.467500:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.467544:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:2.0:1716999792.467576:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099581f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480840960:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (230us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.467581:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46655 00000100:00100000:1.0:1716999792.468868:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.469007:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841024 00000100:00100000:0.0:1716999792.469011:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841024 00000100:00100000:0.0:1716999792.469070:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46656 00000100:00100000:0.0:1716999792.469074:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841024:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.469088:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.469135:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:0.0:1716999792.469161:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841024:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 85us (293us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.469166:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46656 00000100:00100000:1.0:1716999792.470567:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.470621:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841088 00000100:00100000:2.0:1716999792.470625:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841088 00000100:00100000:2.0:1716999792.470651:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46657 00000100:00100000:2.0:1716999792.470655:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841088:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.470670:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.470710:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999792.470730:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841088:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 75us (165us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.470735:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46657 00000100:00100000:1.0:1716999792.471970:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.472018:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841152 00000100:00100000:0.0:1716999792.472023:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841152 00000100:00100000:0.0:1716999792.472050:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46658 00000100:00100000:0.0:1716999792.472055:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841152:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.472072:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.472125:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:0.0:1716999792.472148:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841152:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 93us (183us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.472154:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46658 00000100:00100000:1.0:1716999792.473799:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.474183:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841216 00000100:00100000:2.0:1716999792.474190:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841216 00000100:00100000:2.0:1716999792.474217:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46659 00000100:00100000:2.0:1716999792.474223:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841216:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.474244:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.474297:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:2.0:1716999792.474326:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841216:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 103us (530us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.474333:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46659 00000100:00100000:1.0:1716999792.475837:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.476097:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841280 00000100:00100000:2.0:1716999792.476102:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841280 00000100:00100000:2.0:1716999792.476128:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46660 00000100:00100000:2.0:1716999792.476134:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841280:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.476152:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.476198:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:2.0:1716999792.476223:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841280:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (390us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.476229:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46660 00000100:00100000:2.0:1716999792.477938:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.478037:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841344 00000100:00100000:0.0:1716999792.478044:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841344 00000100:00100000:0.0:1716999792.478070:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46661 00000100:00100000:0.0:1716999792.478076:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841344:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.478095:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.478159:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:0.0:1716999792.478200:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841344:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 123us (265us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.478206:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46661 00000100:00100000:1.0:1716999792.479433:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.479648:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841408 00000100:00100000:2.0:1716999792.479652:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841408 00000100:00100000:2.0:1716999792.479825:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46662 00000100:00100000:2.0:1716999792.479831:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841408:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.479848:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.479918:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999792.479957:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841408:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 125us (526us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.479963:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46662 00000100:00100000:1.0:1716999792.481671:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.481723:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841472 00000100:00100000:0.0:1716999792.481729:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841472 00000100:00100000:0.0:1716999792.481760:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46663 00000100:00100000:0.0:1716999792.481765:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841472:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.481781:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.481841:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:0.0:1716999792.481873:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841472:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 107us (206us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.481891:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46663 00000100:00100000:0.0:1716999792.483118:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.483246:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841536 00000100:00100000:2.0:1716999792.483251:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841536 00000100:00100000:2.0:1716999792.483271:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46664 00000100:00100000:2.0:1716999792.483276:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841536:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.483290:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.483327:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:2.0:1716999792.483362:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e600380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841536:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 84us (246us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.483367:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46664 00000100:00100000:1.0:1716999792.484634:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.484682:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841600 00000100:00100000:0.0:1716999792.484686:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841600 00000100:00100000:0.0:1716999792.484753:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46665 00000100:00100000:0.0:1716999792.484758:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841600:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.484775:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.484836:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:0.0:1716999792.484869:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841600:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 110us (237us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.484876:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46665 00000100:00100000:1.0:1716999792.486085:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.486137:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841664 00000100:00100000:2.0:1716999792.486142:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841664 00000100:00100000:2.0:1716999792.486171:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46666 00000100:00100000:2.0:1716999792.486176:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841664:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.486191:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.486229:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:2.0:1716999792.486263:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841664:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 86us (179us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.486269:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46666 00000100:00100000:1.0:1716999792.487616:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.487727:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841728 00000100:00100000:0.0:1716999792.487732:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841728 00000100:00100000:0.0:1716999792.488105:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46667 00000100:00100000:0.0:1716999792.488110:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841728:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.488125:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.488181:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:0.0:1716999792.488211:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841728:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 101us (597us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.488217:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46667 00000100:00100000:1.0:1716999792.489465:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.489576:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841792 00000100:00100000:2.0:1716999792.489581:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841792 00000100:00100000:2.0:1716999792.489725:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46668 00000100:00100000:2.0:1716999792.489730:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841792:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.489745:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.489792:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:2.0:1716999792.489825:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841792:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 94us (361us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.489830:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46668 00000100:00100000:1.0:1716999792.491805:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.491857:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841856 00000100:00100000:0.0:1716999792.491864:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841856 00000100:00100000:0.0:1716999792.492205:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46669 00000100:00100000:0.0:1716999792.492212:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841856:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.492234:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.492297:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:0.0:1716999792.492338:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841856:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 126us (536us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.492344:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46669 00000100:00100000:1.0:1716999792.493695:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.493965:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841920 00000100:00100000:3.0:1716999792.493971:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841920 00000100:00100000:3.0:1716999792.493998:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46670 00000100:00100000:3.0:1716999792.494003:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841920:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.494020:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6c3:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.494076:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6c3:0x0]: rc = -2 00000100:00100000:3.0:1716999792.494104:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841920:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 100us (411us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.494109:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46670 00000100:00100000:1.0:1716999792.495412:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.495457:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480841984 00000100:00100000:0.0:1716999792.495463:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480841984 00000100:00100000:0.0:1716999792.495493:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46671 00000100:00100000:0.0:1716999792.495499:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841984:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.495513:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.495562:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:0.0:1716999792.495598:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480841984:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (187us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.495603:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46671 00000100:00100000:3.0:1716999792.497052:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.497109:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842048 00000100:00100000:0.0:1716999792.497114:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842048 00000100:00100000:0.0:1716999792.497148:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46672 00000100:00100000:0.0:1716999792.497153:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842048:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.497173:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6dc:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.497302:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6dc:0x0]: rc = -2 00000100:00100000:0.0:1716999792.497340:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842048:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 185us (290us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.497347:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46672 00000100:00100000:1.0:1716999792.499275:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.499508:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842112 00000100:00100000:0.0:1716999792.499514:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842112 00000100:00100000:0.0:1716999792.499553:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46673 00000100:00100000:0.0:1716999792.499559:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842112:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.499579:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.499644:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:0.0:1716999792.499687:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842112:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 127us (417us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.499693:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46673 00000100:00100000:1.0:1716999792.502128:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.502503:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842176 00000100:00100000:2.0:1716999792.502509:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842176 00000100:00100000:2.0:1716999792.502569:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46674 00000100:00100000:2.0:1716999792.502575:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842176:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.502596:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.502667:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:2.0:1716999792.502704:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091104000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842176:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 128us (581us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.502709:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46674 00000100:00100000:3.0:1716999792.504498:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.504546:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842240 00000100:00100000:0.0:1716999792.504551:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842240 00000100:00100000:0.0:1716999792.504578:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46675 00000100:00100000:0.0:1716999792.504583:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842240:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.504601:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x731:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.504664:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x731:0x0]: rc = -2 00000100:00100000:0.0:1716999792.504702:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842240:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 118us (207us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.504707:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46675 00000100:00100000:1.0:1716999792.506282:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.506343:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842304 00000100:00100000:0.0:1716999792.506348:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842304 00000100:00100000:0.0:1716999792.506385:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46676 00000100:00100000:0.0:1716999792.506391:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842304:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.506411:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x731:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.506475:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x731:0x0]: rc = -2 00000100:00100000:0.0:1716999792.506515:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091106a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842304:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 123us (237us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.506521:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46676 00000100:00100000:1.0:1716999792.509041:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.509104:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842368 00000100:00100000:0.0:1716999792.509111:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842368 00000100:00100000:0.0:1716999792.509150:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46677 00000100:00100000:0.0:1716999792.509156:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842368:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.509179:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.509248:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:0.0:1716999792.509281:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091106d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842368:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 125us (246us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.509287:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46677 00000100:00100000:3.0:1716999792.512923:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.513138:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842432 00000100:00100000:0.0:1716999792.513145:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842432 00000100:00100000:0.0:1716999792.513180:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46678 00000100:00100000:0.0:1716999792.513185:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842432:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.513413:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.513490:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:0.0:1716999792.513535:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842432:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 348us (617us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.513541:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46678 00000100:00100000:1.0:1716999792.515622:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.515688:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842496 00000100:00100000:0.0:1716999792.515694:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842496 00000100:00100000:0.0:1716999792.515733:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46679 00000100:00100000:0.0:1716999792.515739:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842496:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.515759:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x731:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.515839:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x731:0x0]: rc = -2 00000100:00100000:0.0:1716999792.515906:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091106680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842496:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 142us (264us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.515912:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46679 00000100:00100000:1.0:1716999792.520401:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.520496:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842560 00000100:00100000:0.0:1716999792.520503:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842560 00000100:00100000:0.0:1716999792.520543:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46680 00000100:00100000:0.0:1716999792.520549:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842560:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.520581:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x731:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.520679:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x731:0x0]: rc = -2 00000100:00100000:0.0:1716999792.520723:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091107100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842560:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 173us (329us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.520729:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46680 00000100:00100000:3.0:1716999792.522407:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.522465:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842624 00000100:00100000:0.0:1716999792.522469:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842624 00000100:00100000:0.0:1716999792.522600:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46681 00000100:00100000:0.0:1716999792.522606:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842624:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.522621:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.522667:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:0.0:1716999792.522702:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842624:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 96us (297us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.522708:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46681 00000100:00100000:0.0:1716999792.524376:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.524483:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842688 00000100:00100000:3.0:1716999792.524488:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842688 00000100:00100000:3.0:1716999792.524511:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46682 00000100:00100000:3.0:1716999792.524516:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842688:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.524533:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.524590:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:3.0:1716999792.524628:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e603100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842688:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 110us (254us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.524634:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46682 00000100:00100000:1.0:1716999792.526313:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.526385:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842752 00000100:00100000:0.0:1716999792.526390:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842752 00000100:00100000:0.0:1716999792.526422:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46683 00000100:00100000:0.0:1716999792.526428:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842752:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.526453:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.526512:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:0.0:1716999792.526549:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091105c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842752:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 120us (239us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.526555:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46683 00000100:00100000:2.0:1716999792.527658:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.527750:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842816 00000100:00100000:3.0:1716999792.527755:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842816 00000100:00100000:3.0:1716999792.528327:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46684 00000100:00100000:3.0:1716999792.528333:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842816:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.528357:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.528397:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:3.0:1716999792.528432:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842816:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (774us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.528438:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46684 00000100:00100000:1.0:1716999792.529949:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.529987:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842880 00000100:00100000:0.0:1716999792.529992:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842880 00000100:00100000:0.0:1716999792.530025:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46685 00000100:00100000:0.0:1716999792.530031:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842880:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.530046:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x731:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.530150:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x731:0x0]: rc = -2 00000100:00100000:0.0:1716999792.530189:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091107b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842880:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 157us (241us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.530195:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46685 00000100:00100000:1.0:1716999792.531661:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.531854:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480842944 00000100:00100000:0.0:1716999792.531859:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480842944 00000100:00100000:3.0:1716999792.532390:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46686 00000100:00100000:3.0:1716999792.532397:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842944:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.532417:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x731:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.532469:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x731:0x0]: rc = -2 00000100:00100000:3.0:1716999792.532503:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091106300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480842944:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 106us (844us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.532509:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46686 00000100:00100000:2.0:1716999792.534865:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.534960:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843008 00000100:00100000:0.0:1716999792.534967:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843008 00000100:00100000:0.0:1716999792.535141:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46687 00000100:00100000:0.0:1716999792.535147:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843008:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.535169:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.535240:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:0.0:1716999792.535283:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843008:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 135us (423us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.535289:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46687 00000100:00100000:1.0:1716999792.538299:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.538353:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843072 00000100:00100000:3.0:1716999792.538360:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843072 00000100:00100000:3.0:1716999792.538392:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46688 00000100:00100000:3.0:1716999792.538398:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843072:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.538420:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.538485:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:3.0:1716999792.539001:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091107480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843072:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 602us (707us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.539007:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46688 00000100:00100000:1.0:1716999792.542321:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.542389:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843136 00000100:00100000:3.0:1716999792.542397:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843136 00000100:00100000:3.0:1716999792.542442:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46689 00000100:00100000:3.0:1716999792.542448:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843136:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.542471:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.542532:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:3.0:1716999792.542580:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091104700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843136:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 131us (266us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.542586:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46689 00000100:00100000:2.0:1716999792.544595:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.544660:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843200 00000100:00100000:3.0:1716999792.544666:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843200 00000100:00100000:3.0:1716999792.544699:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46690 00000100:00100000:3.0:1716999792.544704:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843200:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.544731:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.544781:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:3.0:1716999792.545000:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843200:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 295us (408us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.545010:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46690 00000100:00100000:1.0:1716999792.547864:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.548241:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843264 00000100:00100000:3.0:1716999792.548248:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843264 00000100:00100000:3.0:1716999792.548281:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46691 00000100:00100000:3.0:1716999792.548287:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843264:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:3.0:1716999792.548307:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:3.0:1716999792.548362:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:3.0:1716999792.550262:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091104a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843264:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 1967us (2395us total) trans 0 rc -2/-2 00000100:00100000:3.0:1716999792.550272:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46691 00000100:00100000:1.0:1716999792.553542:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999792.554892:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843328 00000100:00100000:3.0:1716999792.554900:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843328 00000100:00100000:2.0:1716999792.555574:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46692 00000100:00100000:2.0:1716999792.555580:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880091104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843328:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.555604:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6d1:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.555666:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6d1:0x0]: rc = -2 00000100:00100000:2.0:1716999792.555707:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880091104380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843328:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 126us (2172us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.555713:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46692 00000100:00100000:2.0:1716999792.557497:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.557701:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843392 00000100:00100000:0.0:1716999792.557708:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843392 00000100:00100000:0.0:1716999792.557743:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46693 00000100:00100000:0.0:1716999792.557748:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843392:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.557765:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.557851:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:0.0:1716999792.557902:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843392:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 152us (407us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.557908:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46693 00000100:00100000:1.0:1716999792.560492:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.560563:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843456 00000100:00100000:2.0:1716999792.560570:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843456 00000100:00100000:2.0:1716999792.561461:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46694 00000100:00100000:2.0:1716999792.561469:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843456:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.561493:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.561582:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:2.0:1716999792.561623:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843456:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 155us (1137us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.561633:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46694 00000100:00100000:2.0:1716999792.564373:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.564477:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843520 00000100:00100000:0.0:1716999792.564486:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843520 00000100:00100000:0.0:1716999792.564526:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46695 00000100:00100000:0.0:1716999792.564532:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843520:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.564567:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.564660:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:0.0:1716999792.564694:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843520:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 161us (329us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.564703:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46695 00000100:00100000:3.0:1716999792.566578:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.566958:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843584 00000100:00100000:2.0:1716999792.566965:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843584 00000100:00100000:2.0:1716999792.567005:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46696 00000100:00100000:2.0:1716999792.567011:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843584:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.567028:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.567096:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:2.0:1716999792.567126:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843584:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 114us (552us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.567131:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46696 00000100:00100000:1.0:1716999792.568635:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.568696:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843648 00000100:00100000:0.0:1716999792.568702:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843648 00000100:00100000:0.0:1716999792.568737:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46697 00000100:00100000:0.0:1716999792.568744:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843648:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.568759:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x734:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.568831:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x734:0x0]: rc = -2 00000100:00100000:0.0:1716999792.568869:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843648:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 125us (236us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.568875:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46697 00000100:00100000:2.0:1716999792.570446:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.570589:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843712 00000100:00100000:0.0:1716999792.570594:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843712 00000100:00100000:0.0:1716999792.570621:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46698 00000100:00100000:0.0:1716999792.570626:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843712:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.570641:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x734:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.570691:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x734:0x0]: rc = -2 00000100:00100000:0.0:1716999792.570723:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843712:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 97us (281us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.570729:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46698 00000100:00100000:3.0:1716999792.572080:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.572122:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843776 00000100:00100000:2.0:1716999792.572128:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843776 00000100:00100000:2.0:1716999792.572157:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46699 00000100:00100000:2.0:1716999792.572162:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843776:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.572188:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.572232:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:2.0:1716999792.572258:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843776:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (181us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.572265:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46699 00000100:00100000:1.0:1716999792.574021:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.574218:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843840 00000100:00100000:0.0:1716999792.574224:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843840 00000100:00100000:0.0:1716999792.574258:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46700 00000100:00100000:0.0:1716999792.574264:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843840:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.574281:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6f4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.574338:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6f4:0x0]: rc = -2 00000100:00100000:0.0:1716999792.574376:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843840:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 112us (358us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.574382:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46700 00000100:00100000:3.0:1716999792.575713:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.576080:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843904 00000100:00100000:2.0:1716999792.576085:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843904 00000100:00100000:2.0:1716999792.576120:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46701 00000100:00100000:2.0:1716999792.576125:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843904:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.576147:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x734:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.576193:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x734:0x0]: rc = -2 00000100:00100000:2.0:1716999792.576232:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843904:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 105us (521us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.576237:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46701 00000100:00100000:3.0:1716999792.579341:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.579598:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480843968 00000100:00100000:0.0:1716999792.579606:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480843968 00000100:00100000:0.0:1716999792.579773:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46702 00000100:00100000:0.0:1716999792.579779:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843968:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.579820:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x734:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.580128:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x734:0x0]: rc = -2 00000100:00100000:0.0:1716999792.580582:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480843968:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 800us (1285us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.580588:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46702 00000100:00100000:1.0:1716999792.582607:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.582647:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844032 00000100:00100000:0.0:1716999792.582653:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844032 00000100:00100000:0.0:1716999792.582763:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46703 00000100:00100000:0.0:1716999792.582768:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844032:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.582795:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x734:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.582851:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x734:0x0]: rc = -2 00000100:00100000:0.0:1716999792.582903:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844032:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 134us (300us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.582910:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46703 00000100:00100000:3.0:1716999792.583903:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.584322:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844096 00000100:00100000:2.0:1716999792.584327:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844096 00000100:00100000:2.0:1716999792.584380:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46704 00000100:00100000:2.0:1716999792.584386:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844096:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.584401:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x734:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.584442:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x734:0x0]: rc = -2 00000100:00100000:2.0:1716999792.584479:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844096:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 92us (577us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.584484:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46704 00000100:00100000:3.0:1716999792.585908:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.585986:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844160 00000100:00100000:0.0:1716999792.585991:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844160 00000100:00100000:0.0:1716999792.586041:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46705 00000100:00100000:0.0:1716999792.586046:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844160:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.586061:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x72e:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.586112:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x72e:0x0]: rc = -2 00000100:00100000:0.0:1716999792.586145:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844160:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (240us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.586151:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46705 00000100:00100000:1.0:1716999792.587287:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.587695:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844224 00000100:00100000:2.0:1716999792.587700:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844224 00000100:00100000:2.0:1716999792.587731:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46706 00000100:00100000:2.0:1716999792.587737:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844224:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.587755:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x72e:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.587811:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x72e:0x0]: rc = -2 00000100:00100000:2.0:1716999792.587848:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844224:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 111us (563us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.587854:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46706 00000100:00100000:3.0:1716999792.589407:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.589457:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844288 00000100:00100000:0.0:1716999792.589462:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844288 00000100:00100000:0.0:1716999792.589495:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46707 00000100:00100000:0.0:1716999792.589500:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844288:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.589514:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.589567:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b5:0x0]: rc = -2 00000100:00100000:0.0:1716999792.589598:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844288:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 97us (193us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.589604:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46707 00000100:00100000:3.0:1716999792.590545:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.590865:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844352 00000100:00100000:2.0:1716999792.590870:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844352 00000100:00100000:2.0:1716999792.590928:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46708 00000100:00100000:2.0:1716999792.590934:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844352:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.590958:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.590992:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b5:0x0]: rc = -2 00000100:00100000:2.0:1716999792.591023:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844352:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (478us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.591029:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46708 00000100:00100000:1.0:1716999792.593004:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.593067:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844416 00000100:00100000:0.0:1716999792.593073:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844416 00000100:00100000:0.0:1716999792.593255:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46709 00000100:00100000:0.0:1716999792.593261:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844416:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.593290:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b4:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.593354:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b4:0x0]: rc = -2 00000100:00100000:0.0:1716999792.593396:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844416:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 134us (396us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.593402:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46709 00000100:00100000:3.0:1716999792.596538:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.596763:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844480 00000100:00100000:2.0:1716999792.596770:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844480 00000100:00100000:2.0:1716999792.596822:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46710 00000100:00100000:2.0:1716999792.596829:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008af53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844480:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.596852:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b4:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.596953:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b4:0x0]: rc = -2 00000100:00100000:2.0:1716999792.596992:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008af53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844480:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 163us (459us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.596998:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46710 00000100:00100000:3.0:1716999792.603101:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.603382:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844544 00000100:00100000:0.0:1716999792.603390:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844544 00000100:00100000:0.0:1716999792.603422:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46711 00000100:00100000:0.0:1716999792.603429:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844544:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.603456:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.603535:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b5:0x0]: rc = -2 00000100:00100000:0.0:1716999792.603571:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844544:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 142us (476us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.603577:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46711 00000100:00100000:1.0:1716999792.605669:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.607198:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844608 00000100:00100000:2.0:1716999792.607205:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844608 00000100:00100000:2.0:1716999792.607243:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46712 00000100:00100000:2.0:1716999792.607249:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844608:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.607271:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.607330:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b5:0x0]: rc = -2 00000100:00100000:2.0:1716999792.607375:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844608:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 125us (1708us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.607381:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46712 00000100:00100000:3.0:1716999792.613191:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.613308:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844672 00000100:00100000:1.0:1716999792.613315:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844672 00000100:00100000:1.0:1716999792.613396:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46713 00000100:00100000:1.0:1716999792.613403:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844672:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.613434:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.613550:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b4:0x0]: rc = -2 00000100:00100000:1.0:1716999792.614018:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844672:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 615us (833us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.614025:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46713 00000100:00100000:3.0:1716999792.617463:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.617504:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844736 00000100:00100000:1.0:1716999792.617510:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844736 00000100:00100000:1.0:1716999792.617545:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46714 00000100:00100000:1.0:1716999792.617550:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844736:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.617572:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.617630:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b4:0x0]: rc = -2 00000100:00100000:1.0:1716999792.617671:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844736:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 120us (212us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.617678:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46714 00000100:00100000:0.0:1716999792.618843:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.619283:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844800 00000100:00100000:1.0:1716999792.619288:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844800 00000100:00100000:1.0:1716999792.619610:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46715 00000100:00100000:1.0:1716999792.619616:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844800:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.619631:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b5:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.619668:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b5:0x0]: rc = -2 00000100:00100000:1.0:1716999792.619699:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e602300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844800:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (858us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.619704:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46715 00000100:00100000:3.0:1716999792.621754:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.621827:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844864 00000100:00100000:2.0:1716999792.621833:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844864 00000100:00100000:2.0:1716999792.621868:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46716 00000100:00100000:2.0:1716999792.621874:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844864:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.622121:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b5:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.622169:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b5:0x0]: rc = -2 00000100:00100000:2.0:1716999792.622197:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844864:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 322us (447us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.622202:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46716 00000100:00100000:3.0:1716999792.625244:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.625351:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844928 00000100:00100000:1.0:1716999792.625358:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844928 00000100:00100000:1.0:1716999792.625465:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46717 00000100:00100000:1.0:1716999792.625472:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844928:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.625493:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.625553:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b4:0x0]: rc = -2 00000100:00100000:1.0:1716999792.625793:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844928:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 312us (544us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.625800:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46717 00000100:00100000:0.0:1716999792.629090:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.629163:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480844992 00000100:00100000:1.0:1716999792.629171:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480844992 00000100:00100000:1.0:1716999792.629213:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46718 00000100:00100000:1.0:1716999792.629220:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844992:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.629259:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b4:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.629321:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b4:0x0]: rc = -2 00000100:00100000:1.0:1716999792.629488:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e600000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480844992:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 268us (405us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.629496:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46718 00000100:00100000:3.0:1716999792.632209:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.632295:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845056 00000100:00100000:1.0:1716999792.632302:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845056 00000100:00100000:1.0:1716999792.632339:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46719 00000100:00100000:1.0:1716999792.632345:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845056:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.632368:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b5:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.632427:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b5:0x0]: rc = -2 00000100:00100000:1.0:1716999792.632470:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845056:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 124us (267us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.632476:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46719 00000100:00100000:3.0:1716999792.633542:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.633683:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845120 00000100:00100000:1.0:1716999792.633688:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845120 00000100:00100000:1.0:1716999792.633719:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46720 00000100:00100000:1.0:1716999792.633724:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845120:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.633739:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b5:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.633793:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b5:0x0]: rc = -2 00000100:00100000:1.0:1716999792.633824:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845120:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 99us (284us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.633833:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46720 00000100:00100000:0.0:1716999792.635720:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.635913:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845184 00000100:00100000:1.0:1716999792.635919:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845184 00000100:00100000:1.0:1716999792.635955:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46721 00000100:00100000:1.0:1716999792.635960:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845184:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.635977:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.636022:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:1.0:1716999792.636057:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e600700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845184:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 96us (340us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.636063:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46721 00000100:00100000:3.0:1716999792.637633:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.637699:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845248 00000100:00100000:1.0:1716999792.637705:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845248 00000100:00100000:1.0:1716999792.637738:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46722 00000100:00100000:1.0:1716999792.637743:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845248:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.637772:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.637829:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:1.0:1716999792.637864:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845248:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 119us (233us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.637872:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46722 00000100:00100000:3.0:1716999792.639106:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.639153:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845312 00000100:00100000:1.0:1716999792.639157:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845312 00000100:00100000:1.0:1716999792.639187:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46723 00000100:00100000:1.0:1716999792.639192:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845312:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.639206:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.639240:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:1.0:1716999792.639269:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845312:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 77us (165us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.639275:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46723 00000100:00100000:0.0:1716999792.640563:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.640635:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845376 00000100:00100000:1.0:1716999792.640670:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845376 00000100:00100000:1.0:1716999792.640703:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46724 00000100:00100000:1.0:1716999792.640708:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845376:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.640723:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.640760:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:1.0:1716999792.641074:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e602a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845376:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 364us (513us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.641081:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46724 00000100:00100000:3.0:1716999792.642034:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.642107:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845440 00000100:00100000:1.0:1716999792.642111:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845440 00000100:00100000:1.0:1716999792.642134:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46725 00000100:00100000:1.0:1716999792.642139:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845440:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.642182:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.642221:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:1.0:1716999792.642251:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845440:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 111us (218us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.642257:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46725 00000100:00100000:3.0:1716999792.644019:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.644070:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845504 00000100:00100000:1.0:1716999792.644074:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845504 00000100:00100000:1.0:1716999792.644108:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46726 00000100:00100000:1.0:1716999792.644113:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845504:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.644138:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.644179:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:1.0:1716999792.644212:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845504:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 98us (197us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.644218:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46726 00000100:00100000:2.0:1716999792.645479:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.645608:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845568 00000100:00100000:0.0:1716999792.645613:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845568 00000100:00100000:0.0:1716999792.645650:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46727 00000100:00100000:0.0:1716999792.645655:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845568:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.645669:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.645722:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:0.0:1716999792.646090:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845568:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 433us (611us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.646096:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46727 00000100:00100000:3.0:1716999792.647672:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.647921:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845632 00000100:00100000:0.0:1716999792.647927:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845632 00000100:00100000:0.0:1716999792.647952:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46728 00000100:00100000:0.0:1716999792.647957:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845632:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.647975:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.648032:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:0.0:1716999792.648059:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845632:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 101us (391us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.648068:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46728 00000100:00100000:3.0:1716999792.650023:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.650099:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845696 00000100:00100000:0.0:1716999792.650104:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845696 00000100:00100000:0.0:1716999792.650138:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46729 00000100:00100000:0.0:1716999792.650143:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845696:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.650171:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.650353:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:0.0:1716999792.650392:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845696:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 248us (372us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.650397:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46729 00000100:00100000:2.0:1716999792.652511:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.652575:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845760 00000100:00100000:0.0:1716999792.652580:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845760 00000100:00100000:0.0:1716999792.652611:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46730 00000100:00100000:0.0:1716999792.652616:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845760:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.652632:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.652684:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:0.0:1716999792.652719:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845760:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 102us (212us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.652726:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46730 00000100:00100000:3.0:1716999792.654160:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.654267:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845824 00000100:00100000:1.0:1716999792.654271:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845824 00000100:00100000:1.0:1716999792.654317:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46731 00000100:00100000:1.0:1716999792.654322:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845824:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.654335:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.654384:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:1.0:1716999792.654411:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845824:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (253us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.654417:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46731 00000100:00100000:3.0:1716999792.656370:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.656421:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845888 00000100:00100000:0.0:1716999792.656425:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845888 00000100:00100000:0.0:1716999792.656449:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46732 00000100:00100000:0.0:1716999792.656453:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845888:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.656466:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.656516:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:0.0:1716999792.656542:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845888:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 89us (176us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.656546:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46732 00000100:00100000:2.0:1716999792.658211:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.658253:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480845952 00000100:00100000:1.0:1716999792.658259:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480845952 00000100:00100000:1.0:1716999792.658290:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46733 00000100:00100000:1.0:1716999792.658296:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845952:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.658313:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.658356:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:1.0:1716999792.658501:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480845952:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 196us (284us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.658508:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46733 00000100:00100000:3.0:1716999792.663031:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.663109:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846016 00000100:00100000:1.0:1716999792.663115:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846016 00000100:00100000:1.0:1716999792.663189:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46734 00000100:00100000:1.0:1716999792.663195:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846016:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.663219:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.663277:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:1.0:1716999792.663318:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846016:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 123us (292us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.663323:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46734 00000100:00100000:3.0:1716999792.666584:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.666649:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846080 00000100:00100000:0.0:1716999792.666656:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846080 00000100:00100000:0.0:1716999792.666694:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46735 00000100:00100000:0.0:1716999792.666700:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846080:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.666721:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.666806:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:0.0:1716999792.666848:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846080:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 147us (268us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.666854:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46735 00000100:00100000:2.0:1716999792.667851:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.667907:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846144 00000100:00100000:1.0:1716999792.667911:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846144 00000100:00100000:1.0:1716999792.667936:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46736 00000100:00100000:1.0:1716999792.667941:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846144:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.667965:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.667998:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:1.0:1716999792.668033:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846144:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 91us (182us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.668042:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46736 00000100:00100000:3.0:1716999792.668856:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.668952:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846208 00000100:00100000:0.0:1716999792.668955:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846208 00000100:00100000:0.0:1716999792.668973:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46737 00000100:00100000:0.0:1716999792.668977:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846208:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.668994:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.669027:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:0.0:1716999792.669050:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846208:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 72us (194us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.669055:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46737 00000100:00100000:3.0:1716999792.669873:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.669939:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846272 00000100:00100000:0.0:1716999792.669943:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846272 00000100:00100000:0.0:1716999792.669970:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46738 00000100:00100000:0.0:1716999792.669975:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846272:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.669987:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b7:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.670028:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b7:0x0]: rc = -2 00000100:00100000:0.0:1716999792.670059:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846272:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 83us (186us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.670065:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46738 00000100:00100000:2.0:1716999792.670938:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.670973:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846336 00000100:00100000:0.0:1716999792.670976:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846336 00000100:00100000:0.0:1716999792.670994:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46739 00000100:00100000:0.0:1716999792.670997:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846336:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.671006:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.671033:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b5:0x0]: rc = -2 00000100:00100000:0.0:1716999792.671095:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846336:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 97us (157us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.671099:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46739 00000100:00100000:3.0:1716999792.672199:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.672244:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846400 00000100:00100000:0.0:1716999792.672248:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846400 00000100:00100000:0.0:1716999792.672272:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46740 00000100:00100000:0.0:1716999792.672276:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846400:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.672289:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b5:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.672322:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b5:0x0]: rc = -2 00000100:00100000:0.0:1716999792.672637:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846400:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 358us (437us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.672644:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46740 00000100:00100000:3.0:1716999792.673970:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.674036:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846464 00000100:00100000:0.0:1716999792.674040:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846464 00000100:00100000:0.0:1716999792.674066:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46741 00000100:00100000:0.0:1716999792.674071:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846464:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.674096:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b3:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.674135:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b3:0x0]: rc = -2 00000100:00100000:0.0:1716999792.674165:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846464:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 93us (196us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.674170:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46741 00000100:00100000:0.0:1716999792.675145:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.675206:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846528 00000100:00100000:1.0:1716999792.675210:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846528 00000100:00100000:1.0:1716999792.675336:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46742 00000100:00100000:1.0:1716999792.675342:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846528:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.675354:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b3:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.675386:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b3:0x0]: rc = -2 00000100:00100000:1.0:1716999792.675419:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e601c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846528:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 77us (274us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.675425:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46742 00000100:00100000:3.0:1716999792.676968:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.677022:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846592 00000100:00100000:1.0:1716999792.677026:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846592 00000100:00100000:1.0:1716999792.677136:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46743 00000100:00100000:1.0:1716999792.677141:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846592:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.677153:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.677187:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:1.0:1716999792.677273:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846592:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 130us (306us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.677277:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46743 00000100:00100000:2.0:1716999792.678148:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.678205:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846656 00000100:00100000:1.0:1716999792.678208:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846656 00000100:00100000:1.0:1716999792.678231:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46744 00000100:00100000:1.0:1716999792.678235:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846656:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.678247:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.678273:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:1.0:1716999792.678329:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846656:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 91us (180us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.678335:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46744 00000100:00100000:0.0:1716999792.679051:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.679090:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846720 00000100:00100000:1.0:1716999792.679094:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846720 00000100:00100000:1.0:1716999792.679120:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46745 00000100:00100000:1.0:1716999792.679124:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846720:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.679145:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.679178:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:1.0:1716999792.679198:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e603480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846720:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 73us (148us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.679203:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46745 00000100:00100000:3.0:1716999792.680013:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.680150:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846784 00000100:00100000:1.0:1716999792.680154:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846784 00000100:00100000:1.0:1716999792.680178:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46746 00000100:00100000:1.0:1716999792.680182:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ea7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846784:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.680193:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.680416:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:1.0:1716999792.680443:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ea7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846784:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 259us (430us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.680448:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46746 00000100:00100000:2.0:1716999792.681550:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.681645:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846848 00000100:00100000:1.0:1716999792.681649:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846848 00000100:00100000:1.0:1716999792.681676:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46747 00000100:00100000:1.0:1716999792.681680:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846848:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.681693:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.681723:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:1.0:1716999792.681755:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846848:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 74us (207us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.681761:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46747 00000100:00100000:0.0:1716999792.682607:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.682749:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846912 00000100:00100000:2.0:1716999792.682753:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846912 00000100:00100000:2.0:1716999792.682780:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46748 00000100:00100000:2.0:1716999792.682797:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846912:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.682824:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.682873:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:2.0:1716999792.682930:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e602680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846912:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 133us (323us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.682937:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46748 00000100:00100000:3.0:1716999792.684025:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.684084:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480846976 00000100:00100000:1.0:1716999792.684088:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480846976 00000100:00100000:1.0:1716999792.684120:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46749 00000100:00100000:1.0:1716999792.684125:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846976:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.684139:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.684176:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:1.0:1716999792.684210:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480846976:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 84us (186us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.684215:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46749 00000100:00100000:2.0:1716999792.685476:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.685534:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847040 00000100:00100000:0.0:1716999792.685538:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847040 00000100:00100000:0.0:1716999792.685568:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46750 00000100:00100000:0.0:1716999792.685574:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847040:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.685588:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.685649:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:0.0:1716999792.685680:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847040:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 105us (205us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.685685:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46750 00000100:00100000:0.0:1716999792.686412:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.686463:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847104 00000100:00100000:2.0:1716999792.686466:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847104 00000100:00100000:2.0:1716999792.686490:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46751 00000100:00100000:2.0:1716999792.686494:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847104:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.686505:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.686533:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:2.0:1716999792.686563:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847104:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 67us (151us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.686567:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46751 00000100:00100000:3.0:1716999792.687851:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.687924:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847168 00000100:00100000:1.0:1716999792.687929:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847168 00000100:00100000:1.0:1716999792.688062:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46752 00000100:00100000:1.0:1716999792.688068:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847168:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.688090:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.688122:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:1.0:1716999792.688149:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847168:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 82us (300us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.688154:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46752 00000100:00100000:3.0:1716999792.688956:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999792.689012:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847232 00000100:00100000:2.0:1716999792.689016:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847232 00000100:00100000:2.0:1716999792.689044:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46753 00000100:00100000:2.0:1716999792.689051:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847232:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:2.0:1716999792.689067:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:2.0:1716999792.689095:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:2.0:1716999792.689119:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847232:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 67us (164us total) trans 0 rc -2/-2 00000100:00100000:2.0:1716999792.689124:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46753 00000100:00100000:2.0:1716999792.690134:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.690170:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847296 00000100:00100000:0.0:1716999792.690174:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847296 00000100:00100000:0.0:1716999792.690202:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46754 00000100:00100000:0.0:1716999792.690210:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847296:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.690222:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.690275:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:0.0:1716999792.690306:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847296:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 95us (172us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.690315:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46754 00000100:00100000:3.0:1716999792.691638:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999792.692000:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847360 00000100:00100000:1.0:1716999792.692004:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847360 00000100:00100000:1.0:1716999792.692229:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46755 00000100:00100000:1.0:1716999792.692235:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847360:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:1.0:1716999792.692250:0:7785:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:1.0:1716999792.692288:0:7785:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:1.0:1716999792.692352:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847360:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 117us (715us total) trans 0 rc -2/-2 00000100:00100000:1.0:1716999792.692358:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46755 00000100:00100000:2.0:1716999792.693651:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.693780:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847424 00000100:00100000:0.0:1716999792.693795:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847424 00000100:00100000:0.0:1716999792.693822:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46756 00000100:00100000:0.0:1716999792.693830:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847424:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.693844:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.693905:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:0.0:1716999792.694216:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847424:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 386us (564us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.694222:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46756 00000100:00100000:2.0:1716999792.695734:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.695793:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847488 00000100:00100000:0.0:1716999792.695798:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847488 00000100:00100000:0.0:1716999792.695864:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46757 00000100:00100000:0.0:1716999792.695870:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847488:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.695995:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.696038:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:0.0:1716999792.696071:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847488:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 200us (338us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.696077:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46757 00000100:00100000:3.0:1716999792.697189:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999792.697248:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847552 00000100:00100000:0.0:1716999792.697252:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847552 00000100:00100000:0.0:1716999792.697279:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46758 00000100:00100000:0.0:1716999792.697284:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847552:12345-192.168.203.3@tcp:53:lustre_rsync.0 00000004:00000080:0.0:1716999792.697296:0:11055:0:(mdt_handler.c:7634:mdt_fid2path()) path get [0x200000401:0x6b6:0x0] from 18446744073709551615 #0 00000004:00000080:0.0:1716999792.697331:0:11055:0:(mdt_handler.c:7676:mdt_fid2path()) nonlocal object [0x200000401:0x6b6:0x0]: rc = -2 00000100:00100000:0.0:1716999792.697362:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+522:11581:x1800404480847552:12345-192.168.203.3@tcp:53:lustre_rsync.0 Request processed in 77us (173us total) trans 0 rc -2/-2 00000100:00100000:0.0:1716999792.697368:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46758 00010000:00010000:1.0:1716999793.101348:0:11317:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1716999793.324483:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999793.324525:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999793.324561:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999793.324593:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847680 00000100:00100000:0.0:1716999793.324600:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847680 00000100:00100000:0.0:1716999793.324647:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847744 00000100:00100000:0.0:1716999793.324650:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847744 00000100:00100000:0.0:1716999793.324664:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00100000:0.0:1716999793.324669:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+76:1956:x1800404480847680:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:0.0:1716999793.324722:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:107d663a-2216-406b-94c6-b2fcb1558728+76:1956:x1800404480847680:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 52us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999793.324728:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 84 00000100:00100000:1.0:1716999793.324913:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 85 00000100:00100000:1.0:1716999793.324919:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+79:1956:x1800404480847744:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:1.0:1716999793.324947:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:107d663a-2216-406b-94c6-b2fcb1558728+79:1956:x1800404480847744:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 28us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999793.324952:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 85 00000100:00100000:2.0:1716999793.325304:0:6818:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847616 00000100:00100000:2.0:1716999793.325308:0:6818:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847616 00000100:00100000:2.0:1716999793.325330:0:6818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 287 00000100:00100000:2.0:1716999793.325335:0:6818:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb23a41-fd22-43b9-8f02-427ab7f7699a+9:1956:x1800404480847616:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1716999793.325356:0:6818:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb23a41-fd22-43b9-8f02-427ab7f7699a+9:1956:x1800404480847616:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 21us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999793.325361:0:6818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 287 00000100:00080000:3.0:1716999793.325787:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1716999763 00000100:00080000:3.0:1716999793.325791:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1716999763 00000100:00080000:3.0:1716999793.325793:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1716999763 00010000:00010000:1.0:1716999794.106760:0:11316:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1716999794.357866:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986629 is committed 00000004:00080000:0.0:1716999794.357957:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 134 committed 00000004:00080000:0.0:1716999794.358101:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 133 committed 00000001:00080000:0.0:1716999794.358111:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986642 is committed 00000004:00080000:0.0:1716999794.358284:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 135 committed 00000004:00080000:0.0:1716999794.358377:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 139 committed 00000004:00080000:0.0:1716999794.358437:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 140 committed 00000100:00100000:1.0:1716999794.359204:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018112:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.359255:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.359274:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018368:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.359288:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.359297:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.359310:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.359318:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018880:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.359328:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.359340:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1716999794.359344:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.359356:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.359364:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483018240:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.359365:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.359377:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.359388:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018688:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.359390:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.359402:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.359404:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483018496:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.359410:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.359417:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.359425:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012ea9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483018304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.359429:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483018752:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.359438:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.359449:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018112 00000100:00100000:1.0:1716999794.359450:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483018560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.359455:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018112 00000100:00100000:1.0:1716999794.359461:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.359470:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483018816:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.359481:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.360075:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483019072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.360098:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.360374:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018368 00000100:00100000:3.0:1716999794.360379:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018368 00000100:00100000:3.0:1716999794.360400:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018624 00000100:00100000:3.0:1716999794.360402:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018624 00000100:00100000:3.0:1716999794.360414:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018880 00000100:00100000:3.0:1716999794.360416:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018880 00000100:00100000:3.0:1716999794.360424:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018176 00000100:00100000:3.0:1716999794.360426:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018176 00000100:00100000:3.0:1716999794.360433:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018432 00000100:00100000:3.0:1716999794.360435:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018432 00000100:00100000:3.0:1716999794.360443:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018240 00000100:00100000:3.0:1716999794.360445:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018240 00000100:00100000:3.0:1716999794.360453:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018688 00000100:00100000:3.0:1716999794.360455:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018688 00000100:00100000:3.0:1716999794.360462:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018496 00000100:00100000:3.0:1716999794.360463:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018496 00000100:00100000:3.0:1716999794.360470:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018304 00000100:00100000:3.0:1716999794.360472:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018304 00000100:00100000:3.0:1716999794.360477:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018560 00000100:00100000:3.0:1716999794.360478:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018560 00000100:00100000:3.0:1716999794.360483:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018816 00000100:00100000:3.0:1716999794.360485:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018816 00000100:00100000:3.0:1716999794.360493:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10070 00000100:00100000:3.0:1716999794.360499:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+12:3219:x1800404483018112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.360521:0:19200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1544 count 1 00000100:00100000:2.0:1716999794.360539:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10071 00010000:00010000:3.0:1716999794.360540:0:19200:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.360545:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+12:3219:x1800404483018368:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.360558:0:19196:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:845 count 1 00010000:00010000:3.0:1716999794.360564:0:19200:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bae expref: 78 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.360568:0:19196:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.360571:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.360573:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.360575:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.360579:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012facc240/0x6d188eabd8d70154 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b394 expref: 78 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.360585:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.360586:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.360588:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.360599:0:19200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bae expref: 78 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.360604:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012facc240/0x6d188eabd8d70154 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b394 expref: 78 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.360608:0:19200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bae expref: 78 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.360612:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012facc240/0x6d188eabd8d70154 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b394 expref: 78 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.360618:0:19200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483019136:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.360620:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131caa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:19196:1800404483019200:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.360654:0:19205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483019072 00000100:00100000:0.0:1716999794.360749:0:19205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483019072 00000100:00100000:0.0:1716999794.360765:0:19205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10072 00000100:00100000:3.0:1716999794.360813:0:19200:0:(client.c:2542:ptlrpc_set_wait()) set ffff8801362196c0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.360814:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1716999794.360866:0:19205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+9:3219:x1800404483018624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1716999794.360894:0:19205:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1544 count 1 00010000:00010000:0.0:1716999794.360907:0:19205:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.360918:0:19205:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c33 expref: 75 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.361154:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10073 00000100:00100000:3.0:1716999794.361164:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10074 00000100:00100000:1.0:1716999794.361164:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+9:3219:x1800404483018880:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.361170:0:2535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10075 00002000:00080000:1.0:1716999794.361175:0:17864:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:868 count 1 00000100:00100000:3.0:1716999794.361176:0:8342:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3219:x1800404483018176:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.361176:0:2535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+12:3219:x1800404483018432:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1716999794.361185:0:17864:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.361194:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f8cd80/0x6d188eabd8d71471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb51 expref: 75 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.361200:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.361201:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.361204:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.361211:0:19209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10076 00002000:00080000:2.0:1716999794.361212:0:2535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:844 count 1 00000100:00100000:3.0:1716999794.361215:0:19209:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+12:3217:x1800404483018240:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1716999794.361219:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f8cd80/0x6d188eabd8d71471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb51 expref: 75 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.361220:0:2535:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.361225:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f8cd80/0x6d188eabd8d71471 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb51 expref: 75 pid: 8340 timeout: 413 lvb_type: 0 00002000:00080000:3.0:1716999794.361226:0:19209:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1545 count 1 00010000:00010000:2.0:1716999794.361230:0:2535:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fa1c0/0x6d188eabd8d700ba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b34e expref: 78 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.361233:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483019264:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.361234:0:19209:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.361236:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.361238:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.361240:0:2535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361249:0:19209:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d05 expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.361253:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099a713c0 going to sleep for 11 seconds 00010000:00010000:2.0:1716999794.361255:0:2535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fa1c0/0x6d188eabd8d700ba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b34e expref: 78 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361259:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.361260:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.361262:0:19209:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.361262:0:2535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920fa1c0/0x6d188eabd8d700ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b34e expref: 78 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.361266:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10077 00000100:00100000:1.0:1716999794.361270:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3219:x1800404483018688:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999794.361277:0:19209:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d05 expref: 78 pid: 17864 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1716999794.361280:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1545 count 1 00000100:00100000:2.0:1716999794.361281:0:2535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:2535:1800404483019328:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.361284:0:19209:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d05 expref: 78 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.361288:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.361292:0:19209:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:19209:1800404483019392:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.361299:0:2535:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6e40 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.361300:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d13 expref: 75 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.361305:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.361306:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.361308:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.361310:0:19209:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219840 going to sleep for 11 seconds 00000100:00080000:3.0:1716999794.361320:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1716999764 00010000:00010000:1.0:1716999794.361322:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d13 expref: 75 pid: 17864 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1716999794.361323:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1716999764 00010000:00010000:1.0:1716999794.361329:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d13 expref: 75 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.361333:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10078 00000100:00100000:1.0:1716999794.361336:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483019456:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.361337:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+12:3217:x1800404483018496:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.361348:0:19195:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:870 count 1 00000100:00100000:1.0:1716999794.361353:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099a71a80 going to sleep for 11 seconds 00010000:00010000:3.0:1716999794.361356:0:19195:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361366:0:19195:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f27600/0x6d188eabd8d7170a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc54 expref: 78 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.361366:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10079 00000100:00100000:1.0:1716999794.361369:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3218:x1800404483018304:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999794.361371:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.361373:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.361375:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1716999794.361379:0:8341:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1546 count 1 00010000:00010000:1.0:1716999794.361386:0:8341:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361388:0:19195:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f27600/0x6d188eabd8d7170a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc54 expref: 78 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361395:0:19195:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f27600/0x6d188eabd8d7170a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc54 expref: 78 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.361403:0:19195:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19195:1800404483019520:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.361407:0:19205:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.361409:0:19205:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.361411:0:19205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.361426:0:19195:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219f00 going to sleep for 11 seconds 00002000:00080000:2.0:1716999794.361428:0:8342:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1542 count 1 00010000:00010000:0.0:1716999794.361432:0:19205:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c33 expref: 75 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.361438:0:19197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10080 00010000:00010000:2.0:1716999794.361438:0:8342:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.361440:0:19205:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c33 expref: 75 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.361442:0:19197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+12:3218:x1800404483018560:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.361447:0:8342:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a18 expref: 78 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.361447:0:19205:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:19205:1800404483019584:192.168.203.3@tcp:104: 00002000:00080000:3.0:1716999794.361452:0:19197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:872 count 1 00010000:00010000:2.0:1716999794.361453:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.361454:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.361456:0:8342:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361464:0:19197:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.361467:0:19205:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc9000 going to sleep for 11 seconds 00010000:00010000:2.0:1716999794.361470:0:8342:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a18 expref: 78 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361473:0:19197:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8480/0x6d188eabd8d71868 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcee expref: 78 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361478:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.361479:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.361481:0:19197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.361481:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10081 00010000:00010000:2.0:1716999794.361483:0:8342:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a18 expref: 78 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.361486:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3218:x1800404483018816:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.361491:0:8342:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483019648:192.168.203.3@tcp:104: 00002000:00080000:0.0:1716999794.361495:0:11262:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1522 count 1 00010000:00010000:3.0:1716999794.361496:0:19197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8480/0x6d188eabd8d71868 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcee expref: 78 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.361503:0:11262:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361506:0:19197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8480/0x6d188eabd8d71868 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcee expref: 78 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.361508:0:8342:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b69c0 going to sleep for 11 seconds 00010000:00010000:0.0:1716999794.361511:0:11262:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c95200/0x6d188eabd8dc2f80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d61 expref: 75 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.361513:0:19197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:19197:1800404483019712:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.361516:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.361518:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.361520:0:11262:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.361528:0:19197:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219600 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.361539:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10082 00000100:00100000:3.0:1716999794.361542:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3218:x1800404483019072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.361551:0:17700:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:870 count 1 00010000:00010000:3.0:1716999794.361559:0:17700:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361566:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099f24480/0x6d188eabd8d715a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbdd expref: 75 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361570:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.361571:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.361573:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361583:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099f24480/0x6d188eabd8d715a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbdd expref: 75 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361589:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099f24480/0x6d188eabd8d715a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbdd expref: 75 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.361595:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17700:1800404483019776:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.361608:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219180 going to sleep for 11 seconds 00010000:00010000:0.0:1716999794.361664:0:11262:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c95200/0x6d188eabd8dc2f80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d61 expref: 75 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.361666:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1716999794.361672:0:11262:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c95200/0x6d188eabd8dc2f80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d61 expref: 75 pid: 8341 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.361679:0:11262:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11262:1800404483019840:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.361702:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.361705:0:11262:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.361713:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483019008:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.361731:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.361747:0:17474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018944 00000100:00100000:3.0:1716999794.361751:0:17474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018944 00000100:00100000:3.0:1716999794.361761:0:17474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483018752 00000100:00100000:3.0:1716999794.361762:0:17474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483018752 00000100:00100000:2.0:1716999794.361764:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483019008 00000100:00100000:2.0:1716999794.361768:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483019008 00000100:00100000:3.0:1716999794.361769:0:17474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10083 00000100:00100000:3.0:1716999794.361782:0:17474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3219:x1800404483018944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.361790:0:17474:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1528 count 1 00000100:00100000:2.0:1716999794.361794:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10084 00010000:00010000:3.0:1716999794.361798:0:17474:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.361799:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3217:x1800404483018752:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999794.361807:0:17474:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65094 expref: 75 pid: 19195 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1716999794.361809:0:15837:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:846 count 1 00010000:00010000:3.0:1716999794.361812:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.361813:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.361815:0:17474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.361817:0:15837:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.361826:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012facdd40/0x6d188eabd8d701e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b3cc expref: 75 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361828:0:17474:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65094 expref: 75 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.361831:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.361832:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.361834:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361835:0:17474:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65094 expref: 75 pid: 19195 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.361846:0:17474:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:17474:1800404483019904:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.361848:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012facdd40/0x6d188eabd8d701e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b3cc expref: 75 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.361855:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012facdd40/0x6d188eabd8d701e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b3cc expref: 75 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.361862:0:17474:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219d80 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.361868:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483019968:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.361873:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10085 00000100:00100000:3.0:1716999794.361877:0:8340:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3217:x1800404483019008:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.361901:0:8340:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:869 count 1 00000100:00100000:2.0:1716999794.361901:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6840 going to sleep for 11 seconds 00010000:00010000:3.0:1716999794.361908:0:8340:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361918:0:8340:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e6b3c0/0x6d188eabd8d7150b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb97 expref: 75 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361922:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.361923:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.361925:0:8340:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361937:0:8340:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132e6b3c0/0x6d188eabd8d7150b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb97 expref: 75 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.361944:0:8340:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132e6b3c0/0x6d188eabd8d7150b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb97 expref: 75 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.361951:0:8340:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8340:1800404483020032:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.361967:0:8340:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219480 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.362022:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d7c expref: 78 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.362027:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.362029:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.362030:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.362046:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d7c expref: 78 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.362053:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d7c expref: 78 pid: 19200 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.362061:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8341:1800404483020096:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.362079:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099a71d80 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.363458:0:19200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008fc1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483019136:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.363484:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.363497:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.363510:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.363523:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.363534:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.363546:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.363569:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.363587:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847808 00000100:00100000:0.0:1716999794.363591:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847808 00010000:00010000:3.0:1716999794.363632:0:19200:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.363652:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847936 00000100:00100000:3.0:1716999794.363655:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847936 00010000:00010000:0.0:1716999794.363666:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012facc240/0x6d188eabd8d70154 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b394 expref: 79 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.363667:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f8cd80/0x6d188eabd8d71471 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb51 expref: 76 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.363680:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848064 00000100:00100000:0.0:1716999794.363681:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848192 00000100:00100000:3.0:1716999794.363682:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848064 00000100:00100000:0.0:1716999794.363683:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848192 00010000:00010000:3.0:1716999794.363689:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d05 expref: 81 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.363691:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f27600/0x6d188eabd8d7170a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc54 expref: 81 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.363696:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480847872 00000100:00100000:3.0:1716999794.363698:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480847872 00010000:00010000:3.0:1716999794.363704:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bae expref: 82 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.363704:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848000 00000100:00100000:0.0:1716999794.363705:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848000 00000100:00100000:3.0:1716999794.363712:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848128 00010000:00010000:0.0:1716999794.363713:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fa1c0/0x6d188eabd8d700ba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b34e expref: 83 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.363714:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848128 00010000:00010000:3.0:1716999794.363720:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d13 expref: 77 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.363725:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4586 00000100:00100000:2.0:1716999794.363731:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+83:1956:x1800404480847808:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.363740:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.363745:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012facc240/0x6d188eabd8d70154 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b394 expref: 83 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.363754:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012facc240/0x6d188eabd8d70154 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b394 expref: 83 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.363776:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.363778:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.363782:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.363788:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.363799:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999794.363823:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+83:1956:x1800404480847808:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 91us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.364355:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4587 00000100:00100000:0.0:1716999794.364388:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+77:1956:x1800404480847936:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.364396:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.364400:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f8cd80/0x6d188eabd8d71471 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb51 expref: 77 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364409:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f8cd80/0x6d188eabd8d71471 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb51 expref: 77 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364420:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.364422:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.364425:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.364431:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.364441:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.364457:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+77:1956:x1800404480847936:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 71us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.364463:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4587 00000100:00100000:0.0:1716999794.364483:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4588 00000100:00100000:0.0:1716999794.364487:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+83:1956:x1800404480848064:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.364492:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.364496:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d05 expref: 83 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364503:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d05 expref: 83 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364512:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.364513:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.364516:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.364521:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.364529:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.364541:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+83:1956:x1800404480848064:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 54us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.364546:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4588 00000100:00100000:0.0:1716999794.364555:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4589 00000100:00100000:0.0:1716999794.364559:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+82:1956:x1800404480848192:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.364564:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.364568:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f27600/0x6d188eabd8d7170a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc54 expref: 82 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364580:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f27600/0x6d188eabd8d7170a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc54 expref: 82 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364588:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.364589:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.364592:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.364598:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.364605:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.364616:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+82:1956:x1800404480848192:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 57us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.364620:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4589 00000100:00100000:0.0:1716999794.364631:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4590 00000100:00100000:0.0:1716999794.364634:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+81:1956:x1800404480847872:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.364639:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.364642:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bae expref: 81 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364649:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bae expref: 81 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364656:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918eb3c0/0x6d188eabd8dc5e03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65bae expref: 81 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364668:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.364669:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.364671:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.364676:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.364687:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.364699:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+80:1956:x1800404480847872:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 63us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.364703:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4590 00000100:00100000:0.0:1716999794.364712:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4591 00000100:00100000:0.0:1716999794.364716:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+79:1956:x1800404480848000:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.364721:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.364724:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fa1c0/0x6d188eabd8d700ba lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b34e expref: 79 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364730:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fa1c0/0x6d188eabd8d700ba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b34e expref: 79 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364738:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.364739:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.364741:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.364750:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.364757:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.364768:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+79:1956:x1800404480848000:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 51us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.364783:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4586 00000100:00100000:0.0:1716999794.364787:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4591 00000100:00100000:0.0:1716999794.364796:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4592 00000100:00100000:0.0:1716999794.364799:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+76:1956:x1800404480848128:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.364804:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.364807:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d13 expref: 76 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364814:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d13 expref: 76 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.364823:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.364824:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.364826:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.364831:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.364838:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999794.364839:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918e8fc0/0x6d188eabd8dc6208 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x609:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d13 expref: 76 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.364850:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483019456:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.364850:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+75:1956:x1800404480848128:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 50us (1280us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.364855:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4592 00010000:00010000:1.0:1716999794.364862:0:17365:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.364869:0:17365:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.364875:0:17365:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.364897:0:17365:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.364907:0:17365:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.364913:0:17365:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.364919:0:17365:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.364922:0:17365:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.364928:0:17365:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.364937:0:17365:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.364942:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc8746 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.365058:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.365074:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.365112:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.365126:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848320 00000100:00100000:3.0:1716999794.365130:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848320 00000100:00100000:2.0:1716999794.365133:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848448 00000100:00100000:2.0:1716999794.365137:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848448 00010000:00010000:3.0:1716999794.365141:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65094 expref: 76 pid: 19195 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.365149:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132e6b3c0/0x6d188eabd8d7150b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb97 expref: 76 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.365155:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848256 00000100:00100000:3.0:1716999794.365156:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848256 00010000:00010000:3.0:1716999794.365163:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c95200/0x6d188eabd8dc2f80 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d61 expref: 77 pid: 8341 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.365166:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4593 00000100:00100000:2.0:1716999794.365172:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+77:1956:x1800404480848320:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1716999794.365174:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4594 00000100:00100000:3.0:1716999794.365178:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+77:1956:x1800404480848448:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.365178:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.365183:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.365183:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65094 expref: 77 pid: 19195 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.365187:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132e6b3c0/0x6d188eabd8d7150b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb97 expref: 77 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.365191:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65094 expref: 77 pid: 19195 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.365194:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132e6b3c0/0x6d188eabd8d7150b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb97 expref: 77 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.365201:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.365202:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.365203:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.365204:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.365205:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365206:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.365211:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365212:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365221:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.365221:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.365238:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+77:1956:x1800404480848448:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 59us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.365239:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+77:1956:x1800404480848320:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 66us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.365243:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4594 00000100:00100000:2.0:1716999794.365256:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4593 00000100:00100000:3.0:1716999794.365495:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4595 00000100:00100000:3.0:1716999794.365500:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+75:1956:x1800404480848256:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.365506:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.365510:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c95200/0x6d188eabd8dc2f80 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d61 expref: 75 pid: 8341 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.365517:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c95200/0x6d188eabd8dc2f80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d61 expref: 75 pid: 8341 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.365526:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.365527:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.365529:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365535:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365542:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.365555:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+75:1956:x1800404480848256:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 55us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.365559:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4595 00010000:00010000:3.0:1716999794.365595:0:19195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f27600/0x6d188eabd8d7170a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc54 expref: 77 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.365603:0:19195:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008fc1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19195:1800404483019520:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.365614:0:19195:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365624:0:19195:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365628:0:19195:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365634:0:19195:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365639:0:19195:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365645:0:19195:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365650:0:19195:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c506c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.365653:0:19195:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365659:0:19195:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365667:0:19195:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.365672:0:19195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c506c0/0x6d188eabd8dc874d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.365960:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+13:3217:x1800404483018496:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4622us (6541us total) trans 4294970200 rc 0/0 00000100:00100000:3.0:1716999794.365967:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10078 00010000:00010000:3.0:1716999794.365992:0:8340:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e6b3c0/0x6d188eabd8d7150b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb97 expref: 74 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.366012:0:8340:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8340:1800404483020032:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.366021:0:8340:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.366022:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483019968:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.366027:0:8340:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366032:0:8340:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366034:0:15837:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366039:0:8340:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366043:0:8340:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366049:0:8340:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366058:0:8340:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50d80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.366060:0:8340:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366065:0:8340:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366073:0:8340:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366078:0:8340:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c50d80/0x6d188eabd8dc8785 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366115:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fa1c0/0x6d188eabd8d700ba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b34e expref: 76 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.366123:0:2535:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:2535:1800404483019328:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.366133:0:2535:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366138:0:2535:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366144:0:2535:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366149:0:2535:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366155:0:2535:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366161:0:2535:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366166:0:2535:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832f40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.366168:0:2535:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366177:0:2535:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366186:0:2535:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366190:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091832f40/0x6d188eabd8dc8738 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.366206:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3219:x1800404483018688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4934us (6802us total) trans 4294970162 rc 0/0 00000100:00100000:1.0:1716999794.366212:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10077 00000100:00100000:3.0:1716999794.366226:0:8340:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3217:x1800404483019008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4347us (4493us total) trans 4294970163 rc 0/0 00000100:00100000:3.0:1716999794.366232:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10085 00000004:00080000:1.0:1716999794.366246:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9fe680/2, rc 0, transno 2866 00000100:00100000:1.0:1716999794.366254:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018688:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999794.366255:0:17474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c95680/0x6d188eabd8dc3aaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65094 expref: 73 pid: 19195 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.366263:0:17474:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:17474:1800404483019904:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.366273:0:17474:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366279:0:17474:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366289:0:17474:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366295:0:17474:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366299:0:17474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.366303:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483020160:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999794.366305:0:17474:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366309:0:17474:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c533c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.366312:0:17474:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366318:0:17474:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.366325:0:17474:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.366328:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1716999794.366331:0:17474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c533c0/0x6d188eabd8dc8777 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.366351:0:2535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+13:3219:x1800404483018432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5174us (6971us total) trans 4294970201 rc 0/0 00000004:00080000:1.0:1716999794.366355:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9fd880/2, rc 0, transno 2905 00000100:00100000:2.0:1716999794.366356:0:2535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10075 00000100:00100000:1.0:1716999794.366362:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.366365:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483020160 00000100:00100000:2.0:1716999794.366368:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483020160 00000100:00100000:2.0:1716999794.366381:0:2535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10086 00000100:00100000:2.0:1716999794.366384:0:2535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+13:3219:x1800404483020160:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.366388:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1716999794.366393:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a694aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483020224:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.366397:0:2535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:850 count 1 00010000:00010000:2.0:1716999794.366407:0:2535:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.366410:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1716999794.366416:0:2535:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091184fc0/0x6d188eabd8d7067f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b585 expref: 72 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366421:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.366423:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1716999794.366423:0:8340:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483020224 00010000:00010000:2.0:1716999794.366424:0:2535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.366426:0:8340:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483020224 00000100:00100000:1.0:1716999794.366439:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10087 00000100:00100000:1.0:1716999794.366442:0:8340:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3219:x1800404483020224:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.366443:0:2535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091184fc0/0x6d188eabd8d7067f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b585 expref: 72 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.366450:0:2535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091184fc0/0x6d188eabd8d7067f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b585 expref: 72 pid: 17860 timeout: 413 lvb_type: 0 00002000:00080000:1.0:1716999794.366452:0:8340:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:871 count 1 00000100:00100000:2.0:1716999794.366458:0:2535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483020288:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.366461:0:8340:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.366471:0:8340:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091185200/0x6d188eabd8d717c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bca1 expref: 75 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.366476:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.366477:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1716999794.366478:0:2535:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6e40 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.366480:0:8340:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.366493:0:8340:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091185200/0x6d188eabd8d717c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bca1 expref: 75 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.366500:0:8340:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091185200/0x6d188eabd8d717c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bca1 expref: 75 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.366513:0:8340:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6949180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8340:1800404483020352:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.367144:0:17474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3219:x1800404483018944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5359us (5475us total) trans 4294970164 rc 0/0 00000100:00100000:3.0:1716999794.367150:0:17474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10083 00010000:00010000:3.0:1716999794.367178:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918eaf40/0x6d188eabd8dc61ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x609:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d05 expref: 75 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.367188:0:19209:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008fc1df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:19209:1800404483019392:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.367200:0:19209:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.367211:0:19209:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.367216:0:19209:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.367222:0:19209:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.367228:0:19209:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.367233:0:19209:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.367238:0:19209:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c518c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.367240:0:19209:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.367249:0:19209:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.367258:0:19209:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.367264:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c518c0/0x6d188eabd8dc873f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x609:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.367341:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012facc240/0x6d188eabd8d70154 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b394 expref: 74 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.367350:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131caa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:19196:1800404483019200:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.367360:0:19196:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.367365:0:19196:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.367370:0:19196:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.367376:0:19196:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.367381:0:19196:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.367385:0:8340:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099a71a80 going to sleep for 11 seconds 00010000:00010000:2.0:1716999794.367386:0:19196:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.367391:0:19196:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831b00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.367393:0:19196:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.367398:0:19196:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.367406:0:19196:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.367407:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f8cd80/0x6d188eabd8d71471 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb51 expref: 72 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.367411:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8723 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.367416:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0000_UUID:17864:1800404483019264:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.367426:0:17864:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.367433:0:17864:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.367433:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999794.367437:0:17864:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.367443:0:17864:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.367449:0:17864:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.367454:0:17864:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.367458:0:17864:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695e640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.367461:0:17864:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.367466:0:17864:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.367475:0:17864:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.367480:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc8731 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.367492:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.367548:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.367560:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.367571:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.367590:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000004:00080000:0.0:1716999794.367608:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9ffb80/2, rc 0, transno 2868 00000100:00100000:0.0:1716999794.367613:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018944:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.367624:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848384 00000100:00100000:0.0:1716999794.367627:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848384 00010000:00010000:0.0:1716999794.367638:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012facdd40/0x6d188eabd8d701e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b3cc expref: 72 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.367647:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848512 00000100:00100000:0.0:1716999794.367649:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848512 00010000:00010000:0.0:1716999794.367655:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d7c expref: 74 pid: 19200 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.367662:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848640 00000100:00100000:0.0:1716999794.367663:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848640 00010000:00010000:0.0:1716999794.367668:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a18 expref: 75 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.367674:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848768 00000100:00100000:0.0:1716999794.367675:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848768 00010000:00010000:0.0:1716999794.367680:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099f24480/0x6d188eabd8d715a5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbdd expref: 73 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.367691:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848576 00000100:00100000:0.0:1716999794.367692:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848576 00010000:00010000:0.0:1716999794.367698:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c33 expref: 74 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.367703:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848704 00000100:00100000:0.0:1716999794.367705:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848704 00010000:00010000:0.0:1716999794.367710:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8480/0x6d188eabd8d71868 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcee expref: 76 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.367717:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4596 00000100:00100000:0.0:1716999794.367721:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+74:1956:x1800404480848384:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.367727:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.367730:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012facdd40/0x6d188eabd8d701e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b3cc expref: 74 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.367737:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012facdd40/0x6d188eabd8d701e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b3cc expref: 74 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.367747:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012facdd40/0x6d188eabd8d701e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b3cc expref: 74 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.367753:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.367754:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.367757:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.367767:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.367791:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.367806:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+73:1956:x1800404480848384:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 84us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.367811:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4596 00000100:00100000:0.0:1716999794.367820:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4597 00000100:00100000:0.0:1716999794.367823:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+76:1956:x1800404480848512:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.367828:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.367831:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d7c expref: 76 pid: 19200 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.367837:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d7c expref: 76 pid: 19200 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.367846:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.367847:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.367849:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.367854:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.367860:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999794.367865:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+14:3219:x1800404483018880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6700us (8534us total) trans 4294970165 rc 0/0 00000100:00100000:0.0:1716999794.367869:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+76:1956:x1800404480848512:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 45us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999794.367871:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10073 00000100:00100000:0.0:1716999794.367874:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4597 00000100:00100000:0.0:1716999794.367894:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4598 00000100:00100000:0.0:1716999794.367897:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+75:1957:x1800404480848640:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.367902:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.367905:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a18 expref: 75 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.367912:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a18 expref: 75 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.367919:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.367920:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.367922:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.367927:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.367933:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.367971:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4599 00000100:00100000:3.0:1716999794.367975:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+72:1958:x1800404480848768:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.367980:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.367984:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099f24480/0x6d188eabd8d715a5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbdd expref: 72 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.367990:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099f24480/0x6d188eabd8d715a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbdd expref: 72 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.367998:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.367998:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.368000:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.368006:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.368017:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999794.368298:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4600 00000100:00100000:1.0:1716999794.368304:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+72:1957:x1800404480848576:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.368312:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.368316:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c33 expref: 72 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.368323:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c33 expref: 72 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.368333:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.368334:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.368336:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.368346:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.368354:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.368434:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+75:1957:x1800404480848640:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 534us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.368439:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4598 00000100:00100000:0.0:1716999794.368450:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4601 00000100:00100000:0.0:1716999794.368453:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+74:1957:x1800404480848704:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.368459:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.368462:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8480/0x6d188eabd8d71868 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcee expref: 74 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.368469:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8480/0x6d188eabd8d71868 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcee expref: 74 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.368478:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.368479:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.368482:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.368488:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.368496:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.368527:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+72:1958:x1800404480848768:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 551us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.368533:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4599 00000100:00100000:1.0:1716999794.368536:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+72:1957:x1800404480848576:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 230us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.368540:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+14:3219:x1800404483018368:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7994us (9250us total) trans 4294970202 rc 0/0 00000100:00100000:1.0:1716999794.368542:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4600 00000100:00100000:2.0:1716999794.368546:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10071 00010000:00010000:3.0:1716999794.368557:0:17700:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099f24480/0x6d188eabd8d715a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x366:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbdd expref: 70 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.368562:0:15837:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.368565:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17700:1800404483019776:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.368568:0:15837:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.368574:0:15837:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.368575:0:17700:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.368579:0:15837:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.368581:0:17700:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.368584:0:15837:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.368586:0:17700:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.368589:0:15837:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.368592:0:17700:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.368592:0:15837:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999794.368593:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ea9f800/2, rc 0, transno 2906 00010000:00010000:3.0:1716999794.368597:0:17700:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.368597:0:15837:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.368600:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012ea9f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018368:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999794.368603:0:17700:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.368604:0:15837:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999794.368608:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9ff800/2, rc 0, transno 2869 00010000:00010000:2.0:1716999794.368609:0:15837:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc877e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.368611:0:17700:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50fc0 already unused, calling callback (ffffffffa0864a40) 00000100:00100000:1.0:1716999794.368612:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018880:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999794.368614:0:17700:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.368620:0:17700:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.368628:0:17700:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.368633:0:17700:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c50fc0/0x6d188eabd8dc8770 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.368645:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483020544:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999794.369240:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+74:1957:x1800404480848704:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 784us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.369247:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4601 00000100:00100000:2.0:1716999794.369249:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3217:x1800404483018752:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7448us (7545us total) trans 4294970166 rc 0/0 00000100:00100000:2.0:1716999794.369255:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10084 00010000:00010000:0.0:1716999794.369290:0:19205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc5f84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x608:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65c33 expref: 69 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.369298:0:19205:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:19205:1800404483019584:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.369311:0:19205:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.369318:0:19205:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.369323:0:19205:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.369329:0:19205:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.369334:0:19205:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.369339:0:19205:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.369343:0:19205:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e68d80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.369345:0:19205:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.369350:0:19205:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.369354:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c53a80/0x6d188eabd8dc59a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a18 expref: 73 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.369358:0:19205:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.369362:0:19205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc872a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.369363:0:8342:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483019648:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.369375:0:8342:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.369376:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3218:x1800404483019072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7832us (9277us total) trans 4294970167 rc 0/0 00010000:00010000:2.0:1716999794.369381:0:8342:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.369382:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10082 00010000:00010000:2.0:1716999794.369386:0:8342:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.369392:0:8342:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.369398:0:8342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.369403:0:8342:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.369406:0:19197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8480/0x6d188eabd8d71868 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcee expref: 72 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.369408:0:8342:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.369410:0:8342:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.369414:0:19197:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:19197:1800404483019712:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.369415:0:8342:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.369423:0:19197:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.369424:0:8342:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.369429:0:19197:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.369433:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091833840/0x6d188eabd8dc875b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.369438:0:19197:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.369443:0:19197:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.369449:0:19197:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.369454:0:19197:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.369459:0:19197:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.369461:0:19197:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.369466:0:19197:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.369474:0:19197:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.369479:0:19197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c52640/0x6d188eabd8dc8762 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.369532:0:19205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+14:3219:x1800404483018624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8667us (10219us total) trans 4294970168 rc 0/0 00000100:00100000:0.0:1716999794.369537:0:19205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10072 00000100:00100000:1.0:1716999794.369937:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.369945:0:8342:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3219:x1800404483018176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8771us (10587us total) trans 4294970203 rc 0/0 00000100:00100000:3.0:1716999794.369946:0:19197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+15:3218:x1800404483018560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8502us (10483us total) trans 4294970204 rc 0/0 00000100:00100000:2.0:1716999794.369951:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10074 00000100:00100000:3.0:1716999794.369954:0:19197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10080 00000004:00080000:1.0:1716999794.369960:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ea9c380/2, rc 0, transno 2907 00000100:00100000:2.0:1716999794.369963:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483020544 00000100:00100000:2.0:1716999794.369968:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483020544 00000100:00100000:1.0:1716999794.369968:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012ea9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018176:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999794.369979:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9ff480/2, rc 0, transno 2872 00010000:00010000:3.0:1716999794.369983:0:11262:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c95200/0x6d188eabd8dc2f80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d61 expref: 68 pid: 8341 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.369984:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.369985:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10088 00000100:00100000:2.0:1716999794.369989:0:8342:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3219:x1800404483020544:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.369991:0:11262:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11262:1800404483019840:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.370001:0:11262:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1716999794.370004:0:8342:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:852 count 1 00010000:00010000:3.0:1716999794.370007:0:11262:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370011:0:11262:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370015:0:8342:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370016:0:11262:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370021:0:11262:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370025:0:8342:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fef3840/0x6d188eabd8d7092d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b68f expref: 71 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370026:0:11262:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370030:0:11262:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.370031:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1716999794.370031:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a694a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483020608:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999794.370032:0:11262:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370032:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.370035:0:8342:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370040:0:11262:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370047:0:11262:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.370049:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1716999794.370051:0:11262:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e69440/0x6d188eabd8dc8769 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370051:0:8342:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fef3840/0x6d188eabd8d7092d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b68f expref: 71 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370060:0:8342:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fef3840/0x6d188eabd8d7092d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b68f expref: 71 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.370068:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483020608 00000100:00100000:1.0:1716999794.370071:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483020608 00000100:00100000:2.0:1716999794.370074:0:8342:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483020736:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.370086:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10089 00000100:00100000:1.0:1716999794.370090:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+14:3220:x1800404483020608:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.370097:0:8342:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b69c0 going to sleep for 11 seconds 00002000:00080000:1.0:1716999794.370103:0:19195:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1542 count 1 00010000:00010000:1.0:1716999794.370113:0:19195:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370124:0:19195:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a6c expref: 67 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370130:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.370132:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.370134:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370148:0:19195:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a6c expref: 67 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370155:0:19195:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a6c expref: 67 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.370163:0:19195:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a694b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19195:1800404483020800:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.370169:0:2535:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483020288:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.370180:0:2535:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.370184:0:19195:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099a713c0 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.370201:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008efb6640/0x6d188eabd8dc6358 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65d7c expref: 71 pid: 19200 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.370208:0:8341:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8341:1800404483020096:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.370218:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3218:x1800404483018816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8731us (10735us total) trans 4294970169 rc 0/0 00010000:00010000:1.0:1716999794.370218:0:8341:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.370223:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10081 00010000:00010000:1.0:1716999794.370229:0:8341:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370234:0:8341:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370240:0:8341:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370245:0:8341:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370251:0:8341:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370255:0:8341:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.370258:0:8341:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370263:0:8341:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370270:0:8341:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370275:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc8754 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.370319:0:19209:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+15:3217:x1800404483018240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9102us (10928us total) trans 4294970205 rc 0/0 00000100:00100000:3.0:1716999794.370321:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483020416:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.370324:0:19209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10076 00000100:00100000:3.0:1716999794.370339:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.370350:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a694ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483020672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.370361:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.370362:0:19209:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483020416 00000100:00100000:2.0:1716999794.370364:0:19209:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483020416 00000100:00100000:2.0:1716999794.370378:0:19209:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483020672 00000100:00100000:2.0:1716999794.370380:0:19209:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483020672 00000004:00080000:3.0:1716999794.370383:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ea9e300/2, rc 0, transno 2909 00000100:00100000:3.0:1716999794.370390:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012ea9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483018240:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.370390:0:19209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10090 00000100:00100000:2.0:1716999794.370393:0:19209:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+15:3217:x1800404483020416:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.370395:0:19205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10091 00000004:00080000:3.0:1716999794.370398:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9fdf80/2, rc 0, transno 2904 00000100:00100000:0.0:1716999794.370400:0:19205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+16:3217:x1800404483020672:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.370401:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483018496:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.370403:0:19209:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:851 count 1 00000004:00080000:3.0:1716999794.370407:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9ff100/2, rc 0, transno 2870 00010000:00010000:2.0:1716999794.370411:0:19209:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.370412:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483018752:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1716999794.370419:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9fce00/2, rc 0, transno 2867 00010000:00010000:2.0:1716999794.370419:0:19209:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f8c6c0/0x6d188eabd8d70712 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5cb expref: 67 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.370421:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483019008:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1716999794.370423:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00002000:00080000:0.0:1716999794.370423:0:19205:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:855 count 1 00010000:00010000:2.0:1716999794.370424:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.370426:0:19209:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.370428:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1716999794.370432:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a694b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483020480:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1716999794.370432:0:19205:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370441:0:19209:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f8c6c0/0x6d188eabd8d70712 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5cb expref: 67 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.370441:0:19205:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9d40/0x6d188eabd8d70b10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b768 expref: 70 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.370443:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3218:x1800404483018304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9073us (11004us total) trans 4294970206 rc 0/0 00000100:00100000:3.0:1716999794.370447:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1716999794.370447:0:19205:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.370448:0:19209:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f8c6c0/0x6d188eabd8d70712 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5cb expref: 67 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.370448:0:19205:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1716999794.370449:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10079 00010000:00010000:0.0:1716999794.370450:0:19205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 4/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.370455:0:19209:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483020864:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.370458:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483020480 00000100:00100000:1.0:1716999794.370460:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483020480 00010000:00010000:0.0:1716999794.370463:0:19205:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9d40/0x6d188eabd8d70b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b768 expref: 70 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.370470:0:19205:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9d40/0x6d188eabd8d70b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b768 expref: 70 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.370473:0:19209:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.370473:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10092 00000100:00100000:1.0:1716999794.370476:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3217:x1800404483020480:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.370478:0:19205:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:19205:1800404483020928:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.370484:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00002000:00080000:1.0:1716999794.370484:0:8341:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:894 count 1 00000100:00100000:3.0:1716999794.370489:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483020992:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1716999794.370491:0:8341:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.370494:0:19205:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc9000 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.370499:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800997c3180/0x6d188eabd8d7275d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c35b expref: 67 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370504:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1716999794.370505:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1716999794.370505:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.370507:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.370515:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483020992 00000100:00100000:2.0:1716999794.370518:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483020992 00010000:00010000:1.0:1716999794.370519:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800997c3180/0x6d188eabd8d7275d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c35b expref: 67 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370525:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800997c3180/0x6d188eabd8d7275d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c35b expref: 67 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.370531:0:19200:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.370533:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10093 00000100:00100000:1.0:1716999794.370533:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6948700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483021120:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.370536:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3217:x1800404483020992:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999794.370537:0:19200:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370543:0:19200:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1716999794.370545:0:11262:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:851 count 1 00010000:00010000:3.0:1716999794.370547:0:19200:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.370550:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099a71d80 going to sleep for 11 seconds 00010000:00010000:3.0:1716999794.370551:0:19200:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370552:0:11262:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370555:0:19200:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50b40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.370557:0:19200:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370560:0:11262:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f8f180/0x6d188eabd8d70869 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b63b expref: 70 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370562:0:19200:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370564:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.370565:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.370567:0:11262:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370573:0:19200:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.370577:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a694b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483021184:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999794.370578:0:19200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c50b40/0x6d188eabd8dc871c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x608:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370578:0:11262:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131f8f180/0x6d188eabd8d70869 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b63b expref: 70 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370589:0:11262:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131f8f180/0x6d188eabd8d70869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b63b expref: 70 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.370593:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.370596:0:11262:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131caa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11262:1800404483021312:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.370603:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1716999794.370607:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483021056:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.370611:0:11262:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.370647:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.370662:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483021184 00000100:00100000:2.0:1716999794.370665:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483021184 00000100:00100000:1.0:1716999794.370667:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483021056 00000100:00100000:1.0:1716999794.370670:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483021056 00000100:00100000:2.0:1716999794.370679:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10094 00000100:00100000:2.0:1716999794.370682:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3220:x1800404483021184:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.370686:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+18:3219:x1800404483018112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10186us (11430us total) trans 4294970207 rc 0/0 00002000:00080000:2.0:1716999794.370691:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:893 count 1 00000100:00100000:3.0:1716999794.370692:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10070 00000100:00100000:1.0:1716999794.370695:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10095 00010000:00010000:2.0:1716999794.370698:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.370699:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3220:x1800404483021056:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.370706:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800997c33c0/0x6d188eabd8d725c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c2cf expref: 67 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.370707:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483021248:0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.370708:0:15837:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:853 count 1 00010000:00010000:2.0:1716999794.370710:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.370711:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.370713:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370715:0:15837:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370723:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fef1440/0x6d188eabd8d709c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6d5 expref: 70 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370725:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800997c33c0/0x6d188eabd8d725c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c2cf expref: 67 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370727:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.370728:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.370730:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.370731:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800997c33c0/0x6d188eabd8d725c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c2cf expref: 67 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.370741:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483021376:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.370743:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fef1440/0x6d188eabd8d709c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6d5 expref: 70 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.370750:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fef1440/0x6d188eabd8d709c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6d5 expref: 70 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.370759:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6840 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.370761:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a694bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15837:1800404483021440:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.370789:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96000 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.370807:0:8340:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a6949180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8340:1800404483020352:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.370816:0:8340:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999794.370833:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ea9ed80/2, rc 0, transno 2910 00000100:00100000:1.0:1716999794.370839:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012ea9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483018304:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999794.370845:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9fc380/2, rc 0, transno 2908 00000100:00100000:3.0:1716999794.370847:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.370847:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483018560:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999794.370852:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9fed80/2, rc 0, transno 2873 00000100:00100000:1.0:1716999794.370856:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483018816:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1716999794.370861:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9fd500/2, rc 0, transno 2871 00000100:00100000:1.0:1716999794.370863:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483019072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.370864:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483021248 00000100:00100000:3.0:1716999794.370867:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483021248 00000100:00100000:3.0:1716999794.370897:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10096 00000100:00100000:3.0:1716999794.370902:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b87d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3217:x1800404483021248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.370912:0:17700:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1543 count 1 00010000:00010000:3.0:1716999794.370920:0:17700:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.370927:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483021632:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999794.370929:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b22 expref: 67 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370934:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.370935:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.370937:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.370944:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.370955:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1716999794.370956:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b22 expref: 67 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.370964:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b22 expref: 67 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.370964:0:19197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483021632 00000100:00100000:1.0:1716999794.370964:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483021568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.370967:0:19197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483021632 00000100:00100000:3.0:1716999794.370973:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17700:1800404483021760:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.370977:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.370982:0:19197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483021568 00000100:00100000:2.0:1716999794.370984:0:19197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483021568 00000100:00100000:3.0:1716999794.370992:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219600 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.370996:0:19197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10097 00000100:00100000:2.0:1716999794.371000:0:19197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+18:3220:x1800404483021632:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.371007:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483021696:0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.371009:0:19197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:854 count 1 00010000:00010000:2.0:1716999794.371016:0:19197:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.371024:0:19197:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fef3180/0x6d188eabd8d70a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b71b expref: 70 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.371029:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.371030:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.371032:0:19197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.371044:0:19197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fef3180/0x6d188eabd8d70a6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b71b expref: 70 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.371051:0:19197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fef3180/0x6d188eabd8d70a6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b71b expref: 70 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.371058:0:19197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:19197:1800404483021824:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.371109:0:21818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10098 00000100:00100000:0.0:1716999794.371114:0:21818:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+19:3220:x1800404483021568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1716999794.371125:0:21818:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:891 count 1 00010000:00010000:0.0:1716999794.371133:0:21818:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.371142:0:21818:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8900fc0/0x6d188eabd8d7245b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c235 expref: 67 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.371148:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.371149:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.371151:0:21818:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.371163:0:21818:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8900fc0/0x6d188eabd8d7245b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c235 expref: 67 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.371176:0:21818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8900fc0/0x6d188eabd8d7245b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c235 expref: 67 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.371184:0:21818:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:21818:1800404483021888:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.371321:0:19197:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.371323:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.371335:0:17697:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483021696 00000100:00100000:3.0:1716999794.371339:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1716999794.371339:0:17697:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483021696 00000100:00100000:3.0:1716999794.371343:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483021504:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.371353:0:17697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10099 00000100:00100000:1.0:1716999794.371358:0:17697:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3217:x1800404483021696:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.371359:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1716999794.371368:0:17697:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:892 count 1 00000100:00100000:2.0:1716999794.371372:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.371373:0:17473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483021504 00000100:00100000:3.0:1716999794.371376:0:17473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483021504 00010000:00010000:1.0:1716999794.371376:0:17697:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.371385:0:17697:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8901b00/0x6d188eabd8d72526 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c290 expref: 70 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.371387:0:17473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10100 00000100:00100000:3.0:1716999794.371390:0:17473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3217:x1800404483021504:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1716999794.371390:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.371391:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.371392:0:17697:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1716999794.371399:0:17473:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1548 count 1 00010000:00010000:1.0:1716999794.371406:0:17697:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8901b00/0x6d188eabd8d72526 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c290 expref: 70 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.371407:0:17473:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.371407:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848832 00000100:00100000:2.0:1716999794.371410:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848832 00010000:00010000:1.0:1716999794.371413:0:17697:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8901b00/0x6d188eabd8d72526 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c290 expref: 70 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.371416:0:17473:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e78 expref: 68 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.371421:0:17473:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1716999794.371421:0:17697:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:17697:1800404483021952:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.371422:0:17473:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.371423:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091184fc0/0x6d188eabd8d7067f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b585 expref: 68 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.371424:0:17473:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 4/0,1 mode: --/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.371439:0:17473:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e78 expref: 68 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.371441:0:17697:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96300 going to sleep for 11 seconds 00010000:00010000:3.0:1716999794.371446:0:17473:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e78 expref: 68 pid: 19196 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.371453:0:17473:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:17473:1800404483022016:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.371473:0:17473:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219180 going to sleep for 11 seconds 00000100:00100000:0.0:1716999794.371493:0:21818:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc9780 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.371698:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4602 00000100:00100000:1.0:1716999794.371703:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+68:1959:x1800404480848832:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.371711:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.371715:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091184fc0/0x6d188eabd8d7067f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b585 expref: 68 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.371723:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091184fc0/0x6d188eabd8d7067f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b585 expref: 68 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.371734:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091184fc0/0x6d188eabd8d7067f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b585 expref: 68 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.371741:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.371742:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.371745:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.371752:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.371781:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.371855:0:2535:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.371863:0:2535:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.371869:0:2535:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.371875:0:2535:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.371893:0:2535:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.371897:0:2535:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.371900:0:2535:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.371905:0:2535:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.371918:0:2535:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.371923:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091831440/0x6d188eabd8dc878c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.371933:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aa3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+67:1959:x1800404480848832:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 228us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999794.371938:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4602 00000004:00080000:1.0:1716999794.371978:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012ea9c700/2, rc 0, transno 2911 00000100:00100000:1.0:1716999794.371984:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012ea9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483018112:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.372079:0:2535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+21:3219:x1800404483020160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5693us (5749us total) trans 4294970170 rc 0/0 00000100:00100000:2.0:1716999794.372084:0:2535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10086 00000004:00080000:2.0:1716999794.372104:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092df2680/2, rc 0, transno 2874 00000100:00100000:2.0:1716999794.372110:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483020160:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.372150:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483022144:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.372166:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.372488:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483022080:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.372514:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.372533:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483022144 00000100:00100000:1.0:1716999794.372536:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483022144 00000100:00100000:1.0:1716999794.372549:0:19196:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483022080 00000100:00100000:1.0:1716999794.372550:0:19196:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483022080 00000100:00100000:1.0:1716999794.372559:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10101 00000100:00100000:1.0:1716999794.372563:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+21:3219:x1800404483022144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.372574:0:19196:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:892 count 1 00010000:00010000:1.0:1716999794.372583:0:19196:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.372592:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8903180/0x6d188eabd8d72518 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c282 expref: 66 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.372597:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.372599:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.372600:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.372614:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8903180/0x6d188eabd8d72518 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c282 expref: 66 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.372621:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8903180/0x6d188eabd8d72518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c282 expref: 66 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.372627:0:17474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10102 00000100:00100000:1.0:1716999794.372629:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483022208:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.372632:0:17474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3218:x1800404483022080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.372643:0:17474:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1547 count 1 00000100:00100000:1.0:1716999794.372649:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1716999794.372652:0:17474:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.372661:0:17474:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd0 expref: 70 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.372665:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.372667:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.372669:0:17474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.372671:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999794.372684:0:17474:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd0 expref: 70 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.372694:0:17474:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd0 expref: 70 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.372702:0:17474:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:17474:1800404483022272:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.372723:0:17474:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219d80 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.372747:0:8342:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483020736:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.372758:0:8342:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.372815:0:19195:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a694b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19195:1800404483020800:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.372827:0:19195:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.372842:0:19209:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483020864:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.372852:0:19209:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.372852:0:8341:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a6948700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483021120:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.372860:0:8341:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.372873:0:11262:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131caa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11262:1800404483021312:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.372874:0:19205:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:19205:1800404483020928:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.373042:0:11262:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.373043:0:19205:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.373469:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848896 00000100:00100000:3.0:1716999794.373474:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848896 00010000:00010000:3.0:1716999794.373487:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091185200/0x6d188eabd8d717c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bca1 expref: 71 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.373508:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4603 00000100:00100000:3.0:1716999794.373512:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+71:1958:x1800404480848896:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.373518:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.373522:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091185200/0x6d188eabd8d717c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bca1 expref: 71 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.373529:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091185200/0x6d188eabd8d717c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bca1 expref: 71 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.373540:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091185200/0x6d188eabd8d717c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bca1 expref: 71 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.374226:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.374241:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.374253:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.374264:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999794.374364:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.374365:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.374369:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.374376:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.374429:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999794.374438:0:8340:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.374445:0:8340:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.374456:0:8340:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.374461:0:8340:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.374469:0:8340:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.374474:0:8340:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695d8c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.374476:0:8340:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.374482:0:8340:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.374490:0:8340:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.374495:0:8340:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8793 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.374807:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480848960 00000100:00100000:0.0:1716999794.374812:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480848960 00010000:00010000:0.0:1716999794.374828:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fef3840/0x6d188eabd8d7092d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b68f expref: 71 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.374849:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849088 00000100:00100000:0.0:1716999794.374852:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849088 00010000:00010000:0.0:1716999794.374861:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f8c6c0/0x6d188eabd8d70712 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5cb expref: 67 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.374872:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849216 00000100:00100000:0.0:1716999794.374873:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849216 00010000:00010000:0.0:1716999794.374891:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800997c3180/0x6d188eabd8d7275d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c35b expref: 68 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.374898:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849024 00000100:00100000:0.0:1716999794.374900:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849024 00010000:00010000:0.0:1716999794.374907:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a6c expref: 69 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.374915:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4604 00000100:00100000:0.0:1716999794.374919:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+71:1957:x1800404480848960:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.374926:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.374929:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fef3840/0x6d188eabd8d7092d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b68f expref: 71 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.374936:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fef3840/0x6d188eabd8d7092d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b68f expref: 71 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.374945:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fef3840/0x6d188eabd8d7092d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b68f expref: 71 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.374957:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.374959:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.374961:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.374966:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.374977:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.375174:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+70:1958:x1800404480848896:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1660us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.375181:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4603 00000100:00100000:3.0:1716999794.375194:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4605 00000100:00100000:3.0:1716999794.375198:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+69:1957:x1800404480849088:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.375204:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.375208:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f8c6c0/0x6d188eabd8d70712 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5cb expref: 69 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.375216:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f8c6c0/0x6d188eabd8d70712 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5cb expref: 69 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.375227:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f8c6c0/0x6d188eabd8d70712 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5cb expref: 69 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.375234:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.375235:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.375243:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375248:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375261:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.375275:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+68:1957:x1800404480849088:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 75us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.375280:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4605 00000100:00100000:3.0:1716999794.375291:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4606 00000100:00100000:3.0:1716999794.375295:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+67:1957:x1800404480849216:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.375300:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.375304:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800997c3180/0x6d188eabd8d7275d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c35b expref: 67 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.375311:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800997c3180/0x6d188eabd8d7275d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c35b expref: 67 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.375319:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997c3180/0x6d188eabd8d7275d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c35b expref: 67 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.375327:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.375328:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.375331:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375336:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375348:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.375361:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+66:1957:x1800404480849216:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 65us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.375365:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4606 00000100:00100000:3.0:1716999794.375375:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4607 00000100:00100000:3.0:1716999794.375379:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+65:1957:x1800404480849024:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.375384:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.375387:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a6c expref: 65 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.375394:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a6c expref: 65 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.375403:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bddb00/0x6d188eabd8dc5a83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x606:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65a6c expref: 65 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.375410:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.375411:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.375414:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375420:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375431:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.375443:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+64:1957:x1800404480849024:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 63us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.375448:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4607 00010000:00010000:3.0:1716999794.375463:0:8341:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375470:0:8341:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375476:0:8341:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375482:0:8341:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375488:0:8341:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375493:0:8341:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c6c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.375495:0:8341:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375501:0:8341:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375508:0:8341:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375513:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc87b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.375579:0:8340:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3219:x1800404483020224:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9134us (9167us total) trans 4294970208 rc 0/0 00000100:00100000:1.0:1716999794.375586:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10087 00010000:00010000:1.0:1716999794.375607:0:8342:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.375614:0:8342:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.375620:0:8342:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.375625:0:8342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.375630:0:8342:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.375635:0:8342:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833600 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.375637:0:8342:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.375642:0:8342:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.375649:0:8342:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.375655:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc879a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.375704:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3217:x1800404483020480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5226us (5255us total) trans 4294970171 rc 0/0 00000100:00100000:3.0:1716999794.375709:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10092 00000004:00080000:3.0:1716999794.375739:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a694b100/2, rc 0, transno 2875 00000100:00100000:3.0:1716999794.375747:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a694b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483020480:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999794.375800:0:19209:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375807:0:19209:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375813:0:19209:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375819:0:19209:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.375822:0:8342:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3219:x1800404483020544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5831us (5884us total) trans 4294970209 rc 0/0 00010000:00010000:3.0:1716999794.375824:0:19209:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.375827:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10088 00010000:00010000:3.0:1716999794.375829:0:19209:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.375832:0:19209:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375838:0:19209:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375846:0:19209:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.375855:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091830480/0x6d188eabd8dc87a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.376018:0:19209:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+22:3217:x1800404483020416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5623us (5678us total) trans 4294970172 rc 0/0 00000100:00100000:3.0:1716999794.376023:0:19209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10090 00000004:00080000:3.0:1716999794.376042:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6948380/2, rc 0, transno 2876 00000100:00100000:3.0:1716999794.376047:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a6948380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483020416:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.376072:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483022400:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.376094:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.376110:0:19209:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483022400 00000100:00100000:3.0:1716999794.376113:0:19209:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483022400 00000100:00100000:3.0:1716999794.376126:0:19209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10103 00000100:00100000:3.0:1716999794.376129:0:19209:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+22:3217:x1800404483022400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.376142:0:19209:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:873 count 1 00010000:00010000:3.0:1716999794.376153:0:19209:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.376163:0:19209:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa880/0x6d188eabd8d7186f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcf5 expref: 63 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.376169:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.376171:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.376173:0:19209:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.376188:0:19209:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa880/0x6d188eabd8d7186f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcf5 expref: 63 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.376197:0:19209:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa880/0x6d188eabd8d7186f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcf5 expref: 63 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.376206:0:19209:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483022464:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.376226:0:19209:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219480 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.376239:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483022336:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.376254:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.376272:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483022336 00000100:00100000:3.0:1716999794.376275:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483022336 00000100:00100000:3.0:1716999794.376287:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10104 00000100:00100000:3.0:1716999794.376291:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+23:3220:x1800404483022336:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.376299:0:8341:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:871 count 1 00010000:00010000:3.0:1716999794.376306:0:8341:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.376314:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099f26ac0/0x6d188eabd8d7173b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc69 expref: 63 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.376319:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.376320:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.376321:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.376335:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099f26ac0/0x6d188eabd8d7173b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc69 expref: 63 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.376341:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099f26ac0/0x6d188eabd8d7173b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc69 expref: 63 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.376348:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483022528:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.376362:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219f00 going to sleep for 11 seconds 00000100:00100000:0.0:1716999794.376922:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+69:1957:x1800404480848960:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1999us (2694us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.376928:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4604 00000100:00100000:2.0:1716999794.376931:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.376942:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849152 00000100:00100000:0.0:1716999794.376945:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849152 00010000:00010000:0.0:1716999794.376955:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9d40/0x6d188eabd8d70b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b768 expref: 69 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.376973:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4608 00000100:00100000:2.0:1716999794.376975:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.376977:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+69:1957:x1800404480849152:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.376983:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.376987:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9d40/0x6d188eabd8d70b10 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b768 expref: 69 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.376994:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9d40/0x6d188eabd8d70b10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b768 expref: 69 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.377009:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9d40/0x6d188eabd8d70b10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b768 expref: 69 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.377018:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.377019:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.377021:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377027:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377039:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999794.377043:0:19197:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131cab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0001_UUID:19197:1800404483021824:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.377053:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+68:1957:x1800404480849152:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 76us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.377058:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4608 00010000:00010000:2.0:1716999794.377060:0:19197:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.377066:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849280 00000100:00100000:0.0:1716999794.377068:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849280 00010000:00010000:0.0:1716999794.377077:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131f8f180/0x6d188eabd8d70869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b63b expref: 68 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.377088:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4609 00000100:00100000:0.0:1716999794.377092:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+68:1957:x1800404480849280:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.377097:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.377100:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131f8f180/0x6d188eabd8d70869 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b63b expref: 68 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.377110:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131f8f180/0x6d188eabd8d70869 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b63b expref: 68 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.377118:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131f8f180/0x6d188eabd8d70869 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b63b expref: 68 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.377125:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.377126:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.377129:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377134:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377145:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999794.377153:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483021376:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.377158:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aa3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+67:1957:x1800404480849280:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 65us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.377162:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4609 00010000:00010000:2.0:1716999794.377164:0:17365:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.377177:0:11262:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.377183:0:11262:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.377189:0:11262:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377189:0:19195:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.377195:0:11262:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377195:0:19195:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377201:0:19195:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.377202:0:11262:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.377207:0:11262:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.377209:0:11262:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377210:0:19195:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.377214:0:11262:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377215:0:19195:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377219:0:19195:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f3c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.377222:0:19195:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.377223:0:11262:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377227:0:19195:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.377228:0:11262:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc87bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377234:0:19195:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.377239:0:19195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc87a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x606:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.377376:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+24:3220:x1800404483020608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7285us (7326us total) trans 4294970173 rc 0/0 00000100:00100000:0.0:1716999794.377382:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10089 00000100:00100000:1.0:1716999794.377551:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a694bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15837:1800404483021440:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.377562:0:15837:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.377574:0:19205:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.377579:0:19205:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.377585:0:19205:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.377590:0:19205:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.377595:0:19205:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.377599:0:19205:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6aac0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.377602:0:19205:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.377607:0:19205:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.377614:0:19205:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.377619:0:19205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e6aac0/0x6d188eabd8dc87af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.377794:0:19205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+22:3217:x1800404483020672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7392us (7430us total) trans 4294970211 rc 0/0 00000100:00100000:1.0:1716999794.377801:0:19205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10091 00000100:00100000:2.0:1716999794.378071:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3217:x1800404483020992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7532us (7563us total) trans 4294970210 rc 0/0 00000100:00100000:2.0:1716999794.378077:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10093 00000004:00080000:2.0:1716999794.378104:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800897ad500/2, rc 0, transno 2914 00000100:00100000:2.0:1716999794.378569:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483020992:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1716999794.378583:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a694ad80/2, rc 0, transno 2915 00000100:00100000:2.0:1716999794.378586:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a694ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483020672:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1716999794.378605:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6949c00/2, rc 0, transno 2913 00000100:00100000:2.0:1716999794.378608:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a6949c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483020544:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1716999794.378615:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a694aa00/2, rc 0, transno 2912 00000100:00100000:2.0:1716999794.378617:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a694aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483020224:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.378723:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17700:1800404483021760:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.378740:0:17700:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999794.378764:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a694a680/2, rc 0, transno 2877 00000100:00100000:3.0:1716999794.378783:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a694a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483020608:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.378787:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1716999794.378795:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483022656:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.378805:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1716999794.378812:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483022720:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.378821:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.378831:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.378840:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483022656 00000100:00100000:3.0:1716999794.378843:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483022656 00000100:00100000:1.0:1716999794.378847:0:19205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483022720 00000100:00100000:1.0:1716999794.378849:0:19205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483022720 00000100:00100000:3.0:1716999794.378861:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10105 00000100:00100000:1.0:1716999794.378864:0:19205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10106 00000100:00100000:3.0:1716999794.378865:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3220:x1800404483022656:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.378868:0:19205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+22:3219:x1800404483022720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.378893:0:11262:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:890 count 1 00002000:00080000:1.0:1716999794.378898:0:19205:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1549 count 1 00010000:00010000:3.0:1716999794.378905:0:11262:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.378907:0:19205:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.378917:0:19205:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f19 expref: 66 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.378919:0:11262:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339f8900/0x6d188eabd8d723f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c204 expref: 66 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.378924:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.378925:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.378927:0:11262:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.378927:0:19205:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.378929:0:19205:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.378931:0:19205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.378944:0:11262:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801339f8900/0x6d188eabd8d723f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c204 expref: 66 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.378945:0:19205:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f19 expref: 66 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.378952:0:11262:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801339f8900/0x6d188eabd8d723f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c204 expref: 66 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.378953:0:19205:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f19 expref: 66 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.378961:0:11262:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11262:1800404483022848:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.378962:0:19205:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:19205:1800404483022912:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.378985:0:11262:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219600 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.378987:0:19205:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96000 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.379939:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483022784:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.379961:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.379972:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1716999794.379975:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483022592:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.379984:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.379991:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483022976:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.380002:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.380082:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483022784 00000100:00100000:3.0:1716999794.380086:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483022784 00000100:00100000:3.0:1716999794.380102:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483022592 00000100:00100000:3.0:1716999794.380104:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483022592 00000100:00100000:3.0:1716999794.380112:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483022976 00000100:00100000:3.0:1716999794.380114:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483022976 00000100:00100000:3.0:1716999794.380125:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10107 00000100:00100000:3.0:1716999794.380129:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+24:3217:x1800404483022784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.380141:0:19195:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:849 count 1 00010000:00010000:3.0:1716999794.380151:0:19195:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380165:0:19195:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091186d00/0x6d188eabd8d70632 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b562 expref: 66 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380171:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.380173:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.380175:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380190:0:19195:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091186d00/0x6d188eabd8d70632 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b562 expref: 66 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380198:0:19195:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091186d00/0x6d188eabd8d70632 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b562 expref: 66 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.380206:0:19195:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19195:1800404483023040:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.380240:0:19195:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.380254:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10108 00000100:00100000:3.0:1716999794.380258:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+24:3217:x1800404483022592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.380268:0:17864:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:891 count 1 00010000:00010000:3.0:1716999794.380276:0:17864:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380285:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8900480/0x6d188eabd8d7248c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c24a expref: 66 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380290:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.380292:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.380294:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380307:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8900480/0x6d188eabd8d7248c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c24a expref: 66 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380314:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8900480/0x6d188eabd8d7248c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c24a expref: 66 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.380321:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483023104:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.380337:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219300 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.380348:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10109 00000100:00100000:3.0:1716999794.380352:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+24:3217:x1800404483022976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.380362:0:19200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:864 count 1 00010000:00010000:3.0:1716999794.380372:0:19200:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380380:0:19200:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f8d680/0x6d188eabd8d7110d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ec expref: 63 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380385:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.380386:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.380388:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380402:0:19200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f8d680/0x6d188eabd8d7110d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ec expref: 63 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380413:0:19200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f8d680/0x6d188eabd8d7110d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ec expref: 63 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.380422:0:19200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:19200:1800404483023168:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.380437:0:19200:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219a80 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.380507:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.380551:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.380562:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.380571:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.380582:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.380591:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.380591:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849344 00000100:00100000:0.0:1716999794.380595:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849344 00010000:00010000:0.0:1716999794.380610:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800997c33c0/0x6d188eabd8d725c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c2cf expref: 64 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.380611:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.380626:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849472 00000100:00100000:0.0:1716999794.380627:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849472 00000100:00100000:2.0:1716999794.380633:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999794.380636:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fef3180/0x6d188eabd8d70a6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b71b expref: 67 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.380644:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849600 00000100:00100000:0.0:1716999794.380645:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849600 00000100:00100000:2.0:1716999794.380650:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.380651:0:17473:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:17473:1800404483022016:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.380652:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8901b00/0x6d188eabd8d72526 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c290 expref: 68 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.380663:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849408 00010000:00010000:3.0:1716999794.380665:0:17473:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.380665:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849408 00010000:00010000:2.0:1716999794.380676:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b22 expref: 65 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.380679:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849536 00000100:00100000:3.0:1716999794.380681:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849536 00000100:00100000:2.0:1716999794.380686:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849664 00000100:00100000:2.0:1716999794.380687:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849664 00010000:00010000:3.0:1716999794.380692:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fef1440/0x6d188eabd8d709c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6d5 expref: 69 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.380693:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e78 expref: 66 pid: 19196 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.380699:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849728 00000100:00100000:2.0:1716999794.380701:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849728 00000100:00100000:3.0:1716999794.380703:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4610 00010000:00010000:2.0:1716999794.380706:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8900fc0/0x6d188eabd8d7245b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c235 expref: 67 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.380707:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+67:1959:x1800404480849344:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1716999794.380713:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849792 00000100:00100000:2.0:1716999794.380714:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849792 00010000:00010000:3.0:1716999794.380715:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.380719:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800997c33c0/0x6d188eabd8d725c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c2cf expref: 68 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.380720:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8903180/0x6d188eabd8d72518 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c282 expref: 68 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.380726:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800997c33c0/0x6d188eabd8d725c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c2cf expref: 68 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.380730:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849856 00000100:00100000:2.0:1716999794.380732:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849856 00010000:00010000:2.0:1716999794.380737:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd0 expref: 70 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.380740:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800997c33c0/0x6d188eabd8d725c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c2cf expref: 68 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.380744:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4611 00000100:00100000:2.0:1716999794.380748:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+70:1959:x1800404480849472:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.380750:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.380751:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.380753:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.380754:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.380756:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fef3180/0x6d188eabd8d70a6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b71b expref: 70 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.380760:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.380762:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fef3180/0x6d188eabd8d70a6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b71b expref: 70 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.380785:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fef3180/0x6d188eabd8d70a6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b71b expref: 70 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.380788:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.380792:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.380794:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.380796:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.380802:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.380808:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+67:1959:x1800404480849344:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 100us (301us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999794.380812:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.380813:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4610 00000100:00100000:2.0:1716999794.380826:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+69:1959:x1800404480849472:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 77us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.380828:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4612 00000100:00100000:3.0:1716999794.380832:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+66:1959:x1800404480849408:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1716999794.380832:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4611 00010000:00010000:3.0:1716999794.380838:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1716999794.380841:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4613 00010000:00010000:3.0:1716999794.380842:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b22 expref: 66 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.380844:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+66:1959:x1800404480849664:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.380849:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.380850:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b22 expref: 66 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.380852:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e78 expref: 66 pid: 19196 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.380858:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e78 expref: 66 pid: 19196 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.380859:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918eb840/0x6d188eabd8dc5c5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x607:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65b22 expref: 66 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.380866:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.380867:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.380867:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135bdd8c0/0x6d188eabd8dc65f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e78 expref: 65 pid: 19196 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.380870:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.380873:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.380874:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.380875:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.380876:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.380900:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380906:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.380910:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.380920:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+64:1959:x1800404480849408:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 87us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.380922:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+64:1959:x1800404480849664:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 77us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.380925:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4612 00000100:00100000:2.0:1716999794.380928:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4613 00000100:00100000:3.0:1716999794.380936:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4614 00000100:00100000:3.0:1716999794.380940:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+68:1959:x1800404480849536:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.380945:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.380949:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fef1440/0x6d188eabd8d709c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6d5 expref: 68 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.380955:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fef1440/0x6d188eabd8d709c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6d5 expref: 68 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.380964:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fef1440/0x6d188eabd8d709c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6d5 expref: 68 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.380971:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.380972:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.380974:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380980:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.380990:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.381000:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+67:1959:x1800404480849536:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 59us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999794.381097:0:17697:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb8a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:17697:1800404483021952:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.381108:0:17697:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.381121:0:15837:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.381127:0:15837:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.381134:0:15837:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.381145:0:15837:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.381150:0:15837:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.381155:0:15837:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695fcc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.381158:0:15837:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.381164:0:15837:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.381172:0:15837:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.381177:0:15837:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc87cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.381419:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3220:x1800404483021056:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10719us (10770us total) trans 4294970212 rc 0/0 00000100:00100000:1.0:1716999794.381425:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10095 00000100:00100000:2.0:1716999794.382079:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4615 00000100:00100000:2.0:1716999794.382085:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+62:1958:x1800404480849728:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1716999794.382086:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4614 00010000:00010000:2.0:1716999794.382093:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.382097:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8900fc0/0x6d188eabd8d7245b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c235 expref: 62 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.382101:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4616 00000100:00100000:3.0:1716999794.382104:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+62:1958:x1800404480849792:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.382105:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8900fc0/0x6d188eabd8d7245b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c235 expref: 62 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.382111:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.382115:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.382116:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8903180/0x6d188eabd8d72518 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c282 expref: 62 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.382116:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.382119:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382123:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8903180/0x6d188eabd8d72518 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c282 expref: 62 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.382124:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382133:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.382134:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.382134:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.382137:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382143:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.382150:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aa3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+62:1958:x1800404480849728:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 66us (1538us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999794.382152:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.382155:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4617 00000100:00100000:0.0:1716999794.382161:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+66:1958:x1800404480849856:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1716999794.382167:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+62:1958:x1800404480849792:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 62us (1532us total) trans 0 rc 0/0 00010000:00010000:0.0:1716999794.382168:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1716999794.382173:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4616 00010000:00010000:0.0:1716999794.382174:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd0 expref: 66 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.382181:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd0 expref: 66 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.382183:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4618 00000100:00100000:3.0:1716999794.382187:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+66:1959:x1800404480849600:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.382192:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.382192:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.382193:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.382195:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382196:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8901b00/0x6d188eabd8d72526 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c290 expref: 66 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.382201:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382203:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8901b00/0x6d188eabd8d72526 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c290 expref: 66 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.382212:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8901b00/0x6d188eabd8d72526 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c290 expref: 66 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.382214:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.382220:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.382221:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.382223:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382229:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.382229:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+65:1958:x1800404480849856:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 69us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.382234:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4617 00010000:00010000:3.0:1716999794.382241:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.382255:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+64:1959:x1800404480849600:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 67us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.382260:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4618 00010000:00010000:0.0:1716999794.382260:0:21818:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8900fc0/0x6d188eabd8d7245b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c235 expref: 61 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.382269:0:21818:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:21818:1800404483021888:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.382277:0:17473:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.382282:0:21818:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382283:0:17473:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.382288:0:21818:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.382292:0:21818:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382294:0:17473:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.382298:0:21818:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382300:0:17473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.382303:0:21818:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382305:0:17473:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.382308:0:21818:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382310:0:17473:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51d40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.382313:0:17473:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.382317:0:21818:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e686c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.382319:0:17473:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.382319:0:21818:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.382324:0:21818:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382327:0:17473:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382332:0:17473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c51d40/0x6d188eabd8dc87ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.382332:0:21818:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.382337:0:21818:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e686c0/0x6d188eabd8dc87e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.382345:0:17697:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.382353:0:17697:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.382358:0:17697:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.382363:0:17697:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.382369:0:17697:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.382373:0:17697:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695ef40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.382375:0:17697:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.382381:0:17697:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.382388:0:17697:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.382394:0:17697:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc87e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.382512:0:17473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3217:x1800404483021504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11120us (11151us total) trans 4294970174 rc 0/0 00000100:00100000:3.0:1716999794.382518:0:17473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10100 00000100:00100000:0.0:1716999794.382521:0:21818:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+26:3220:x1800404483021568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11405us (11541us total) trans 4294970175 rc 0/0 00000100:00100000:0.0:1716999794.382526:0:21818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10098 00010000:00010000:3.0:1716999794.382536:0:17700:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382542:0:17700:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382548:0:17700:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.382552:0:17697:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3217:x1800404483021696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11193us (11228us total) trans 4294970213 rc 0/0 00010000:00010000:3.0:1716999794.382554:0:17700:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.382558:0:17697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10099 00010000:00010000:3.0:1716999794.382560:0:17700:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382564:0:17700:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50900 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.382567:0:17700:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382573:0:17700:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382580:0:17700:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.382582:0:19209:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008fc1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483022464:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.382585:0:17700:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c50900/0x6d188eabd8dc87d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x607:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.382718:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b87d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3217:x1800404483021248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11815us (11870us total) trans 4294970176 rc 0/0 00000100:00100000:3.0:1716999794.382724:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10096 00010000:00010000:3.0:1716999794.382749:0:17474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc6c0/0x6d188eabd8dc641c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65dd0 expref: 63 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.382761:0:17474:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:17474:1800404483022272:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.382784:0:17474:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382791:0:17474:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382795:0:17474:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382801:0:17474:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382806:0:17474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382812:0:17474:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382817:0:17474:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52400 already unused, calling callback (ffffffffa0864a40) 00000100:00100000:2.0:1716999794.382903:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4615 00010000:00010000:3.0:1716999794.382935:0:17474:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.382939:0:19197:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382945:0:17474:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.382946:0:19197:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.382952:0:19197:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382953:0:17474:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.382958:0:17474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c52400/0x6d188eabd8dc87fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.382962:0:19197:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.382967:0:19197:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.382972:0:19197:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.382975:0:19197:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.382981:0:19197:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.382989:0:19197:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.382995:0:19197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc87d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.383115:0:17474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3218:x1800404483022080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10482us (10599us total) trans 4294970214 rc 0/0 00000100:00100000:3.0:1716999794.383119:0:17474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10102 00000100:00100000:3.0:1716999794.383147:0:8341:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483022528:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.383150:0:19197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+25:3220:x1800404483021632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12149us (12205us total) trans 4294970215 rc 0/0 00000100:00100000:2.0:1716999794.383155:0:19197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10097 00010000:00010000:3.0:1716999794.383158:0:8341:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.383173:0:17365:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.383179:0:17365:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.383185:0:17365:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.383195:0:17365:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.383199:0:17365:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.383204:0:17365:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.383206:0:17365:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.383211:0:17365:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.383218:0:17365:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.383223:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091830fc0/0x6d188eabd8dc87c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.383334:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3220:x1800404483021184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12651us (12741us total) trans 4294970177 rc 0/0 00000100:00100000:2.0:1716999794.383339:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10094 00000004:00080000:2.0:1716999794.383423:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6949180/2, rc 0, transno 2878 00010000:00010000:1.0:1716999794.383497:0:19209:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999794.383516:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092df1c00/2, rc 0, transno 2879 00000100:00100000:1.0:1716999794.384062:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483021568:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1716999794.384078:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092df0000/2, rc 0, transno 2919 00000100:00100000:1.0:1716999794.384085:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483021632:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999794.384093:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800897afb80/2, rc 0, transno 2916 00000100:00100000:1.0:1716999794.384095:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483021056:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999794.384102:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a694b480/2, rc 0, transno 2881 00000100:00100000:1.0:1716999794.384104:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a694b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483021184:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.384161:0:11262:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11262:1800404483022848:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.384172:0:11262:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.384321:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a6949180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483021504:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1716999794.384334:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb8a680/2, rc 0, transno 2917 00000100:00100000:2.0:1716999794.384339:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483021696:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1716999794.384346:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6948a80/2, rc 0, transno 2880 00000100:00100000:2.0:1716999794.384348:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a6948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483021248:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.384375:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483023360:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.384398:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.384417:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483023360 00000100:00100000:2.0:1716999794.384421:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483023360 00000100:00100000:2.0:1716999794.384435:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10110 00000100:00100000:2.0:1716999794.384439:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3217:x1800404483023360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.384455:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:847 count 1 00010000:00010000:2.0:1716999794.384468:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.384478:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f8db00/0x6d188eabd8d703e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b482 expref: 62 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.384484:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.384486:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.384488:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.384507:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131f8db00/0x6d188eabd8d703e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b482 expref: 62 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.384516:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131f8db00/0x6d188eabd8d703e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b482 expref: 62 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.384524:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483023424:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.384554:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6000 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.385168:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483023296:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.385189:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.385211:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483023616:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.385224:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.385234:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1716999794.385238:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483023232:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.385250:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.385257:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483023552:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.385267:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.385282:0:17697:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483023296 00000100:00100000:1.0:1716999794.385286:0:17697:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483023296 00000100:00100000:1.0:1716999794.385299:0:17697:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483023616 00000100:00100000:1.0:1716999794.385301:0:17697:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483023616 00000100:00100000:1.0:1716999794.385310:0:17697:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483023232 00000100:00100000:1.0:1716999794.385311:0:17697:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483023232 00000100:00100000:1.0:1716999794.385319:0:17697:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483023552 00000100:00100000:1.0:1716999794.385321:0:17697:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483023552 00000100:00100000:1.0:1716999794.385329:0:17697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10111 00000100:00100000:1.0:1716999794.385332:0:17697:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+27:3220:x1800404483023296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.385343:0:17697:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:846 count 1 00010000:00010000:1.0:1716999794.385353:0:17697:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385362:0:17697:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012facd8c0/0x6d188eabd8d70337 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b435 expref: 62 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385367:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.385369:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.385371:0:17697:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385384:0:17697:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012facd8c0/0x6d188eabd8d70337 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b435 expref: 62 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385390:0:17697:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012facd8c0/0x6d188eabd8d70337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b435 expref: 62 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.385397:0:17697:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:17697:1800404483023744:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.385417:0:17697:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96300 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.385430:0:21818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10112 00000100:00100000:1.0:1716999794.385434:0:21818:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+26:3220:x1800404483023616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.385444:0:21818:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:857 count 1 00010000:00010000:1.0:1716999794.385454:0:21818:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385462:0:21818:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f8dd40/0x6d188eabd8d70cd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b809 expref: 59 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385467:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.385468:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.385470:0:21818:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385484:0:21818:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f8dd40/0x6d188eabd8d70cd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b809 expref: 59 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385491:0:21818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f8dd40/0x6d188eabd8d70cd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b809 expref: 59 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.385500:0:21818:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:21818:1800404483023808:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.385516:0:21818:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96240 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.385533:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10113 00000100:00100000:1.0:1716999794.385537:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+27:3220:x1800404483023232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.385546:0:15837:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:850 count 1 00010000:00010000:1.0:1716999794.385554:0:15837:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385567:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c5758c0/0x6d188eabd8d706cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5a8 expref: 62 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385572:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.385573:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.385575:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385588:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c5758c0/0x6d188eabd8d706cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5a8 expref: 62 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385594:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c5758c0/0x6d188eabd8d706cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5a8 expref: 62 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.385601:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15837:1800404483023872:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.385615:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96840 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.385639:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8903180/0x6d188eabd8d72518 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c282 expref: 59 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.385646:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483022208:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.385656:0:19196:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385661:0:19196:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385670:0:19196:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385677:0:19196:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385681:0:19196:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385688:0:19196:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385693:0:19196:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695ed00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.385695:0:19196:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385701:0:19196:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385711:0:19196:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385716:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc87f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.385939:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+27:3219:x1800404483022144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13374us (13771us total) trans 4294970178 rc 0/0 00000100:00100000:1.0:1716999794.385944:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10101 00000100:00100000:1.0:1716999794.385956:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10114 00000100:00100000:1.0:1716999794.385959:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+26:3220:x1800404483023552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.385967:0:19196:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:858 count 1 00010000:00010000:1.0:1716999794.385973:0:19196:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385981:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa400/0x6d188eabd8d70d78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b856 expref: 58 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.385986:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.385987:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.385989:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.386000:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa400/0x6d188eabd8d70d78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b856 expref: 58 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.386005:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa400/0x6d188eabd8d70d78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b856 expref: 58 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.386012:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483023936:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.386024:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96cc0 going to sleep for 11 seconds 00000004:00080000:1.0:1716999794.386038:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131ca9f80/2, rc 0, transno 2882 00000100:00100000:1.0:1716999794.386043:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483022144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.386280:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483023488:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.386310:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.386320:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483024000:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.386331:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1716999794.386345:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb89500/2, rc 0, transno 2918 00000100:00100000:0.0:1716999794.386474:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483022080:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999794.386482:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1716999794.386486:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483023680:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.386504:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.386543:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483023488 00000100:00100000:3.0:1716999794.386547:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483023488 00000100:00100000:3.0:1716999794.386564:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483024000 00000100:00100000:3.0:1716999794.386566:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483024000 00000100:00100000:3.0:1716999794.386573:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483023680 00000100:00100000:3.0:1716999794.386575:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483023680 00000100:00100000:3.0:1716999794.386584:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10115 00000100:00100000:3.0:1716999794.386588:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3218:x1800404483023488:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.386590:0:17473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10116 00000100:00100000:0.0:1716999794.386594:0:17473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+29:3218:x1800404483024000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.386598:0:17700:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:872 count 1 00002000:00080000:0.0:1716999794.386605:0:17473:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1536 count 1 00010000:00010000:3.0:1716999794.386607:0:17700:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.386615:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a65f9200/0x6d188eabd8d717d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcaf expref: 58 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.386615:0:17473:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.386620:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.386621:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.386623:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.386624:0:17473:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e9 expref: 58 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.386629:0:17473:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.386630:0:17473:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.386632:0:17473:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.386637:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a65f9200/0x6d188eabd8d717d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcaf expref: 58 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.386644:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a65f9200/0x6d188eabd8d717d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcaf expref: 58 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.386647:0:17473:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e9 expref: 58 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.386652:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17700:1800404483024064:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.386655:0:17473:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e9 expref: 58 pid: 15837 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.386663:0:17473:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:17473:1800404483024128:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.386669:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219f00 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.386681:0:19197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10117 00000100:00100000:0.0:1716999794.386682:0:17473:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc9780 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.386684:0:19197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+29:3218:x1800404483023680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.386694:0:19197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:865 count 1 00010000:00010000:3.0:1716999794.386701:0:19197:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.386715:0:19197:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a65f98c0/0x6d188eabd8d711a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba32 expref: 58 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.386720:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.386722:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.386723:0:19197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.386736:0:19197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a65f98c0/0x6d188eabd8d711a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba32 expref: 58 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.386742:0:19197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a65f98c0/0x6d188eabd8d711a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba32 expref: 58 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.386749:0:19197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19197:1800404483024192:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.386763:0:19197:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219d80 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.386807:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.386841:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.386873:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.386905:0:19205:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb8b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0001_UUID:19205:1800404483022912:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.386935:0:19195:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c11880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19195:1800404483023040:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.386950:0:19195:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.386964:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849920 00000100:00100000:3.0:1716999794.386966:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849920 00010000:00010000:3.0:1716999794.386984:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa880/0x6d188eabd8d7186f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcf5 expref: 59 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.386998:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480849984 00000100:00100000:3.0:1716999794.387000:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480849984 00010000:00010000:3.0:1716999794.387007:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099f26ac0/0x6d188eabd8d7173b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc69 expref: 60 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.387021:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850048 00000100:00100000:3.0:1716999794.387023:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850048 00010000:00010000:3.0:1716999794.387029:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801339f8900/0x6d188eabd8d723f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c204 expref: 63 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.387041:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4619 00000100:00100000:3.0:1716999794.387045:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+60:1958:x1800404480849920:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.387052:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.387055:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa880/0x6d188eabd8d7186f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcf5 expref: 60 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.387062:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa880/0x6d188eabd8d7186f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcf5 expref: 60 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.387073:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa880/0x6d188eabd8d7186f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcf5 expref: 60 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.387080:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.387081:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.387084:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.387090:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.387101:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.387113:0:19205:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.387114:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+59:1958:x1800404480849920:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 69us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.387119:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4619 00000100:00100000:3.0:1716999794.387129:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4620 00000100:00100000:3.0:1716999794.387132:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+58:1959:x1800404480849984:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1716999794.387136:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4621 00010000:00010000:3.0:1716999794.387138:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1716999794.387140:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+63:1958:x1800404480850048:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.387141:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099f26ac0/0x6d188eabd8d7173b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc69 expref: 58 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.387146:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.387148:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099f26ac0/0x6d188eabd8d7173b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc69 expref: 58 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.387150:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801339f8900/0x6d188eabd8d723f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c204 expref: 63 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.387157:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099f26ac0/0x6d188eabd8d7173b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x367:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bc69 expref: 58 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.387157:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801339f8900/0x6d188eabd8d723f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c204 expref: 63 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.387164:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.387165:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.387167:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.387168:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801339f8900/0x6d188eabd8d723f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c204 expref: 63 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.387173:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.387175:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.387176:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.387179:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.387183:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.387184:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.387194:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+57:1959:x1800404480849984:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 61us (353us total) trans 0 rc 0/0 00010000:00010000:0.0:1716999794.387194:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.387199:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4620 00000100:00100000:0.0:1716999794.387208:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+62:1958:x1800404480850048:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 67us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.387212:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4621 00010000:00010000:3.0:1716999794.387213:0:8341:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.387219:0:8341:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.387225:0:8341:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.387229:0:8341:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.387234:0:8341:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.387511:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483024256:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999794.387532:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.387667:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483024256 00000100:00100000:1.0:1716999794.387672:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483024256 00000100:00100000:1.0:1716999794.387694:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10118 00000100:00100000:1.0:1716999794.387699:0:8342:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3219:x1800404483024256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.387710:0:8342:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:866 count 1 00010000:00010000:1.0:1716999794.387720:0:8342:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.387735:0:8342:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f27a80/0x6d188eabd8d712db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bac5 expref: 61 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.387741:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.387742:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.387745:0:8342:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.387749:0:8341:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51b00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.387752:0:8341:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.387758:0:8341:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.387759:0:8342:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f27a80/0x6d188eabd8d712db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bac5 expref: 61 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.387766:0:8342:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f27a80/0x6d188eabd8d712db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bac5 expref: 61 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.387767:0:8341:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.387782:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c51b00/0x6d188eabd8dc880a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.387789:0:8342:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483024320:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.387808:0:8342:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96900 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.387825:0:19209:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.387831:0:19209:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.387842:0:19209:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.387848:0:19209:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.387853:0:19209:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.387858:0:19209:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.387860:0:19209:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.387866:0:19209:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.387874:0:19209:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.387906:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c52ac0/0x6d188eabd8dc8803 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.388017:0:11262:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.388025:0:11262:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.388031:0:11262:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.388036:0:11262:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.388042:0:11262:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.388046:0:11262:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.388048:0:11262:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.388054:0:11262:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.388062:0:11262:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.388067:0:11262:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8811 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.388971:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3220:x1800404483022336:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12676us (12713us total) trans 4294970179 rc 0/0 00000100:00100000:3.0:1716999794.388979:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10104 00000100:00100000:3.0:1716999794.389010:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483023104:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.389023:0:17864:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.389043:0:19200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:19200:1800404483023168:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.389053:0:19200:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1716999794.389151:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800897af800/2, rc 0, transno 2883 00000100:00100000:0.0:1716999794.389160:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483022336:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.390590:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1716999794.390602:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483024384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.390634:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.391583:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999794.392062:0:19209:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+30:3217:x1800404483022400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15928us (15963us total) trans 4294970180 rc 0/0 00000100:00100000:1.0:1716999794.392071:0:19209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10103 00000100:00100000:1.0:1716999794.392088:0:19209:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483024384 00000100:00100000:1.0:1716999794.392093:0:19209:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483024384 00000100:00100000:1.0:1716999794.392115:0:19209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10119 00000100:00100000:1.0:1716999794.392120:0:19209:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+30:3219:x1800404483024384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.392139:0:19209:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1532 count 1 00010000:00010000:1.0:1716999794.392158:0:19209:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.392173:0:19209:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65318 expref: 56 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.392180:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.392181:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.392184:0:19209:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.392207:0:19209:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65318 expref: 56 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.392217:0:19209:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65318 expref: 56 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.392227:0:19209:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483024448:192.168.203.3@tcp:104: 00000004:00080000:3.0:1716999794.392294:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800897ad880/2, rc 0, transno 2884 00000100:00100000:3.0:1716999794.392304:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483022400:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.392339:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1716999794.392353:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483024512:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.392377:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.392452:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483023424:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.392467:0:17365:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.392483:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483024512 00000100:00100000:2.0:1716999794.392485:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483024512 00000100:00100000:2.0:1716999794.392500:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10120 00000100:00100000:2.0:1716999794.392503:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3218:x1800404483024512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1716999794.392513:0:8341:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:863 count 1 00010000:00010000:2.0:1716999794.392521:0:8341:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.392529:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a65f86c0/0x6d188eabd8d71073 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9a6 expref: 56 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.392534:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.392535:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.392537:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.392549:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a65f86c0/0x6d188eabd8d71073 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9a6 expref: 56 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.392556:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a65f86c0/0x6d188eabd8d71073 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9a6 expref: 56 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.392564:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483024576:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.392593:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6000 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.392695:0:19209:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96780 going to sleep for 11 seconds 00000100:00100000:0.0:1716999794.392824:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.392841:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.392859:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.392873:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999794.392941:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3220:x1800404483022656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14074us (14119us total) trans 4294970216 rc 0/0 00000100:00100000:0.0:1716999794.392943:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999794.392950:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10105 00000100:00100000:0.0:1716999794.392955:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.392968:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999794.392972:0:17697:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:17697:1800404483023744:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.392978:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999794.392984:0:17697:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.393002:0:21818:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:21818:1800404483023808:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.393011:0:21818:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.393019:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850176 00000100:00100000:0.0:1716999794.393022:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850176 00000100:00100000:1.0:1716999794.393030:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15837:1800404483023872:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.393037:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091186d00/0x6d188eabd8d70632 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b562 expref: 62 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.393038:0:15837:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.393049:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850304 00000100:00100000:1.0:1716999794.393051:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850240 00000100:00100000:0.0:1716999794.393051:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850304 00000100:00100000:1.0:1716999794.393054:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850240 00010000:00010000:0.0:1716999794.393058:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f8d680/0x6d188eabd8d7110d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ec expref: 57 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.393065:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8900480/0x6d188eabd8d7248c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c24a expref: 63 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.393066:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850368 00000100:00100000:0.0:1716999794.393067:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850368 00010000:00010000:0.0:1716999794.393074:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131f8db00/0x6d188eabd8d703e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b482 expref: 64 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.393076:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850112 00000100:00100000:1.0:1716999794.393078:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850112 00000100:00100000:0.0:1716999794.393081:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850496 00000100:00100000:0.0:1716999794.393083:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850496 00010000:00010000:1.0:1716999794.393085:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f19 expref: 65 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.393089:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f8dd40/0x6d188eabd8d70cd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b809 expref: 58 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.393094:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850624 00000100:00100000:1.0:1716999794.393096:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850624 00000100:00100000:0.0:1716999794.393096:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850560 00000100:00100000:0.0:1716999794.393098:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850560 00010000:00010000:1.0:1716999794.393103:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa400/0x6d188eabd8d70d78 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b856 expref: 59 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.393103:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c5758c0/0x6d188eabd8d706cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5a8 expref: 66 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.393110:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850432 00000100:00100000:0.0:1716999794.393111:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850432 00000100:00100000:1.0:1716999794.393113:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4622 00010000:00010000:0.0:1716999794.393116:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012facd8c0/0x6d188eabd8d70337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b435 expref: 67 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.393117:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+67:1957:x1800404480850176:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1716999794.393124:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4623 00010000:00010000:1.0:1716999794.393125:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1716999794.393128:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+59:1957:x1800404480850304:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.393129:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091186d00/0x6d188eabd8d70632 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b562 expref: 67 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.393134:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.393137:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091186d00/0x6d188eabd8d70632 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b562 expref: 67 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.393137:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f8d680/0x6d188eabd8d7110d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ec expref: 59 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.393144:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f8d680/0x6d188eabd8d7110d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ec expref: 59 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.393151:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091186d00/0x6d188eabd8d70632 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b562 expref: 67 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.393155:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f8d680/0x6d188eabd8d7110d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ec expref: 59 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.393159:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.393161:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.393162:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.393163:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.393164:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.393166:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.393170:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.393172:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.393183:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.393185:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999794.393200:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+66:1957:x1800404480850176:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 81us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.393202:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aa2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+58:1957:x1800404480850304:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 72us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999794.393206:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4622 00000100:00100000:0.0:1716999794.393209:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4623 00000100:00100000:1.0:1716999794.393218:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4624 00000100:00100000:1.0:1716999794.393221:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+65:1957:x1800404480850240:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.393227:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.393231:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8900480/0x6d188eabd8d7248c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c24a expref: 65 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.393237:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8900480/0x6d188eabd8d7248c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c24a expref: 65 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.393246:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8900480/0x6d188eabd8d7248c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c24a expref: 65 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.393253:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.393254:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.393256:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.393262:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.393274:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999794.393287:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+64:1957:x1800404480850240:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 65us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.393293:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4625 00000100:00100000:0.0:1716999794.393297:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+64:1957:x1800404480850368:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.393303:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.393307:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131f8db00/0x6d188eabd8d703e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b482 expref: 64 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.393315:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131f8db00/0x6d188eabd8d703e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b482 expref: 64 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.393325:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131f8db00/0x6d188eabd8d703e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b482 expref: 64 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.393332:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.393334:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.393336:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.393341:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.393353:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.393367:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+63:1957:x1800404480850368:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 69us (507us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999794.394052:0:17365:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.394061:0:17365:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.394068:0:17365:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.394074:0:17365:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.394079:0:17365:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.394084:0:17365:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918318c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.394087:0:17365:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.394093:0:17365:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.394102:0:17365:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.394108:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918318c0/0x6d188eabd8dc8834 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.394274:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3217:x1800404483023360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9833us (9874us total) trans 4294970217 rc 0/0 00000100:00100000:2.0:1716999794.394280:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10110 00000100:00100000:1.0:1716999794.394993:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4624 00000100:00100000:1.0:1716999794.395018:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4626 00000100:00100000:1.0:1716999794.395023:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+62:1958:x1800404480850112:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.395031:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.395036:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f19 expref: 62 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395049:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f19 expref: 62 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395060:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008efb4d80/0x6d188eabd8dc67fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f19 expref: 62 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395068:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.395069:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.395072:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395078:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395093:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999794.395110:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+61:1958:x1800404480850112:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 87us (2235us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999794.395116:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4626 00000100:00100000:1.0:1716999794.395125:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4627 00000100:00100000:1.0:1716999794.395129:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+57:1957:x1800404480850496:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.395135:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.395139:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f8dd40/0x6d188eabd8d70cd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b809 expref: 57 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395147:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f8dd40/0x6d188eabd8d70cd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b809 expref: 57 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395160:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f8dd40/0x6d188eabd8d70cd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x359:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b809 expref: 57 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395167:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.395169:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.395171:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395177:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395188:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999794.395200:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+56:1957:x1800404480850496:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 71us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999794.395205:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4627 00000100:00100000:1.0:1716999794.395216:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4628 00000100:00100000:1.0:1716999794.395220:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+60:1959:x1800404480850560:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.395227:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.395230:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c5758c0/0x6d188eabd8d706cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5a8 expref: 60 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395237:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c5758c0/0x6d188eabd8d706cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5a8 expref: 60 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395247:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c5758c0/0x6d188eabd8d706cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b5a8 expref: 60 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395258:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.395259:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.395261:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395267:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395277:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999794.395291:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+59:1959:x1800404480850560:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 70us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999794.395295:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4628 00000100:00100000:1.0:1716999794.395304:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4629 00000100:00100000:1.0:1716999794.395308:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+55:1957:x1800404480850624:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.395313:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.395317:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa400/0x6d188eabd8d70d78 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b856 expref: 55 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395323:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa400/0x6d188eabd8d70d78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b856 expref: 55 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395331:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.395332:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.395334:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395342:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395350:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1716999794.395361:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+55:1957:x1800404480850624:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 52us (2405us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999794.395365:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4629 00000100:00100000:1.0:1716999794.395373:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4630 00000100:00100000:1.0:1716999794.395377:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+58:1958:x1800404480850432:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.395382:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.395386:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012facd8c0/0x6d188eabd8d70337 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b435 expref: 58 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395392:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012facd8c0/0x6d188eabd8d70337 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b435 expref: 58 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395400:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012facd8c0/0x6d188eabd8d70337 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b435 expref: 58 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.395407:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.395408:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.395410:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395415:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395430:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999794.395439:0:17697:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395444:0:17697:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395450:0:17697:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395456:0:17697:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395461:0:17697:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395466:0:17697:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695e400 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.395468:0:17697:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395474:0:17697:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395482:0:17697:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395491:0:17697:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695e400/0x6d188eabd8dc883b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.395667:0:17697:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3220:x1800404483023296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10333us (10477us total) trans 4294970218 rc 0/0 00000100:00100000:1.0:1716999794.395674:0:17697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10111 00010000:00010000:1.0:1716999794.395691:0:17864:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395697:0:17864:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395703:0:17864:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395707:0:17864:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395712:0:17864:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395716:0:17864:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53840 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.395718:0:17864:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395723:0:17864:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395730:0:17864:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395735:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8826 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.395892:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+29:3217:x1800404483022592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15619us (15892us total) trans 4294970219 rc 0/0 00000100:00100000:1.0:1716999794.395897:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10108 00010000:00010000:1.0:1716999794.395911:0:19195:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395917:0:19195:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395922:0:19195:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395927:0:19195:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395932:0:19195:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395936:0:19195:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52880 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.395938:0:19195:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395943:0:19195:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395950:0:19195:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.395954:0:19195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c52880/0x6d188eabd8dc881f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.396069:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131cab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+29:3217:x1800404483022784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15939us (16107us total) trans 4294970220 rc 0/0 00000100:00100000:1.0:1716999794.396073:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10107 00010000:00010000:1.0:1716999794.396086:0:21818:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396092:0:21818:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396097:0:21818:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396101:0:21818:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396106:0:21818:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396114:0:21818:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c000 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.396116:0:21818:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396120:0:21818:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396127:0:21818:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396132:0:21818:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8842 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.396279:0:21818:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+32:3220:x1800404483023616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10844us (11053us total) trans 4294970181 rc 0/0 00000100:00100000:1.0:1716999794.396284:0:21818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10112 00000100:00100000:1.0:1716999794.396305:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aa2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+57:1958:x1800404480850432:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 927us (3325us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999794.396309:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4630 00010000:00010000:1.0:1716999794.396323:0:15837:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396328:0:15837:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396333:0:15837:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396338:0:15837:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396343:0:15837:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396347:0:15837:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695fa80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.396349:0:15837:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396353:0:15837:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396359:0:15837:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396364:0:15837:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8849 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.396489:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3220:x1800404483023232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10950us (11237us total) trans 4294970221 rc 0/0 00000100:00100000:1.0:1716999794.396493:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10113 00000100:00100000:1.0:1716999794.396519:0:8342:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483024320:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.396530:0:8342:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396545:0:19205:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396550:0:19205:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396555:0:19205:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396560:0:19205:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396564:0:19205:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396568:0:19205:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695cb40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.396570:0:19205:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396574:0:19205:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396580:0:19205:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396584:0:19205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8818 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.396678:0:19205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+29:3219:x1800404483022720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17809us (17846us total) trans 4294970222 rc 0/0 00000100:00100000:1.0:1716999794.396683:0:19205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10106 00000004:00080000:1.0:1716999794.396703:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb8a300/2, rc 0, transno 2925 00000100:00100000:1.0:1716999794.396710:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483023232:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999794.396716:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb88e00/2, rc 0, transno 2922 00000100:00100000:1.0:1716999794.396718:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483023296:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999794.396725:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a5c11f80/2, rc 0, transno 2885 00000100:00100000:1.0:1716999794.396730:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483023616:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1716999794.396737:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb8aa00/2, rc 0, transno 2920 00000100:00100000:1.0:1716999794.396739:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483022656:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1716999794.396793:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a65fa400/0x6d188eabd8d70d78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b856 expref: 54 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.396800:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483023936:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.396809:0:19196:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396814:0:19196:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396819:0:19196:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396827:0:19196:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396832:0:19196:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396837:0:19196:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396840:0:19196:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695cd80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.396842:0:19196:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396847:0:19196:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396854:0:19196:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.396858:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc8850 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.396990:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+32:3220:x1800404483023552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11030us (11721us total) trans 4294970182 rc 0/0 00000100:00100000:1.0:1716999794.396995:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10114 00000004:00080000:1.0:1716999794.397009:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a5c12680/2, rc 0, transno 2886 00000100:00100000:1.0:1716999794.397013:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483023552:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.397069:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4625 00000100:00100000:3.0:1716999794.397073:0:19197:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c10e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19197:1800404483024192:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.397085:0:19197:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.397104:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17700:1800404483024064:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.397109:0:17473:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:17473:1800404483024128:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.397111:0:17700:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.397121:0:19200:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.397121:0:17473:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.397130:0:19200:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.397135:0:19200:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.397139:0:19200:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.397144:0:19200:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.397147:0:19200:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52f40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.397149:0:19200:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.397154:0:19200:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.397160:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999794.397161:0:19200:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.397165:0:19200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c52f40/0x6d188eabd8dc882d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.397197:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.397217:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.397308:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+32:3217:x1800404483022976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16955us (17304us total) trans 4294970183 rc 0/0 00000100:00100000:3.0:1716999794.397313:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10109 00000100:00100000:2.0:1716999794.398572:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850752 00000100:00100000:2.0:1716999794.398579:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850752 00010000:00010000:2.0:1716999794.398597:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f27a80/0x6d188eabd8d712db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bac5 expref: 56 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.398607:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850688 00000100:00100000:2.0:1716999794.398609:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850688 00010000:00010000:2.0:1716999794.398615:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e9 expref: 54 pid: 15837 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.398621:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850816 00000100:00100000:2.0:1716999794.398623:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850816 00010000:00010000:2.0:1716999794.398629:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a65f98c0/0x6d188eabd8d711a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba32 expref: 55 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.398637:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4631 00000100:00100000:2.0:1716999794.398641:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+56:1959:x1800404480850752:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.398649:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.398653:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f27a80/0x6d188eabd8d712db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bac5 expref: 56 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.398663:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f27a80/0x6d188eabd8d712db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bac5 expref: 56 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.398674:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f27a80/0x6d188eabd8d712db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bac5 expref: 56 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.398682:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.398683:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.398686:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.398692:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.398706:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999794.398725:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+55:1959:x1800404480850752:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 83us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.398729:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4631 00000100:00100000:2.0:1716999794.398738:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4632 00000100:00100000:2.0:1716999794.398740:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+55:1959:x1800404480850688:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.398745:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.398749:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e9 expref: 55 pid: 15837 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.398755:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e9 expref: 55 pid: 15837 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.398767:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c96f40/0x6d188eabd8dc4b6b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x600:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f655e9 expref: 55 pid: 15837 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.398785:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.398786:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.398788:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.398793:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.398804:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.398812:0:17473:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.398817:0:17473:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.398822:0:17473:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.398828:0:17473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.398833:0:17473:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.398841:0:17473:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e68d80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.398844:0:17473:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.398849:0:17473:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.398856:0:17473:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.398861:0:17473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e68d80/0x6d188eabd8dc885e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x600:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.399017:0:17473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3218:x1800404483024000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12421us (12684us total) trans 4294970184 rc 0/0 00000100:00100000:2.0:1716999794.399022:0:17473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10116 00000100:00100000:2.0:1716999794.399188:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483024768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.399210:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.399219:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1716999794.399223:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483024704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.399233:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.399242:0:17473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483024768 00000100:00100000:2.0:1716999794.399244:0:17473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483024768 00000100:00100000:2.0:1716999794.399254:0:17473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483024704 00000100:00100000:2.0:1716999794.399255:0:17473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483024704 00000100:00100000:2.0:1716999794.399263:0:17473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10121 00000100:00100000:2.0:1716999794.399266:0:17473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+30:3220:x1800404483024768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.399279:0:17473:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:864 count 1 00010000:00010000:2.0:1716999794.399290:0:17473:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399298:0:17473:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65faf40/0x6d188eabd8d711a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba39 expref: 54 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399303:0:17473:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.399304:0:17473:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.399306:0:17473:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399319:0:17473:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65faf40/0x6d188eabd8d711a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba39 expref: 54 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399326:0:17473:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a65faf40/0x6d188eabd8d711a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba39 expref: 54 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.399333:0:17473:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:17473:1800404483024896:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.399351:0:17473:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.399379:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10122 00000100:00100000:2.0:1716999794.399382:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+30:3220:x1800404483024704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.399390:0:19200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:848 count 1 00010000:00010000:2.0:1716999794.399396:0:19200:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399403:0:19200:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fb3c0/0x6d188eabd8d70479 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4c1 expref: 54 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399408:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.399410:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.399411:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399425:0:19200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fb3c0/0x6d188eabd8d70479 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4c1 expref: 54 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399432:0:19200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920fb3c0/0x6d188eabd8d70479 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4c1 expref: 54 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.399439:0:19200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099582300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483024960:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.399456:0:19200:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.399491:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4633 00000100:00100000:2.0:1716999794.399495:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+54:1959:x1800404480850816:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.399501:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.399504:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a65f98c0/0x6d188eabd8d711a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba32 expref: 54 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.399511:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a65f98c0/0x6d188eabd8d711a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba32 expref: 54 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.399521:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a65f98c0/0x6d188eabd8d711a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba32 expref: 54 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.399532:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.399534:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.399536:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399541:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399551:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999794.399563:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+53:1959:x1800404480850816:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 68us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.399567:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4633 00010000:00010000:2.0:1716999794.399579:0:19197:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399585:0:19197:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399590:0:19197:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399595:0:19197:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399600:0:19197:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399608:0:19197:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51f80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.399610:0:19197:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399615:0:19197:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399621:0:19197:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.399626:0:19197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c51f80/0x6d188eabd8dc8865 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.399764:0:19197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+32:3218:x1800404483023680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13079us (13258us total) trans 4294970185 rc 0/0 00000100:00100000:2.0:1716999794.399769:0:19197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10117 00000100:00100000:2.0:1716999794.399819:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+52:1959:x1800404480850688:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1077us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.399824:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4632 00000100:00100000:3.0:1716999794.400091:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483024832:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.400112:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1716999794.400134:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131d5ed80/2, rc 0, transno 2921 00000100:00100000:3.0:1716999794.400140:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483023360:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1716999794.400148:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb88a80/2, rc 0, transno 2923 00000100:00100000:3.0:1716999794.400150:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483022592:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1716999794.400158:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131ca8380/2, rc 0, transno 2887 00000100:00100000:3.0:1716999794.400161:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483022976:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1716999794.400166:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb89f80/2, rc 0, transno 2924 00000100:00100000:3.0:1716999794.400168:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483022784:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.400174:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1716999794.400178:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483024640:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.400191:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1716999794.400415:0:8342:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.400422:0:8342:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.400429:0:8342:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.400434:0:8342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.400439:0:8342:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.400443:0:8342:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695cfc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.400446:0:8342:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.400451:0:8342:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.400459:0:8342:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.400463:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc886c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.400652:0:8342:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3219:x1800404483024256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12952us (13118us total) trans 4294970223 rc 0/0 00000100:00100000:1.0:1716999794.400657:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10118 00000100:00100000:1.0:1716999794.400668:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483024832 00000100:00100000:1.0:1716999794.400671:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483024832 00000100:00100000:1.0:1716999794.400683:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483024640 00000100:00100000:1.0:1716999794.400685:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483024640 00000100:00100000:1.0:1716999794.400692:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10123 00000100:00100000:1.0:1716999794.400695:0:8342:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3217:x1800404483024832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.400705:0:8342:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:856 count 1 00010000:00010000:1.0:1716999794.400713:0:8342:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.400721:0:8342:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f24000/0x6d188eabd8d70ca6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7f4 expref: 54 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.400726:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.400727:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.400728:0:8342:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.400741:0:8342:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f24000/0x6d188eabd8d70ca6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7f4 expref: 54 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.400747:0:8342:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f24000/0x6d188eabd8d70ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7f4 expref: 54 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.400759:0:8342:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483025152:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.400789:0:8342:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.400841:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483025088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.400857:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.400865:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000004:00080000:1.0:1716999794.400870:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131d5f480/2, rc 0, transno 2927 00000100:00100000:1.0:1716999794.400873:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483024256:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999794.400894:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb88700/2, rc 0, transno 2926 00000100:00100000:1.0:1716999794.400896:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483022720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.400906:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483025088 00000100:00100000:1.0:1716999794.400908:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483025088 00000100:00100000:0.0:1716999794.400916:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999794.400919:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10124 00000100:00100000:1.0:1716999794.400922:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3217:x1800404483024640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.400930:0:15837:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:860 count 1 00000100:00100000:0.0:1716999794.400942:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.400960:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850880 00000100:00100000:0.0:1716999794.400963:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850880 00010000:00010000:0.0:1716999794.400974:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a65f9200/0x6d188eabd8d717d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcaf expref: 52 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.400989:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480850944 00000100:00100000:0.0:1716999794.400991:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480850944 00010000:00010000:0.0:1716999794.400998:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a65f86c0/0x6d188eabd8d71073 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9a6 expref: 53 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.401006:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851008 00000100:00100000:0.0:1716999794.401008:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851008 00010000:00010000:0.0:1716999794.401014:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65318 expref: 54 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.401022:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4634 00000100:00100000:0.0:1716999794.401027:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+54:1957:x1800404480850880:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.401033:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.401037:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a65f9200/0x6d188eabd8d717d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcaf expref: 54 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.401044:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a65f9200/0x6d188eabd8d717d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcaf expref: 54 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.401055:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a65f9200/0x6d188eabd8d717d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x368:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bcaf expref: 54 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.401062:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.401064:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.401066:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.401072:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.401084:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.401100:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+53:1957:x1800404480850880:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 73us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.401106:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4634 00000100:00100000:0.0:1716999794.401117:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4635 00000100:00100000:0.0:1716999794.401121:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+52:1957:x1800404480850944:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.401126:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.401129:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a65f86c0/0x6d188eabd8d71073 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9a6 expref: 52 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.401136:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a65f86c0/0x6d188eabd8d71073 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9a6 expref: 52 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.401144:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.401145:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.401148:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.401153:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.401161:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.401172:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+52:1957:x1800404480850944:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 51us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.401176:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4635 00000100:00100000:0.0:1716999794.401184:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4636 00000100:00100000:0.0:1716999794.401187:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+51:1959:x1800404480851008:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.401192:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.401195:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65318 expref: 51 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.401200:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65318 expref: 51 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.401208:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.401209:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.401212:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.401217:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.401224:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.401232:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+51:1959:x1800404480851008:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 44us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.401237:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4636 00010000:00010000:3.0:1716999794.401347:0:17700:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401353:0:17700:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401360:0:17700:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.401360:0:19197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10125 00000100:00100000:2.0:1716999794.401364:0:19197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b87cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+33:3219:x1800404483025088:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999794.401369:0:17700:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1716999794.401372:0:19197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:867 count 1 00010000:00010000:3.0:1716999794.401379:0:17700:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401380:0:19197:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401384:0:17700:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53a80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.401387:0:17700:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401388:0:19197:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e6a400/0x6d188eabd8d712d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4babe expref: 50 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401392:0:17700:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401393:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.401394:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.401396:0:19197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401401:0:17700:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401406:0:17700:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c53a80/0x6d188eabd8dc8857 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401407:0:19197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880132e6a400/0x6d188eabd8d712d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4babe expref: 50 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401414:0:19197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880132e6a400/0x6d188eabd8d712d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4babe expref: 50 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.401421:0:19197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19197:1800404483025536:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.401435:0:19197:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1716999794.401453:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a65f86c0/0x6d188eabd8d71073 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9a6 expref: 50 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.401460:0:8341:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8341:1800404483024576:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.401471:0:8341:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401477:0:8341:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401482:0:8341:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401492:0:8341:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401497:0:8341:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401502:0:8341:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401506:0:8341:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833a80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.401508:0:8341:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401514:0:8341:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401522:0:8341:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.401527:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091833a80/0x6d188eabd8dc887a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.401556:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3218:x1800404483023488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14967us (15245us total) trans 4294970186 rc 0/0 00000100:00100000:3.0:1716999794.401562:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10115 00000100:00100000:3.0:1716999794.401582:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483025280:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.401599:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.401612:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1716999794.401616:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483025024:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.401631:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.401640:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483025344:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.401651:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.401665:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483025280 00000100:00100000:3.0:1716999794.401667:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483025280 00000100:00100000:3.0:1716999794.401679:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483025024 00000100:00100000:3.0:1716999794.401681:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483025024 00000100:00100000:3.0:1716999794.401689:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483025344 00000100:00100000:3.0:1716999794.401691:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483025344 00000100:00100000:2.0:1716999794.401695:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3218:x1800404483024512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9190us (9317us total) trans 4294970187 rc 0/0 00000100:00100000:2.0:1716999794.401700:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10120 00000100:00100000:3.0:1716999794.401712:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10126 00000100:00100000:3.0:1716999794.401717:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+33:3217:x1800404483025280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.401727:0:19195:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:857 count 1 00010000:00010000:3.0:1716999794.401736:0:19195:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401745:0:19195:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f26640/0x6d188eabd8d70d40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b83a expref: 54 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401750:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.401751:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.401753:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401767:0:19195:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f26640/0x6d188eabd8d70d40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b83a expref: 54 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401791:0:19195:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f26640/0x6d188eabd8d70d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b83a expref: 54 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.401799:0:19195:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19195:1800404483025600:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.401817:0:19195:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219f00 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.401830:0:17697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10127 00000100:00100000:3.0:1716999794.401834:0:17697:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+34:3217:x1800404483025024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.401844:0:17697:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:862 count 1 00010000:00010000:3.0:1716999794.401852:0:17697:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401860:0:17697:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099f27cc0/0x6d188eabd8d70fd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b967 expref: 49 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401865:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.401866:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.401868:0:17697:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401907:0:17697:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099f27cc0/0x6d188eabd8d70fd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b967 expref: 49 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.401915:0:17697:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099f27cc0/0x6d188eabd8d70fd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b967 expref: 49 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.401923:0:17697:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a5c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:17697:1800404483025664:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.401924:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483025408:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.401941:0:17697:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219d80 going to sleep for 11 seconds 00000100:00100000:0.0:1716999794.401944:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.401963:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1716999794.401965:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483025408 00000100:00100000:0.0:1716999794.401967:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483025216:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.401968:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483025408 00000100:00100000:0.0:1716999794.401978:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.401982:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483025216 00000100:00100000:3.0:1716999794.401984:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483025216 00000100:00100000:0.0:1716999794.401985:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483025472:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.401994:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10128 00000100:00100000:0.0:1716999794.401995:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.401997:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3217:x1800404483025344:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.402009:0:17700:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:858 count 1 00010000:00010000:3.0:1716999794.402017:0:17700:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402026:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9f80/0x6d188eabd8d70dda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b880 expref: 54 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402031:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.402032:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.402034:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 4/0,1 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402048:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9f80/0x6d188eabd8d70dda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b880 expref: 54 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402055:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9f80/0x6d188eabd8d70dda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b880 expref: 54 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.402063:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483025728:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.402081:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219a80 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.402091:0:19193:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483025472 00000100:00100000:3.0:1716999794.402093:0:19193:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483025472 00000100:00100000:3.0:1716999794.402104:0:19193:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10129 00000100:00100000:3.0:1716999794.402107:0:19193:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+36:3219:x1800404483025408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.402115:0:19193:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:860 count 1 00010000:00010000:3.0:1716999794.402123:0:19193:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402135:0:19193:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9680/0x6d188eabd8d70f0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b90c expref: 54 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402139:0:19193:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.402141:0:19193:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.402143:0:19193:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402155:0:19193:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9680/0x6d188eabd8d70f0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b90c expref: 54 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402162:0:19193:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9680/0x6d188eabd8d70f0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b90c expref: 54 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.402169:0:19193:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:19193:1800404483025792:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.402183:0:19193:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219300 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.402195:0:17474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10130 00000100:00100000:3.0:1716999794.402198:0:17474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3219:x1800404483025216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.402207:0:17474:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:863 count 1 00010000:00010000:3.0:1716999794.402214:0:17474:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402222:0:17474:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65fb600/0x6d188eabd8d71106 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9f3 expref: 54 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402227:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.402229:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.402230:0:17474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402245:0:17474:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65fb600/0x6d188eabd8d71106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9f3 expref: 54 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402252:0:17474:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a65fb600/0x6d188eabd8d71106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9f3 expref: 54 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.402259:0:17474:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:17474:1800404483025856:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.402271:0:17474:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.402332:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10131 00000100:00100000:3.0:1716999794.402336:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3219:x1800404483025472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.402345:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:865 count 1 00010000:00010000:3.0:1716999794.402353:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402361:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8b40/0x6d188eabd8d71233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba71 expref: 54 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402366:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.402367:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.402369:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402383:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8b40/0x6d188eabd8d71233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba71 expref: 54 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402394:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8b40/0x6d188eabd8d71233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba71 expref: 54 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.402401:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483025920:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.402413:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219180 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.402508:0:15837:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.402517:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8d80/0x6d188eabd8d70ea5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8db expref: 49 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.402522:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.402523:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.402525:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.402539:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8d80/0x6d188eabd8d70ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8db expref: 49 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.402546:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8d80/0x6d188eabd8d70ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8db expref: 49 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.402553:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483025984:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.402567:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96900 going to sleep for 11 seconds 00000004:00080000:1.0:1716999794.402658:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a5c13480/2, rc 0, transno 2891 00000100:00100000:1.0:1716999794.402665:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483024512:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1716999794.402674:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a5c13800/2, rc 0, transno 2889 00000100:00100000:1.0:1716999794.402677:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483023680:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1716999794.402684:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a5c11c00/2, rc 0, transno 2890 00000100:00100000:1.0:1716999794.402686:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483023488:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1716999794.402692:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995a3800/2, rc 0, transno 2888 00000100:00100000:1.0:1716999794.402694:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483024000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.402739:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483026112:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.402755:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.402764:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1716999794.402765:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c94240/0x6d188eabd8dc429d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65318 expref: 49 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.402768:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483026048:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.402787:0:19209:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483024448:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.402797:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1716999794.402799:0:19209:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.402809:0:19209:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.402810:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483026112 00000100:00100000:1.0:1716999794.402813:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483026112 00010000:00010000:0.0:1716999794.402815:0:19209:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.402824:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483026048 00000100:00100000:1.0:1716999794.402825:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483026048 00000100:00100000:1.0:1716999794.402833:0:2535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10132 00000100:00100000:1.0:1716999794.402837:0:2535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+36:3218:x1800404483026112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.402846:0:2535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:861 count 1 00000100:00100000:3.0:1716999794.402856:0:19205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10133 00000100:00100000:3.0:1716999794.402861:0:19205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+36:3218:x1800404483026048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.402872:0:19205:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:866 count 1 00010000:00010000:3.0:1716999794.402894:0:19205:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402903:0:19205:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800911858c0/0x6d188eabd8d71241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba7f expref: 48 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402909:0:19205:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.402910:0:19205:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.402912:0:19205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 4/0,1 mode: --/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402926:0:19205:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800911858c0/0x6d188eabd8d71241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba7f expref: 48 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.402933:0:19205:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800911858c0/0x6d188eabd8d71241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba7f expref: 48 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.402941:0:19205:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:19205:1800404483026304:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.402961:0:19205:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219240 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.403028:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.403042:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.403083:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851136 00000100:00100000:3.0:1716999794.403086:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851136 00010000:00010000:3.0:1716999794.403097:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fb3c0/0x6d188eabd8d70479 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4c1 expref: 55 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.403110:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851072 00000100:00100000:3.0:1716999794.403112:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851072 00010000:00010000:3.0:1716999794.403118:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65faf40/0x6d188eabd8d711a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba39 expref: 56 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.403130:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4637 00000100:00100000:3.0:1716999794.403134:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+56:1959:x1800404480851136:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.403140:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.403144:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fb3c0/0x6d188eabd8d70479 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4c1 expref: 56 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.403152:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fb3c0/0x6d188eabd8d70479 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4c1 expref: 56 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.403162:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.403163:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.403166:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.403171:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.403181:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.403198:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aa2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+56:1959:x1800404480851136:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 63us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.403203:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4637 00000100:00100000:3.0:1716999794.403226:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4638 00000100:00100000:3.0:1716999794.403230:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+55:1959:x1800404480851072:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.403235:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.403239:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a65faf40/0x6d188eabd8d711a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba39 expref: 55 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.403246:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a65faf40/0x6d188eabd8d711a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba39 expref: 55 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.403254:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.403255:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.403257:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.403264:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.403272:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.403284:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+55:1959:x1800404480851072:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 53us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.403289:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4638 00010000:00010000:1.0:1716999794.403456:0:2535:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403466:0:2535:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8000/0x6d188eabd8d70f3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b921 expref: 48 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403471:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.403473:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.403474:0:2535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403489:0:2535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8000/0x6d188eabd8d70f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b921 expref: 48 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403496:0:2535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8000/0x6d188eabd8d70f3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b921 expref: 48 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.403504:0:2535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483026368:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.403523:0:2535:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96840 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.403544:0:8342:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483025152:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.403554:0:8342:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.403568:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483026176:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1716999794.403575:0:17473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65faf40/0x6d188eabd8d711a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba39 expref: 54 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.403584:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.403585:0:17473:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:17473:1800404483024896:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.403597:0:17473:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.403603:0:17473:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.403604:0:17860:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483026176 00000100:00100000:1.0:1716999794.403606:0:17860:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483026176 00010000:00010000:2.0:1716999794.403608:0:17473:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.403614:0:17473:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.403620:0:17473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.403620:0:17860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10134 00000100:00100000:1.0:1716999794.403623:0:17860:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+37:3219:x1800404483026176:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1716999794.403626:0:17473:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.403631:0:17473:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830480 already unused, calling callback (ffffffffa0864a40) 00002000:00080000:1.0:1716999794.403632:0:17860:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:859 count 1 00010000:00010000:2.0:1716999794.403634:0:17473:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.403639:0:17473:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403640:0:17860:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403647:0:17860:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f8e880/0x6d188eabd8d70e0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b895 expref: 48 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.403651:0:17473:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403652:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.403654:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.403655:0:17860:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.403656:0:17473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8881 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403668:0:17860:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f8e880/0x6d188eabd8d70e0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b895 expref: 48 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403674:0:17860:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f8e880/0x6d188eabd8d70e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b895 expref: 48 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.403681:0:17860:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f4bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:17860:1800404483026432:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.403695:0:17860:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.403706:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1716999794.403710:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483026240:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.403726:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.403740:0:21818:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483026240 00000100:00100000:1.0:1716999794.403747:0:21818:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483026240 00000100:00100000:1.0:1716999794.403761:0:21818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10135 00000100:00100000:1.0:1716999794.403765:0:21818:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+38:3219:x1800404483026240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.403788:0:21818:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:847 count 1 00010000:00010000:1.0:1716999794.403796:0:21818:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403804:0:21818:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012faced00/0x6d188eabd8d70399 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b45f expref: 48 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403809:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.403810:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.403812:0:21818:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403826:0:21818:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012faced00/0x6d188eabd8d70399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b45f expref: 48 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.403834:0:21818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012faced00/0x6d188eabd8d70399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b45f expref: 48 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.403841:0:21818:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:21818:1800404483026496:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.403855:0:21818:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96240 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.403908:0:17473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+37:3220:x1800404483024768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4639us (4696us total) trans 4294970224 rc 0/0 00000100:00100000:2.0:1716999794.403914:0:17473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10121 00010000:00010000:0.0:1716999794.403995:0:19209:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.404005:0:19209:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.404011:0:19209:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.404016:0:19209:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.404019:0:19209:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.404025:0:19209:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.404033:0:19209:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.404039:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695f180/0x6d188eabd8dc8873 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.404292:0:19209:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+39:3219:x1800404483024384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12171us (13657us total) trans 4294970188 rc 0/0 00000100:00100000:0.0:1716999794.404299:0:19209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10119 00000004:00080000:1.0:1716999794.404516:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995a2d80/2, rc 0, transno 2892 00000100:00100000:1.0:1716999794.404525:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483024384:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1716999794.404582:0:19200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fb3c0/0x6d188eabd8d70479 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4c1 expref: 53 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.404591:0:19200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099582300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483024960:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.404602:0:19200:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.404614:0:19200:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.404619:0:19200:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.404626:0:19200:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.404631:0:19200:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.404855:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483026560:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.404891:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.404911:0:17473:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483026560 00000100:00100000:3.0:1716999794.404915:0:17473:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483026560 00000100:00100000:3.0:1716999794.404927:0:17473:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10136 00000100:00100000:3.0:1716999794.404931:0:17473:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+39:3217:x1800404483026560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.404941:0:17473:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:849 count 1 00010000:00010000:3.0:1716999794.404950:0:17473:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.404958:0:17473:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012facef40/0x6d188eabd8d704d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4eb expref: 48 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.404964:0:17473:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.404965:0:17473:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.404967:0:17473:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 4/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.404980:0:17473:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012facef40/0x6d188eabd8d704d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4eb expref: 48 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.404986:0:17473:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012facef40/0x6d188eabd8d704d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4eb expref: 48 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.404993:0:17473:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:17473:1800404483026624:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.405015:0:17473:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219000 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.405049:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.405097:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851200 00000100:00100000:3.0:1716999794.405100:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851200 00010000:00010000:3.0:1716999794.405113:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f24000/0x6d188eabd8d70ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7f4 expref: 53 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.405127:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4639 00000100:00100000:3.0:1716999794.405131:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+53:1959:x1800404480851200:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.405137:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.405140:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f24000/0x6d188eabd8d70ca6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7f4 expref: 53 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.405148:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f24000/0x6d188eabd8d70ca6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7f4 expref: 53 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.405158:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f24000/0x6d188eabd8d70ca6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b7f4 expref: 53 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.405165:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.405167:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.405170:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.405176:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.405188:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.405203:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+52:1959:x1800404480851200:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 72us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.405208:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4639 00010000:00010000:1.0:1716999794.405379:0:8342:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.405391:0:8342:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.405397:0:8342:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.405402:0:8342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.405408:0:8342:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.405414:0:8342:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695e640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.405416:0:8342:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.405422:0:8342:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.405431:0:8342:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.405435:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695e640/0x6d188eabd8dc888f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.405625:0:8342:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+37:3217:x1800404483024832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4928us (5511us total) trans 4294970225 rc 0/0 00000100:00100000:1.0:1716999794.405631:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10123 00010000:00010000:2.0:1716999794.405670:0:19200:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.405675:0:19200:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830b40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.405677:0:19200:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.405683:0:19200:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.405690:0:19200:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.405695:0:19200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc8888 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.405864:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+37:3220:x1800404483024704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6480us (6629us total) trans 4294970226 rc 0/0 00000100:00100000:2.0:1716999794.405870:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10122 00000004:00080000:2.0:1716999794.405915:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131d5dc00/2, rc 0, transno 2930 00000100:00100000:2.0:1716999794.405928:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483024704:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1716999794.405938:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131d5d180/2, rc 0, transno 2928 00000100:00100000:2.0:1716999794.405940:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483024768:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.406047:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1716999794.406048:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483026688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.406054:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483026752:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.406068:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.406077:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.406092:0:8340:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483026688 00000100:00100000:2.0:1716999794.406096:0:8340:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483026688 00000100:00100000:2.0:1716999794.406108:0:8340:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483026752 00000100:00100000:2.0:1716999794.406110:0:8340:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483026752 00000100:00100000:2.0:1716999794.406119:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10137 00000100:00100000:2.0:1716999794.406123:0:8340:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3218:x1800404483026688:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999794.406129:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10138 00002000:00080000:2.0:1716999794.406133:0:8340:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1537 count 1 00000100:00100000:0.0:1716999794.406133:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+38:3220:x1800404483026752:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.406143:0:8340:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1716999794.406144:0:19200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:861 count 1 00010000:00010000:0.0:1716999794.406151:0:19200:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.406152:0:8340:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6568a expref: 51 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.406157:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.406158:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.406160:0:19200:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9440/0x6d188eabd8d70fcb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b959 expref: 51 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.406161:0:8340:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.406165:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.406166:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.406168:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.406175:0:8340:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6568a expref: 51 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.406180:0:19200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9440/0x6d188eabd8d70fcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b959 expref: 51 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.406183:0:8340:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6568a expref: 51 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.406187:0:19200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9440/0x6d188eabd8d70fcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b959 expref: 51 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.406191:0:8340:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8340:1800404483026816:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.406194:0:19200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483026880:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.406213:0:8340:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6600 going to sleep for 11 seconds 00000100:00100000:0.0:1716999794.406213:0:19200:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc9600 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.406546:0:19193:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0001_UUID:19193:1800404483025792:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.406562:0:19193:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.406566:0:19197:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19197:1800404483025536:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.406579:0:17697:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:17697:1800404483025664:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.406579:0:19197:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.406588:0:17697:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.406603:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483025728:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.407038:0:17700:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999794.407188:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131d5d880/2, rc 0, transno 2929 00000100:00100000:1.0:1716999794.407285:0:2535:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f49f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483026368:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.407298:0:2535:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.407329:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483024832:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.407441:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483026944:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.407464:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.407512:0:19209:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483026944 00000100:00100000:3.0:1716999794.407516:0:19209:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483026944 00000100:00100000:3.0:1716999794.407534:0:19209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10139 00000100:00100000:3.0:1716999794.407538:0:19209:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+39:3220:x1800404483026944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.407551:0:19209:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1533 count 1 00010000:00010000:3.0:1716999794.407562:0:19209:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.407570:0:19209:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6539d expref: 51 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.407575:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.407576:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.407578:0:19209:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.407591:0:19209:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6539d expref: 51 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.407598:0:19209:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6539d expref: 51 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.407605:0:19209:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:19209:1800404483027008:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.407628:0:19209:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219a80 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.410384:0:17474:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:17474:1800404483025856:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.410407:0:17474:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.410473:0:19195:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a5c12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0001_UUID:19195:1800404483025600:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.410488:0:19195:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.410585:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.410600:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.410613:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.410625:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.410638:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.410650:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.410662:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.410673:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.410682:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.410691:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.410791:0:19200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483026880:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.410803:0:19200:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.410872:0:17860:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f4bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:17860:1800404483026432:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.410909:0:17860:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.410931:0:21818:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f49c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:21818:1800404483026496:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.410941:0:21818:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.410963:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483025984:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.410971:0:15837:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.411024:0:8340:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8340:1800404483026816:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.411036:0:8340:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.411052:0:19205:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:19205:1800404483026304:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.411061:0:19205:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 3/0,1 mode: --/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.411119:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851264 00000100:00100000:3.0:1716999794.411124:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851264 00010000:00010000:3.0:1716999794.411144:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880132e6a400/0x6d188eabd8d712d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4babe expref: 49 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.411157:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851328 00000100:00100000:3.0:1716999794.411159:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851328 00010000:00010000:3.0:1716999794.411166:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099f27cc0/0x6d188eabd8d70fd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b967 expref: 50 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.411173:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851456 00000100:00100000:3.0:1716999794.411175:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851456 00010000:00010000:3.0:1716999794.411180:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9680/0x6d188eabd8d70f0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b90c expref: 52 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.411187:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851392 00000100:00100000:3.0:1716999794.411188:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851392 00010000:00010000:3.0:1716999794.411194:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9f80/0x6d188eabd8d70dda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b880 expref: 53 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.411201:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851584 00000100:00100000:3.0:1716999794.411202:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851584 00010000:00010000:3.0:1716999794.411208:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f26640/0x6d188eabd8d70d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b83a expref: 54 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.411215:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851520 00000100:00100000:3.0:1716999794.411217:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851520 00010000:00010000:3.0:1716999794.411224:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8000/0x6d188eabd8d70f3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b921 expref: 51 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.411231:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851712 00000100:00100000:3.0:1716999794.411233:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851712 00010000:00010000:3.0:1716999794.411239:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8b40/0x6d188eabd8d71233 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba71 expref: 55 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.411245:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851648 00000100:00100000:3.0:1716999794.411247:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851648 00010000:00010000:3.0:1716999794.411253:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65fb600/0x6d188eabd8d71106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9f3 expref: 56 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.411259:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851840 00000100:00100000:3.0:1716999794.411261:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851840 00010000:00010000:3.0:1716999794.411266:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8d80/0x6d188eabd8d70ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8db expref: 52 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.411273:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851776 00000100:00100000:3.0:1716999794.411275:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851776 00010000:00010000:3.0:1716999794.411280:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800911858c0/0x6d188eabd8d71241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba7f expref: 53 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.411290:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4640 00000100:00100000:3.0:1716999794.411295:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+53:1959:x1800404480851264:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.411305:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.411309:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880132e6a400/0x6d188eabd8d712d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4babe expref: 53 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411317:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880132e6a400/0x6d188eabd8d712d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4babe expref: 53 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411333:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e6a400/0x6d188eabd8d712d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x363:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4babe expref: 53 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411357:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411359:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411362:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411369:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411395:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.411425:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+52:1959:x1800404480851264:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 130us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.411431:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4640 00000100:00100000:3.0:1716999794.411443:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4641 00000100:00100000:3.0:1716999794.411446:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+51:1959:x1800404480851328:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.411452:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.411455:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099f27cc0/0x6d188eabd8d70fd9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b967 expref: 51 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411461:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099f27cc0/0x6d188eabd8d70fd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b967 expref: 51 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411470:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099f27cc0/0x6d188eabd8d70fd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b967 expref: 51 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411477:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411479:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411481:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411486:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411498:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.411511:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+50:1959:x1800404480851328:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 64us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.411516:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4641 00000100:00100000:3.0:1716999794.411526:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4642 00000100:00100000:3.0:1716999794.411531:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+56:1958:x1800404480851456:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.411537:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.411540:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9680/0x6d188eabd8d70f0e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b90c expref: 56 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411547:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9680/0x6d188eabd8d70f0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b90c expref: 56 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411558:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9680/0x6d188eabd8d70f0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b90c expref: 56 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411566:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411567:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411569:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411575:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411587:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.411599:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+55:1958:x1800404480851456:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 68us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.411603:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4642 00000100:00100000:3.0:1716999794.411612:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4643 00000100:00100000:3.0:1716999794.411615:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+54:1959:x1800404480851392:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.411620:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.411623:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9f80/0x6d188eabd8d70dda lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b880 expref: 54 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411629:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9f80/0x6d188eabd8d70dda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b880 expref: 54 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411637:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9f80/0x6d188eabd8d70dda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b880 expref: 54 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411644:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411645:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411648:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411653:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411664:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.411676:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+53:1959:x1800404480851392:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 60us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.411680:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4643 00000100:00100000:3.0:1716999794.411689:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4644 00000100:00100000:3.0:1716999794.411693:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+52:1958:x1800404480851584:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.411698:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.411701:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f26640/0x6d188eabd8d70d40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b83a expref: 52 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411707:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f26640/0x6d188eabd8d70d40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b83a expref: 52 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411719:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f26640/0x6d188eabd8d70d40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x359:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b83a expref: 52 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411725:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411726:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411729:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411734:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411744:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.411757:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aa3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+51:1958:x1800404480851584:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 63us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.411762:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4644 00000100:00100000:3.0:1716999794.411793:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4645 00000100:00100000:3.0:1716999794.411797:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+49:1959:x1800404480851520:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.411804:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.411808:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8000/0x6d188eabd8d70f3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b921 expref: 49 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411815:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8000/0x6d188eabd8d70f3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b921 expref: 49 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411824:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8000/0x6d188eabd8d70f3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b921 expref: 49 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411836:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411837:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411840:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411845:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411866:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.411899:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+48:1959:x1800404480851520:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 100us (1247us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.411904:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4645 00000100:00100000:3.0:1716999794.411915:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4646 00000100:00100000:3.0:1716999794.411918:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+50:1958:x1800404480851712:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.411924:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.411929:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8b40/0x6d188eabd8d71233 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba71 expref: 50 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411935:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8b40/0x6d188eabd8d71233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba71 expref: 50 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.411944:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411945:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.411947:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411957:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.411966:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.411978:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+50:1958:x1800404480851712:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 59us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.411983:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4646 00000100:00100000:3.0:1716999794.411991:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4647 00000100:00100000:3.0:1716999794.411994:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+49:1959:x1800404480851648:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.411999:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.412003:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a65fb600/0x6d188eabd8d71106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9f3 expref: 49 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.412010:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a65fb600/0x6d188eabd8d71106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9f3 expref: 49 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.412019:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65fb600/0x6d188eabd8d71106 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9f3 expref: 49 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.412026:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.412027:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.412029:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412035:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412050:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.412063:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+48:1959:x1800404480851648:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 67us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.412068:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4647 00000100:00100000:3.0:1716999794.412076:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4648 00000100:00100000:3.0:1716999794.412080:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+47:1958:x1800404480851840:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.412085:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.412089:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8d80/0x6d188eabd8d70ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8db expref: 47 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.412096:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8d80/0x6d188eabd8d70ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8db expref: 47 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.412104:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a65f8d80/0x6d188eabd8d70ea5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8db expref: 47 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.412110:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.412111:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.412113:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412118:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412129:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.412139:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+46:1958:x1800404480851840:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 58us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.412144:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4648 00000100:00100000:3.0:1716999794.412153:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4649 00000100:00100000:3.0:1716999794.412156:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+45:1959:x1800404480851776:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.412161:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.412165:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800911858c0/0x6d188eabd8d71241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba7f expref: 45 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.412171:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800911858c0/0x6d188eabd8d71241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba7f expref: 45 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.412179:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800911858c0/0x6d188eabd8d71241 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x362:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba7f expref: 45 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.412186:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.412187:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.412189:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412194:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412204:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.412213:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+44:1959:x1800404480851776:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 55us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.412217:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4649 00010000:00010000:3.0:1716999794.412232:0:19193:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412239:0:19193:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412247:0:19193:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412253:0:19193:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412259:0:19193:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412265:0:19193:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51200 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.412268:0:19193:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412275:0:19193:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412283:0:19193:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412287:0:19193:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c51200/0x6d188eabd8dc88b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.412515:0:19193:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+40:3219:x1800404483025408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10405us (10568us total) trans 4294970227 rc 0/0 00000100:00100000:3.0:1716999794.412522:0:19193:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10129 00010000:00010000:3.0:1716999794.412538:0:17697:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412545:0:17697:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412551:0:17697:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412557:0:17697:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412563:0:17697:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412568:0:17697:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.412570:0:17697:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412576:0:17697:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412585:0:17697:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412591:0:17697:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c50240/0x6d188eabd8dc88a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.412746:0:17697:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3217:x1800404483025024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10910us (11113us total) trans 4294970189 rc 0/0 00000100:00100000:3.0:1716999794.412752:0:17697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10127 00010000:00010000:3.0:1716999794.412768:0:19195:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412787:0:19195:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412793:0:19195:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412798:0:19195:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412804:0:19195:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412809:0:19195:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.412812:0:19195:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412817:0:19195:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412826:0:19195:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.412832:0:19195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c50480/0x6d188eabd8dc889d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.413006:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+40:3217:x1800404483025280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11288us (11404us total) trans 4294970228 rc 0/0 00000100:00100000:3.0:1716999794.413011:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10126 00010000:00010000:3.0:1716999794.413038:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f8b40/0x6d188eabd8d71233 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x361:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4ba71 expref: 47 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.413046:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483025920:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.413058:0:17365:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413065:0:17365:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413070:0:17365:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413077:0:17365:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413082:0:17365:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413092:0:17365:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413097:0:17365:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52ac0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.413099:0:17365:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413105:0:17365:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413113:0:17365:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413118:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c52ac0/0x6d188eabd8dc88c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.413266:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+40:3219:x1800404483025472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10928us (11269us total) trans 4294970229 rc 0/0 00000100:00100000:3.0:1716999794.413272:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10131 00010000:00010000:3.0:1716999794.413288:0:17700:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413295:0:17700:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413301:0:17700:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413307:0:17700:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413312:0:17700:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413316:0:17700:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c50000 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.413318:0:17700:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413323:0:17700:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413330:0:17700:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413335:0:17700:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c50000/0x6d188eabd8dc88ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.413457:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3217:x1800404483025344:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11458us (11804us total) trans 4294970230 rc 0/0 00000100:00100000:3.0:1716999794.413462:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10128 00000100:00100000:3.0:1716999794.413486:0:17473:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897af480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:17473:1800404483026624:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.413496:0:17473:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999794.413527:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995a1f80/2, rc 0, transno 2893 00000100:00100000:3.0:1716999794.413535:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483025024:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1716999794.413543:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092e7c380/2, rc 0, transno 2934 00000100:00100000:3.0:1716999794.413549:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483025344:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1716999794.413555:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092e7e680/2, rc 0, transno 2932 00000100:00100000:3.0:1716999794.413558:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483025280:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.413606:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483027072:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.413627:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.413637:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1716999794.413641:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483027136:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.413652:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.413664:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483027072 00000100:00100000:3.0:1716999794.413668:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483027072 00000100:00100000:3.0:1716999794.413680:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483027136 00000100:00100000:3.0:1716999794.413682:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483027136 00000100:00100000:3.0:1716999794.413689:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10140 00000100:00100000:3.0:1716999794.413693:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3217:x1800404483027072:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.413707:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:859 count 1 00010000:00010000:3.0:1716999794.413718:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413728:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9b00/0x6d188eabd8d70e97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8cd expref: 46 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413733:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.413735:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.413737:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413751:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9b00/0x6d188eabd8d70e97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8cd expref: 46 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413759:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9b00/0x6d188eabd8d70e97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8cd expref: 46 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.413766:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483027200:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.413799:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219000 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.413811:0:17697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10141 00000100:00100000:3.0:1716999794.413814:0:17697:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3217:x1800404483027136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.413823:0:17697:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:862 count 1 00010000:00010000:3.0:1716999794.413830:0:17697:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413838:0:17697:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091186400/0x6d188eabd8d7106c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ad expref: 46 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413842:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.413844:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.413845:0:17697:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413857:0:17697:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091186400/0x6d188eabd8d7106c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ad expref: 46 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.413866:0:17697:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091186400/0x6d188eabd8d7106c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ad expref: 46 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.413873:0:17697:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:17697:1800404483027264:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.413904:0:17697:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219180 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.413932:0:19209:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897adc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0001_UUID:19209:1800404483027008:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.413941:0:19209:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414013:0:19197:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414020:0:19197:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414026:0:19197:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414035:0:19197:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414039:0:19197:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414043:0:19197:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830000 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.414045:0:19197:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414049:0:19197:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414057:0:19197:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414062:0:19197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091830000/0x6d188eabd8dc8896 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.414191:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.414234:0:19197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b87cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+40:3219:x1800404483025088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12868us (13375us total) trans 4294970190 rc 0/0 00000100:00100000:2.0:1716999794.414240:0:19197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10125 00000100:00100000:0.0:1716999794.414247:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.414259:0:17474:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414264:0:17474:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.414269:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.414270:0:17474:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414275:0:17474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414280:0:17474:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414284:0:17474:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.414286:0:17474:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.414289:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.414291:0:17474:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414299:0:17474:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414304:0:17474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c51680/0x6d188eabd8dc88b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.414310:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.414338:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.414456:0:17474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3219:x1800404483025216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12256us (12476us total) trans 4294970231 rc 0/0 00000100:00100000:2.0:1716999794.414462:0:17474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10130 00010000:00010000:2.0:1716999794.414478:0:19205:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414485:0:19205:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414491:0:19205:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414497:0:19205:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414502:0:19205:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414507:0:19205:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.414509:0:19205:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414514:0:19205:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414522:0:19205:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.414528:0:19205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc88ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.414660:0:19205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+40:3218:x1800404483026048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11799us (11862us total) trans 4294970191 rc 0/0 00000100:00100000:2.0:1716999794.414666:0:19205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10133 00010000:00010000:1.0:1716999794.414725:0:2535:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414732:0:2535:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414743:0:2535:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414749:0:2535:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414754:0:2535:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414759:0:2535:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c900 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.414761:0:2535:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414767:0:2535:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414786:0:2535:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414792:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695c900/0x6d188eabd8dc88d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.414947:0:2535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+40:3218:x1800404483026112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12109us (12190us total) trans 4294970192 rc 0/0 00000100:00100000:1.0:1716999794.414953:0:2535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10132 00010000:00010000:1.0:1716999794.414969:0:15837:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414976:0:15837:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414983:0:15837:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414988:0:15837:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414994:0:15837:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.414998:0:15837:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.415001:0:15837:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415006:0:15837:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415014:0:15837:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415020:0:15837:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695c480/0x6d188eabd8dc88c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1716999794.415059:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995a0a80/2, rc 0, transno 2895 00000100:00100000:0.0:1716999794.415069:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483026048:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1716999794.415077:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995a0700/2, rc 0, transno 2896 00000100:00100000:0.0:1716999794.415079:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483026112:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.415110:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1716999794.415116:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483027456:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.415140:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3217:x1800404483024640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14216us (14947us total) trans 4294970193 rc 0/0 00000100:00100000:1.0:1716999794.415145:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10124 00000100:00100000:1.0:1716999794.415223:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483027328:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.415239:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1716999794.415256:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092e7df80/2, rc 0, transno 2935 00000100:00100000:1.0:1716999794.415262:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483025216:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999794.415262:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1716999794.415270:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092e7d180/2, rc 0, transno 2933 00000100:00100000:1.0:1716999794.415273:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483025472:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999794.415280:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092e7f100/2, rc 0, transno 2931 00000100:00100000:1.0:1716999794.415283:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483025408:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999794.415289:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995a1c00/2, rc 0, transno 2894 00000100:00100000:1.0:1716999794.415300:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483025088:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.415306:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1716999794.415310:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483027392:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.415324:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.415337:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483027520:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.415354:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.415364:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483027328 00000100:00100000:0.0:1716999794.415365:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1716999794.415367:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483027328 00000100:00100000:0.0:1716999794.415370:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483027712:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.415381:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483027456 00000100:00100000:1.0:1716999794.415383:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483027456 00000100:00100000:0.0:1716999794.415383:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.415391:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483027392 00000100:00100000:1.0:1716999794.415393:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483027392 00000100:00100000:1.0:1716999794.415401:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483027520 00000100:00100000:1.0:1716999794.415402:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483027520 00000100:00100000:1.0:1716999794.415408:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483027712 00000100:00100000:1.0:1716999794.415410:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483027712 00000100:00100000:0.0:1716999794.415412:0:19193:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10142 00000100:00100000:0.0:1716999794.415417:0:19193:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+43:3219:x1800404483027328:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.415420:0:2535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10143 00000100:00100000:1.0:1716999794.415423:0:2535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+43:3218:x1800404483027456:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1716999794.415429:0:19193:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:848 count 1 00002000:00080000:1.0:1716999794.415434:0:2535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:855 count 1 00010000:00010000:0.0:1716999794.415439:0:19193:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415443:0:2535:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.415451:0:19193:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012facfa80/0x6d188eabd8d70433 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4a5 expref: 43 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415452:0:2535:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fef1b00/0x6d188eabd8d70a7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b729 expref: 43 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.415456:0:19193:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.415457:0:19193:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.415458:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.415458:0:19193:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415460:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.415462:0:2535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.415474:0:19193:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012facfa80/0x6d188eabd8d70433 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4a5 expref: 43 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415476:0:2535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fef1b00/0x6d188eabd8d70a7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b729 expref: 43 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.415482:0:19193:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012facfa80/0x6d188eabd8d70433 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4a5 expref: 43 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.415483:0:2535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fef1b00/0x6d188eabd8d70a7d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b729 expref: 43 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.415490:0:19193:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:19193:1800404483027776:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.415492:0:2535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483027840:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.415511:0:19193:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc9600 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.415512:0:2535:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96900 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.415523:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10144 00000100:00100000:1.0:1716999794.415526:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+43:3219:x1800404483027392:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.415535:0:19195:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:854 count 1 00010000:00010000:1.0:1716999794.415542:0:19195:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415551:0:19195:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fef2400/0x6d188eabd8d709e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6e3 expref: 43 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415556:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.415558:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.415560:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415572:0:19195:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fef2400/0x6d188eabd8d709e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6e3 expref: 43 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415585:0:19195:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fef2400/0x6d188eabd8d709e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6e3 expref: 43 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.415596:0:19195:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19195:1800404483027904:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.415612:0:19195:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96240 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.415622:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10145 00000100:00100000:1.0:1716999794.415626:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+43:3218:x1800404483027520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.415635:0:15837:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:896 count 1 00010000:00010000:1.0:1716999794.415642:0:15837:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415651:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008b7ec480/0x6d188eabd8d72986 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c434 expref: 43 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415656:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.415658:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.415660:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415677:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008b7ec480/0x6d188eabd8d72986 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c434 expref: 43 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415685:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008b7ec480/0x6d188eabd8d72986 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c434 expref: 43 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.415692:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f4ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483027968:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.415714:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.415723:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483027584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.415738:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.415748:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1716999794.415752:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483027648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.415764:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.415789:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483027584 00000100:00100000:1.0:1716999794.415792:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483027584 00000100:00100000:0.0:1716999794.415793:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483027648 00000100:00100000:0.0:1716999794.415797:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483027648 00000100:00100000:1.0:1716999794.415805:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10146 00000100:00100000:1.0:1716999794.415809:0:8342:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+44:3218:x1800404483027712:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999794.415816:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10147 00002000:00080000:1.0:1716999794.415818:0:8342:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1523 count 1 00000100:00100000:0.0:1716999794.415820:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3219:x1800404483027584:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1716999794.415825:0:8342:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1716999794.415830:0:8341:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:894 count 1 00010000:00010000:1.0:1716999794.415834:0:8342:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc240/0x6d188eabd8dc2ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d8b expref: 46 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415839:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.415839:0:8341:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415841:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.415843:0:8342:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.415847:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800997c2ac0/0x6d188eabd8d727f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c393 expref: 46 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.415852:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.415853:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.415855:0:8342:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdc240/0x6d188eabd8dc2ff0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d8b expref: 46 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.415855:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415862:0:8342:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdc240/0x6d188eabd8dc2ff0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d8b expref: 46 pid: 15837 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.415868:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800997c2ac0/0x6d188eabd8d727f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c393 expref: 46 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.415870:0:8342:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb89180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483028032:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.415876:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800997c2ac0/0x6d188eabd8d727f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c393 expref: 46 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.415900:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092df0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8341:1800404483028096:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.415905:0:8342:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96840 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.415916:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10148 00000100:00100000:0.0:1716999794.415919:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc9d80 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.415920:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+44:3219:x1800404483027648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.415929:0:17864:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1529 count 1 00010000:00010000:1.0:1716999794.415936:0:17864:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415948:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f650d3 expref: 46 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415954:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.415955:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.415957:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415969:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f650d3 expref: 46 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.415979:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f650d3 expref: 46 pid: 19195 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.415986:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483028160:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.415999:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96300 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.416154:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851904 00000100:00100000:3.0:1716999794.416157:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851904 00010000:00010000:3.0:1716999794.416169:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f8e880/0x6d188eabd8d70e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b895 expref: 44 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.416186:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852032 00000100:00100000:3.0:1716999794.416188:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852032 00010000:00010000:3.0:1716999794.416195:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012facef40/0x6d188eabd8d704d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4eb expref: 45 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.416203:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480851968 00000100:00100000:3.0:1716999794.416205:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480851968 00010000:00010000:3.0:1716999794.416211:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012faced00/0x6d188eabd8d70399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b45f expref: 46 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.416219:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852096 00000100:00100000:3.0:1716999794.416220:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852096 00010000:00010000:3.0:1716999794.416228:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6568a expref: 47 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.416235:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852160 00000100:00100000:3.0:1716999794.416237:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852160 00010000:00010000:3.0:1716999794.416242:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9440/0x6d188eabd8d70fcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b959 expref: 48 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.416248:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852224 00000100:00100000:3.0:1716999794.416250:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852224 00010000:00010000:3.0:1716999794.416257:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6539d expref: 49 pid: 17864 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.416265:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4650 00000100:00100000:3.0:1716999794.416268:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+46:1959:x1800404480851904:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.416275:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.416278:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f8e880/0x6d188eabd8d70e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b895 expref: 46 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.416287:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f8e880/0x6d188eabd8d70e0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b895 expref: 46 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.416297:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f8e880/0x6d188eabd8d70e0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b895 expref: 46 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.416305:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.416306:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.416309:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.416320:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.416394:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4651 00000100:00100000:0.0:1716999794.416399:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+45:1959:x1800404480852032:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.416407:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.416412:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012facef40/0x6d188eabd8d704d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4eb expref: 45 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.416420:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012facef40/0x6d188eabd8d704d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4eb expref: 45 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.416430:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012facef40/0x6d188eabd8d704d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4eb expref: 45 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.416439:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.416440:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.416442:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.416448:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.416473:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.416488:0:17473:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.416493:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aa2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+44:1959:x1800404480852032:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 93us (2245us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999794.416494:0:17473:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.416499:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4651 00010000:00010000:2.0:1716999794.416500:0:17473:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.416506:0:17473:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.416511:0:17473:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.416511:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4652 00000100:00100000:0.0:1716999794.416515:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+43:1959:x1800404480851968:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.416516:0:17473:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c521c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.416518:0:17473:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.416521:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.416524:0:17473:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.416524:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012faced00/0x6d188eabd8d70399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b45f expref: 43 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.416531:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012faced00/0x6d188eabd8d70399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b45f expref: 43 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.416532:0:17473:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.416537:0:17473:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc88ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17473 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.416541:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012faced00/0x6d188eabd8d70399 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b45f expref: 43 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.416549:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.416550:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.416552:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.416558:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.416738:0:17473:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+44:3217:x1800404483026560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11806us (11860us total) trans 4294970194 rc 0/0 00000100:00100000:2.0:1716999794.416744:0:17473:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10136 00010000:00010000:3.0:1716999794.416864:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.416897:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+42:1959:x1800404480851904:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 627us (2706us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.416903:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4650 00000100:00100000:3.0:1716999794.416927:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4653 00000100:00100000:3.0:1716999794.416931:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+49:1959:x1800404480852096:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.416936:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.416940:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6568a expref: 49 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.416947:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6568a expref: 49 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.416957:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009216ed00/0x6d188eabd8dc4da9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x601:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 8192->12287) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6568a expref: 49 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.416964:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.416965:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.416967:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.416972:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.417749:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.417768:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+41:1959:x1800404480851968:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1251us (3496us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.417786:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4652 00000100:00100000:0.0:1716999794.417798:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4654 00000100:00100000:0.0:1716999794.417802:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+48:1958:x1800404480852160:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.417809:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.417813:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9440/0x6d188eabd8d70fcb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b959 expref: 48 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.417821:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9440/0x6d188eabd8d70fcb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b959 expref: 48 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.417831:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9440/0x6d188eabd8d70fcb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b959 expref: 48 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.417844:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.417845:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.417847:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.417853:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.417864:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.417877:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+47:1958:x1800404480852160:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 74us (3567us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.417894:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4654 00000100:00100000:0.0:1716999794.417905:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4655 00000100:00100000:0.0:1716999794.417909:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+46:1958:x1800404480852224:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.417916:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.417920:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6539d expref: 46 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.417926:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6539d expref: 46 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.417935:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090c96400/0x6d188eabd8dc4425 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 12288->16383) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6539d expref: 46 pid: 17864 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.417942:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.417943:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.417945:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.417950:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.417961:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.417975:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+45:1958:x1800404480852224:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 65us (3637us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.417980:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4655 00010000:00010000:0.0:1716999794.417994:0:19200:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.417999:0:19200:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.418004:0:19200:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.418010:0:19200:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.418016:0:19200:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.418020:0:19200:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e698c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.418023:0:19200:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.418031:0:19200:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.418038:0:19200:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.418043:0:19200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e698c0/0x6d188eabd8dc88f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.418832:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.418854:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+44:1959:x1800404480852096:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1921us (4562us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.418860:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4653 00000004:00080000:3.0:1716999794.418912:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800889ff800/2, rc 0, transno 2898 00000100:00100000:3.0:1716999794.418922:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483026560:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1716999794.418933:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995a2a00/2, rc 0, transno 2897 00000100:00100000:3.0:1716999794.418935:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483024640:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1716999794.419022:0:17860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419029:0:17860:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419037:0:17860:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419043:0:17860:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419049:0:17860:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419054:0:17860:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f840 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.419056:0:17860:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419062:0:17860:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419072:0:17860:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419078:0:17860:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695f840/0x6d188eabd8dc88dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.419159:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+45:3220:x1800404483026752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13023us (13080us total) trans 4294970232 rc 0/0 00000100:00100000:0.0:1716999794.419166:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10138 00000100:00100000:1.0:1716999794.419252:0:17860:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3219:x1800404483026176:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15627us (15666us total) trans 4294970195 rc 0/0 00000100:00100000:1.0:1716999794.419257:0:17860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10134 00000100:00100000:0.0:1716999794.419271:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999794.419276:0:21818:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419281:0:21818:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419286:0:21818:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.419288:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999794.419291:0:21818:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419297:0:21818:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419301:0:21818:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695d680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.419303:0:21818:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419309:0:21818:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419317:0:21818:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.419320:0:19193:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_012:lustre-OST0000_UUID:19193:1800404483027776:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.419323:0:21818:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc88e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.419334:0:19193:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.419465:0:21818:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+44:3219:x1800404483026240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15698us (15737us total) trans 4294970196 rc 0/0 00000100:00100000:1.0:1716999794.419470:0:21818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10135 00000100:00100000:0.0:1716999794.419487:0:8341:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8341:1800404483028096:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.419496:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483028160:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.419497:0:8341:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.419506:0:17864:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.419525:0:19195:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19195:1800404483027904:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.419564:0:8340:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.419571:0:8340:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.419577:0:8340:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.419583:0:8340:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.419589:0:8340:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.419593:0:8340:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.419595:0:8340:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.419601:0:8340:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.419609:0:8340:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.419615:0:8340:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091832640/0x6d188eabd8dc88f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x601:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.419762:0:8340:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3218:x1800404483026688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13637us (13693us total) trans 4294970233 rc 0/0 00000100:00100000:2.0:1716999794.419767:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10137 00000100:00100000:3.0:1716999794.419877:0:17697:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897af100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:17697:1800404483027264:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.419905:0:17697:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.419925:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483027200:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.419935:0:17365:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.419947:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852288 00000100:00100000:3.0:1716999794.419952:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852288 00010000:00010000:3.0:1716999794.419966:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9b00/0x6d188eabd8d70e97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8cd expref: 44 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.419980:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852352 00000100:00100000:3.0:1716999794.419982:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852352 00000100:00100000:0.0:1716999794.419984:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999794.419988:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091186400/0x6d188eabd8d7106c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ad expref: 45 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.419994:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.419999:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852416 00000100:00100000:0.0:1716999794.420000:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.420001:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852416 00000100:00100000:0.0:1716999794.420006:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999794.420007:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012facfa80/0x6d188eabd8d70433 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4a5 expref: 41 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.420012:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.420013:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852480 00000100:00100000:3.0:1716999794.420015:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852480 00000100:00100000:0.0:1716999794.420018:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999794.420021:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fef1b00/0x6d188eabd8d70a7d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b729 expref: 42 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.420028:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852544 00000100:00100000:0.0:1716999794.420028:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.420030:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852544 00010000:00010000:3.0:1716999794.420035:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800997c2ac0/0x6d188eabd8d727f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c393 expref: 46 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.420035:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852608 00000100:00100000:0.0:1716999794.420038:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852608 00000100:00100000:3.0:1716999794.420042:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852672 00000100:00100000:3.0:1716999794.420044:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852672 00010000:00010000:0.0:1716999794.420046:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fef2400/0x6d188eabd8d709e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6e3 expref: 44 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420050:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008b7ec480/0x6d188eabd8d72986 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c434 expref: 44 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.420054:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852736 00000100:00100000:0.0:1716999794.420055:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852736 00000100:00100000:3.0:1716999794.420057:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852800 00000100:00100000:3.0:1716999794.420058:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852800 00010000:00010000:0.0:1716999794.420059:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdc240/0x6d188eabd8dc2ff0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d8b expref: 47 pid: 15837 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420064:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f650d3 expref: 48 pid: 19195 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.420066:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4656 00000100:00100000:0.0:1716999794.420070:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+48:1959:x1800404480852288:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1716999794.420073:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4657 00010000:00010000:0.0:1716999794.420075:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1716999794.420077:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+48:1959:x1800404480852352:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.420078:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9b00/0x6d188eabd8d70e97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8cd expref: 48 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.420083:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9b00/0x6d188eabd8d70e97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8cd expref: 48 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420084:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.420087:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091186400/0x6d188eabd8d7106c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ad expref: 48 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.420091:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65f9b00/0x6d188eabd8d70e97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b8cd expref: 48 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420093:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091186400/0x6d188eabd8d7106c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ad expref: 48 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.420096:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.420097:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.420100:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420102:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091186400/0x6d188eabd8d7106c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b9ad expref: 47 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.420104:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420110:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420111:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420113:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420114:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.420118:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.420129:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+46:1959:x1800404480852288:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 58us (859us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999794.420130:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.420133:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4656 00000100:00100000:0.0:1716999794.420144:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4658 00000100:00100000:3.0:1716999794.420145:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+45:1959:x1800404480852352:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 67us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.420146:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+44:1959:x1800404480852416:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1716999794.420150:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4657 00010000:00010000:0.0:1716999794.420150:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.420153:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012facfa80/0x6d188eabd8d70433 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4a5 expref: 44 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.420157:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012facfa80/0x6d188eabd8d70433 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4a5 expref: 44 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.420159:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4659 00000100:00100000:3.0:1716999794.420163:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+44:1959:x1800404480852480:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.420164:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012facfa80/0x6d188eabd8d70433 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x350:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b4a5 expref: 44 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420169:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.420169:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.420170:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.420171:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420173:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fef1b00/0x6d188eabd8d70a7d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b729 expref: 43 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.420175:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420182:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.420184:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fef1b00/0x6d188eabd8d70a7d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b729 expref: 43 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.420187:0:19193:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420191:0:19193:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420193:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420194:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.420194:0:19193:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420196:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420197:0:19193:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420201:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420201:0:19193:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420203:0:19193:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e68fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.420205:0:19193:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420208:0:19193:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420209:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.420212:0:19193:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420217:0:19193:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8914 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19193 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.420221:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+43:1959:x1800404480852480:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 57us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.420226:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4659 00000100:00100000:3.0:1716999794.420235:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4660 00000100:00100000:3.0:1716999794.420238:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+44:1959:x1800404480852544:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.420244:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.420247:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800997c2ac0/0x6d188eabd8d727f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c393 expref: 44 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420254:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800997c2ac0/0x6d188eabd8d727f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c393 expref: 44 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420263:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800997c2ac0/0x6d188eabd8d727f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c393 expref: 44 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420275:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420277:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420279:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420285:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420296:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.420309:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+43:1959:x1800404480852544:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 69us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.420313:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4660 00000100:00100000:3.0:1716999794.420322:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4661 00000100:00100000:3.0:1716999794.420325:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+42:1957:x1800404480852608:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.420331:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.420335:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fef2400/0x6d188eabd8d709e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6e3 expref: 42 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420341:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fef2400/0x6d188eabd8d709e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6e3 expref: 42 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.420344:0:19193:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+44:3219:x1800404483027328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4927us (5104us total) trans 4294970197 rc 0/0 00000100:00100000:0.0:1716999794.420348:0:19193:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10142 00010000:00010000:3.0:1716999794.420349:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fef2400/0x6d188eabd8d709e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x356:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b6e3 expref: 42 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420355:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420356:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420358:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420359:0:17365:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420363:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420363:0:17365:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420367:0:17365:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420369:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.420370:0:17365:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420373:0:17365:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420376:0:17365:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51f80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.420377:0:17365:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420380:0:17365:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.420381:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+41:1957:x1800404480852608:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 55us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.420386:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4661 00010000:00010000:0.0:1716999794.420386:0:17365:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420389:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c51f80/0x6d188eabd8dc8906 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.420395:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4662 00000100:00100000:3.0:1716999794.420399:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+40:1958:x1800404480852672:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.420404:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.420407:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008b7ec480/0x6d188eabd8d72986 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c434 expref: 40 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420414:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008b7ec480/0x6d188eabd8d72986 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c434 expref: 40 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420421:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420423:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420424:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420429:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420435:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.420446:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+40:1958:x1800404480852672:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 47us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.420451:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4662 00000100:00100000:3.0:1716999794.420458:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4663 00000100:00100000:3.0:1716999794.420461:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+42:1959:x1800404480852736:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.420466:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.420470:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdc240/0x6d188eabd8dc2ff0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d8b expref: 42 pid: 15837 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420476:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdc240/0x6d188eabd8dc2ff0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d8b expref: 42 pid: 15837 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420484:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420485:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420487:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420492:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420499:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.420510:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+42:1959:x1800404480852736:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 48us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.420515:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4663 00000100:00100000:0.0:1716999794.420517:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3217:x1800404483027072:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6823us (6890us total) trans 4294970234 rc 0/0 00000100:00100000:0.0:1716999794.420521:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10140 00000100:00100000:3.0:1716999794.420523:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4664 00000100:00100000:3.0:1716999794.420527:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+41:1956:x1800404480852800:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.420533:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.420537:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f650d3 expref: 41 pid: 19195 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.420538:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aa1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+39:1959:x1800404480852416:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 390us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.420541:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4658 00010000:00010000:3.0:1716999794.420544:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f650d3 expref: 41 pid: 19195 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420553:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdd440/0x6d188eabd8dc3b6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f650d3 expref: 41 pid: 19195 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.420560:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420561:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.420563:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420567:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420578:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.420589:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+40:1956:x1800404480852800:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 61us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.420593:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4664 00010000:00010000:3.0:1716999794.420606:0:17697:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420612:0:17697:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420618:0:17697:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420624:0:17697:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420630:0:17697:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420634:0:17697:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53600 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.420637:0:17697:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420643:0:17697:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420650:0:17697:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.420656:0:17697:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c53600/0x6d188eabd8dc890d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1716999794.420721:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800889fce00/2, rc 0, transno 2936 00000100:00100000:2.0:1716999794.420729:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483026752:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.420734:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1716999794.420743:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483028288:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.420765:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.420814:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483028288 00000100:00100000:2.0:1716999794.420818:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483028352:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999794.420818:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483028288 00000100:00100000:2.0:1716999794.420833:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.420834:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10149 00000100:00100000:0.0:1716999794.420838:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+44:3220:x1800404483028288:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.420849:0:8340:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483028352 00000100:00100000:2.0:1716999794.420851:0:8340:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483028352 00002000:00080000:0.0:1716999794.420852:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:895 count 1 00010000:00010000:0.0:1716999794.420862:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.420864:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10150 00000100:00100000:2.0:1716999794.420868:0:8340:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+45:3220:x1800404483028352:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1716999794.420872:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f8d8c0/0x6d188eabd8d728e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3e7 expref: 38 pid: 17860 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1716999794.420877:0:8340:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:869 count 1 00010000:00010000:0.0:1716999794.420877:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.420893:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.420895:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.420899:0:8340:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.420907:0:8340:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f26880/0x6d188eabd8d71574 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbcf expref: 39 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.420912:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.420912:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f8d8c0/0x6d188eabd8d728e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3e7 expref: 38 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.420914:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.420916:0:8340:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.420921:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f8d8c0/0x6d188eabd8d728e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3e7 expref: 38 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.420929:0:8340:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f26880/0x6d188eabd8d71574 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbcf expref: 39 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.420930:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483028416:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.420936:0:8340:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f26880/0x6d188eabd8d71574 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbcf expref: 39 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.420943:0:8340:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8340:1800404483028480:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.420954:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc9600 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.420960:0:8340:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6600 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.421021:0:19195:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421028:0:19195:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421033:0:19195:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421044:0:19195:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421049:0:19195:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421054:0:19195:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421058:0:19195:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695dd40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.421061:0:19195:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421066:0:19195:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421074:0:19195:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421079:0:19195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8922 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.421227:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+45:3219:x1800404483027392:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5700us (5901us total) trans 4294970198 rc 0/0 00000100:00100000:1.0:1716999794.421233:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10144 00010000:00010000:1.0:1716999794.421249:0:17864:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421255:0:17864:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421261:0:17864:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421266:0:17864:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421271:0:17864:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421276:0:17864:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695ed00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.421278:0:17864:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421283:0:17864:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421291:0:17864:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421296:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695ed00/0x6d188eabd8dc893e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421335:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fef1b00/0x6d188eabd8d70a7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x357:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b729 expref: 38 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.421343:0:2535:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483027840:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.421352:0:2535:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421357:0:2535:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421361:0:2535:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421366:0:2535:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421371:0:2535:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421376:0:2535:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421381:0:2535:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695d440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.421383:0:2535:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421389:0:2535:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421408:0:2535:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421412:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc891b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.421554:0:2535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+45:3218:x1800404483027456:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6129us (6291us total) trans 4294970199 rc 0/0 00000100:00100000:1.0:1716999794.421559:0:2535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10143 00010000:00010000:1.0:1716999794.421584:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc240/0x6d188eabd8dc2ff0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->8191) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f64d8b expref: 39 pid: 15837 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.421595:0:8342:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb89180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483028032:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.421604:0:8342:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421610:0:8342:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421615:0:8342:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421621:0:8342:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421626:0:8342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421632:0:8342:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421636:0:8342:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695d200 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.421638:0:8342:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421644:0:8342:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421651:0:8342:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421656:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695d200/0x6d188eabd8dc8930 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421693:0:15837:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008b7ec480/0x6d188eabd8d72986 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c434 expref: 37 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.421702:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f4ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483027968:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.421711:0:15837:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421717:0:15837:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421726:0:15837:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421732:0:15837:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421737:0:15837:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421742:0:15837:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421746:0:15837:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f600 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.421748:0:15837:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421753:0:15837:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421760:0:15837:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.421765:0:15837:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8929 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.421833:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008fc1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483028416:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.421843:0:17365:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.421907:0:8340:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8340:1800404483028480:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.421916:0:8340:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.421946:0:8341:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.421953:0:8341:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.421959:0:8341:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.421964:0:8341:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.421970:0:8341:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.421974:0:8341:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69f80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.421976:0:8341:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.421981:0:8341:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.421990:0:8341:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.421994:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e69f80/0x6d188eabd8dc8937 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.422048:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000004:00080000:3.0:1716999794.422057:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800897af480/2, rc 0, transno 2938 00000100:00100000:2.0:1716999794.422087:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852928 00000100:00100000:2.0:1716999794.422090:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852928 00010000:00010000:2.0:1716999794.422100:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f26880/0x6d188eabd8d71574 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbcf expref: 39 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.422109:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.422112:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852864 00000100:00100000:2.0:1716999794.422114:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852864 00010000:00010000:2.0:1716999794.422119:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f8d8c0/0x6d188eabd8d728e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3e7 expref: 37 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.422124:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4665 00000100:00100000:0.0:1716999794.422128:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+39:1959:x1800404480852928:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1716999794.422129:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4666 00000100:00100000:2.0:1716999794.422133:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+37:1959:x1800404480852864:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.422135:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.422138:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.422140:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f26880/0x6d188eabd8d71574 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbcf expref: 39 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.422141:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f8d8c0/0x6d188eabd8d728e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3e7 expref: 37 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.422147:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f26880/0x6d188eabd8d71574 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbcf expref: 39 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.422148:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f8d8c0/0x6d188eabd8d728e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3e7 expref: 37 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.422157:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f8d8c0/0x6d188eabd8d728e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3e7 expref: 37 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.422157:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f26880/0x6d188eabd8d71574 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x365:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bbcf expref: 39 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.422164:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.422165:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.422165:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.422167:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.422168:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.422169:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422173:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.422174:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422185:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.422186:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999794.422203:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+36:1959:x1800404480852864:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 69us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.422204:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aa1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+38:1959:x1800404480852928:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 75us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.422208:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4666 00000100:00100000:0.0:1716999794.422212:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4665 00010000:00010000:2.0:1716999794.422221:0:17365:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422227:0:17365:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422236:0:17365:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422241:0:17365:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422247:0:17365:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422252:0:17365:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69b00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.422254:0:17365:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422260:0:17365:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422268:0:17365:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422273:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e69b00/0x6d188eabd8dc8945 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.422442:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3220:x1800404483028288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1603us (1675us total) trans 4294970200 rc 0/0 00000100:00100000:2.0:1716999794.422446:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10149 00000004:00080000:2.0:1716999794.422464:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800897ae680/2, rc 0, transno 2904 00000100:00100000:2.0:1716999794.422471:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483028288:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1716999794.422496:0:8340:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422502:0:8340:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422507:0:8340:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422512:0:8340:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422516:0:8340:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422520:0:8340:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831f80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.422522:0:8340:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422526:0:8340:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422533:0:8340:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.422538:0:8340:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091831f80/0x6d188eabd8dc894c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.422668:0:8340:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+46:3220:x1800404483028352:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1800us (1834us total) trans 4294970235 rc 0/0 00000100:00100000:2.0:1716999794.422673:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10150 00000004:00080000:2.0:1716999794.422687:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092e7fb80/2, rc 0, transno 2939 00000100:00100000:3.0:1716999794.422708:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483027072:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.422716:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483028544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.422733:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.422741:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1716999794.422745:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800897adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483028224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.422760:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1716999794.422790:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092df1500/2, rc 0, transno 2903 00000100:00100000:3.0:1716999794.422795:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483027456:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1716999794.422802:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800889fd880/2, rc 0, transno 2937 00000100:00100000:1.0:1716999794.422938:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+45:3218:x1800404483027520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7310us (7581us total) trans 4294970201 rc 0/0 00000100:00100000:1.0:1716999794.422944:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10145 00000100:00100000:1.0:1716999794.422953:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483028544 00000100:00100000:1.0:1716999794.422955:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483028544 00000100:00100000:1.0:1716999794.422978:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483028224 00000100:00100000:1.0:1716999794.422980:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483028224 00000100:00100000:1.0:1716999794.422990:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10151 00000100:00100000:1.0:1716999794.422993:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+46:3217:x1800404483028544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.423005:0:15837:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:852 count 1 00010000:00010000:1.0:1716999794.423015:0:15837:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.423024:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c575440/0x6d188eabd8d708c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b665 expref: 35 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.423029:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.423031:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.423033:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.423047:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c575440/0x6d188eabd8d708c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b665 expref: 35 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.423055:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c575440/0x6d188eabd8d708c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b665 expref: 35 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.423062:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb89180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483028608:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.423082:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1716999794.423135:0:2535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10152 00000100:00100000:0.0:1716999794.423140:0:2535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+46:3217:x1800404483028224:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1716999794.423157:0:2535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:856 count 1 00010000:00010000:0.0:1716999794.423167:0:2535:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.423178:0:2535:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800920f8480/0x6d188eabd8d70b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b76f expref: 35 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.423184:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.423186:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.423188:0:2535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.423203:0:2535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800920f8480/0x6d188eabd8d70b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b76f expref: 35 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.423211:0:2535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800920f8480/0x6d188eabd8d70b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b76f expref: 35 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.423215:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+46:3219:x1800404483027648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7293us (7449us total) trans 4294970236 rc 0/0 00000100:00100000:0.0:1716999794.423218:0:2535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483028672:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.423221:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10148 00000100:00100000:0.0:1716999794.423238:0:2535:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.423355:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483028352:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.423416:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483028864:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.423434:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.423442:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1716999794.423446:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483028800:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.423458:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.423520:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483026688:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.423551:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880092e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483028736:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.423568:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1716999794.423899:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092df3100/2, rc 0, transno 2905 00000100:00100000:3.0:1716999794.423906:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483027520:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.423912:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1716999794.423916:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880099582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483028928:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.423932:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1716999794.423959:0:19209:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.423966:0:19209:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.423974:0:19209:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.423979:0:19209:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.423985:0:19209:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.423994:0:19209:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.423997:0:19209:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.424003:0:19209:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.424013:0:19209:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.424018:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c53180/0x6d188eabd8dc88ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.424092:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483028864 00000100:00100000:2.0:1716999794.424096:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483028864 00000100:00100000:2.0:1716999794.424113:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483028800 00000100:00100000:2.0:1716999794.424115:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483028800 00000100:00100000:2.0:1716999794.424127:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483028736 00000100:00100000:2.0:1716999794.424128:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483028736 00000100:00100000:2.0:1716999794.424138:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483028928 00000100:00100000:2.0:1716999794.424139:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483028928 00000100:00100000:2.0:1716999794.424149:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10153 00000100:00100000:2.0:1716999794.424152:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3220:x1800404483028864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.424162:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:867 count 1 00010000:00010000:2.0:1716999794.424171:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424180:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880132e68000/0x6d188eabd8d71440 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb3c expref: 37 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424190:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.424192:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.424193:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424209:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880132e68000/0x6d188eabd8d71440 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb3c expref: 37 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424217:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880132e68000/0x6d188eabd8d71440 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb3c expref: 37 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.424225:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483028992:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.424252:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6600 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.424265:0:21818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10154 00000100:00100000:2.0:1716999794.424269:0:21818:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b87c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+49:3220:x1800404483028800:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.424278:0:17860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10155 00002000:00080000:2.0:1716999794.424279:0:21818:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:896 count 1 00000100:00100000:1.0:1716999794.424283:0:17860:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3218:x1800404483028736:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.424286:0:21818:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1716999794.424293:0:17860:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:868 count 1 00010000:00010000:2.0:1716999794.424295:0:21818:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a65fa1c0/0x6d188eabd8d7297f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c42d expref: 37 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424300:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.424301:0:17860:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424302:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.424303:0:21818:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.424309:0:17860:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099f27180/0x6d188eabd8d714da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb82 expref: 37 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.424313:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.424314:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.424316:0:17860:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424321:0:21818:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a65fa1c0/0x6d188eabd8d7297f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c42d expref: 37 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424328:0:21818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a65fa1c0/0x6d188eabd8d7297f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c42d expref: 37 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.424329:0:17860:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099f27180/0x6d188eabd8d714da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb82 expref: 37 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.424334:0:21818:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:21818:1800404483029056:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.424335:0:17860:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099f27180/0x6d188eabd8d714da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb82 expref: 37 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.424342:0:17860:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:17860:1800404483029120:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.424351:0:21818:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.424359:0:17860:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96840 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.424368:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10156 00000100:00100000:2.0:1716999794.424372:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+47:3218:x1800404483028928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1716999794.424381:0:19200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:853 count 1 00000004:00080000:1.0:1716999794.424389:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880129f4a300/2, rc 0, transno 2940 00010000:00010000:2.0:1716999794.424390:0:19200:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.424396:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483027648:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.424398:0:19200:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fef0fc0/0x6d188eabd8d70949 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b69d expref: 35 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424402:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.424403:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.424405:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999794.424405:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092df2d80/2, rc 0, transno 2902 00000100:00100000:1.0:1716999794.424408:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092df2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483027392:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1716999794.424414:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6948700/2, rc 0, transno 2901 00000100:00100000:1.0:1716999794.424416:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a6948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483027328:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1716999794.424417:0:19200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fef0fc0/0x6d188eabd8d70949 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b69d expref: 35 pid: 11262 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999794.424422:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb8b480/2, rc 0, transno 2900 00010000:00010000:2.0:1716999794.424423:0:19200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fef0fc0/0x6d188eabd8d70949 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b69d expref: 35 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.424424:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483026240:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1716999794.424429:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb8b800/2, rc 0, transno 2899 00000100:00100000:2.0:1716999794.424430:0:19200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:19200:1800404483029184:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.424431:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483026176:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.424445:0:19200:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.424483:0:8342:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3218:x1800404483027712:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8673us (9098us total) trans 4294970237 rc 0/0 00000100:00100000:1.0:1716999794.424488:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10146 00000100:00100000:2.0:1716999794.424495:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483029440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.424503:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483029312:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.424512:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.424520:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483029440 00000100:00100000:1.0:1716999794.424522:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483029440 00000100:00100000:2.0:1716999794.424526:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1716999794.424530:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483029248:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.424533:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10157 00000100:00100000:1.0:1716999794.424536:0:8342:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+48:3217:x1800404483029440:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.424541:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1716999794.424544:0:8342:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:842 count 1 00000100:00100000:1.0:1716999794.424555:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483029248 00000100:00100000:2.0:1716999794.424557:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483029504:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.424557:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483029248 00000100:00100000:1.0:1716999794.424567:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10158 00000100:00100000:2.0:1716999794.424568:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.424570:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+49:3217:x1800404483029248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.424576:0:17864:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:895 count 1 00000100:00100000:2.0:1716999794.424582:0:8340:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483029504 00010000:00010000:1.0:1716999794.424582:0:17864:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.424584:0:8340:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483029504 00010000:00010000:1.0:1716999794.424593:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f8cfc0/0x6d188eabd8d728ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3ee expref: 37 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.424596:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10159 00010000:00010000:1.0:1716999794.424598:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1716999794.424599:0:8340:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+49:3217:x1800404483029504:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1716999794.424599:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.424601:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1716999794.424607:0:8340:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:844 count 1 00010000:00010000:1.0:1716999794.424612:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131f8cfc0/0x6d188eabd8d728ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3ee expref: 37 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424615:0:8340:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.424618:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131f8cfc0/0x6d188eabd8d728ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3ee expref: 37 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.424623:0:8340:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f8f3c0/0x6d188eabd8d70089 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b339 expref: 35 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.424625:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483029632:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.424628:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.424629:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.424630:0:8340:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.424638:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96240 going to sleep for 11 seconds 00010000:00010000:2.0:1716999794.424647:0:8340:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f8f3c0/0x6d188eabd8d70089 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b339 expref: 35 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.424648:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1716999794.424653:0:8340:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f8f3c0/0x6d188eabd8d70089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b339 expref: 35 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.424656:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483029568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.424660:0:8340:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131caa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8340:1800404483029696:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.424668:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.424675:0:8340:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6000 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.424677:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1716999794.424681:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483029376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.424686:0:19205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483029312 00000100:00100000:2.0:1716999794.424689:0:19205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483029312 00000100:00100000:1.0:1716999794.424691:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.424700:0:19205:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483029568 00000100:00100000:2.0:1716999794.424701:0:19205:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483029568 00000100:00100000:1.0:1716999794.424703:0:19197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483029376 00000100:00100000:1.0:1716999794.424705:0:19197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483029376 00000100:00100000:2.0:1716999794.424709:0:19205:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10160 00000100:00100000:2.0:1716999794.424712:0:19205:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+52:3219:x1800404483029312:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.424715:0:19197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10161 00000100:00100000:1.0:1716999794.424718:0:19197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+52:3219:x1800404483029568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1716999794.424721:0:19205:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:897 count 1 00002000:00080000:1.0:1716999794.424727:0:19197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:843 count 1 00010000:00010000:2.0:1716999794.424728:0:19205:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.424734:0:19197:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424736:0:19205:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009215c6c0/0x6d188eabd8d729e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c45e expref: 35 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424740:0:19205:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.424741:0:19205:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.424742:0:19197:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f8f840/0x6d188eabd8d6ffe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2ec expref: 35 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424743:0:19205:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.424746:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.424748:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.424749:0:19197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424757:0:19205:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009215c6c0/0x6d188eabd8d729e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c45e expref: 35 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.424761:0:19197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f8f840/0x6d188eabd8d6ffe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2ec expref: 35 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.424764:0:19205:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009215c6c0/0x6d188eabd8d729e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c45e expref: 35 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.424767:0:19197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f8f840/0x6d188eabd8d6ffe8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2ec expref: 35 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.424783:0:19205:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:19205:1800404483029760:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.424787:0:19197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19197:1800404483029824:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.424799:0:19205:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.424802:0:19197:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96900 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.424811:0:17474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10162 00000100:00100000:2.0:1716999794.424815:0:17474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3219:x1800404483029376:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1716999794.424825:0:8342:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.424833:0:8342:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800920f8fc0/0x6d188eabd8d6ff39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b29f expref: 35 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.424837:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.424838:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.424840:0:8342:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.424852:0:8342:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800920f8fc0/0x6d188eabd8d6ff39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b29f expref: 35 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.424857:0:8342:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800920f8fc0/0x6d188eabd8d6ff39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b29f expref: 35 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.424874:0:8342:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8342:1800404483029888:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.424898:0:8342:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96300 going to sleep for 11 seconds 00000100:00100000:0.0:1716999794.425035:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.425064:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.425141:0:2535:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008fc1f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483028672:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.425153:0:2535:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999794.425528:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880129f49180/2, rc 0, transno 2941 00000100:00100000:3.0:1716999794.425547:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483027712:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.425560:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480852992 00000100:00100000:3.0:1716999794.425563:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480852992 00010000:00010000:3.0:1716999794.425575:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c575440/0x6d188eabd8d708c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b665 expref: 36 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.425588:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853056 00000100:00100000:3.0:1716999794.425590:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853056 00010000:00010000:3.0:1716999794.425596:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800920f8480/0x6d188eabd8d70b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b76f expref: 37 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.425606:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4667 00000100:00100000:3.0:1716999794.425611:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+37:1956:x1800404480852992:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.425617:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.425620:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c575440/0x6d188eabd8d708c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b665 expref: 37 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.425627:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c575440/0x6d188eabd8d708c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b665 expref: 37 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.425638:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.425640:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.425643:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.425648:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.425649:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+50:3219:x1800404483027584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9828us (9910us total) trans 4294970238 rc 0/0 00000100:00100000:1.0:1716999794.425654:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10147 00010000:00010000:3.0:1716999794.425658:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.425678:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+37:1956:x1800404480852992:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 65us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.425683:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4667 00000100:00100000:3.0:1716999794.425693:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4668 00000100:00100000:3.0:1716999794.425696:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+36:1956:x1800404480853056:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.425702:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.425706:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800920f8480/0x6d188eabd8d70b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b76f expref: 36 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.425713:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800920f8480/0x6d188eabd8d70b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b76f expref: 36 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.425723:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800920f8480/0x6d188eabd8d70b17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x358:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b76f expref: 36 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.425731:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.425732:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.425735:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.425740:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.425751:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.425910:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+35:1956:x1800404480853056:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 211us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.425915:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4668 00000100:00100000:1.0:1716999794.425922:0:17697:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3217:x1800404483027136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12106us (12267us total) trans 4294970239 rc 0/0 00002000:00080000:2.0:1716999794.425923:0:17474:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:845 count 1 00000100:00100000:1.0:1716999794.425927:0:17697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10141 00010000:00010000:3.0:1716999794.425928:0:2535:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.425932:0:17474:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.425935:0:2535:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.425940:0:17474:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800920f8d80/0x6d188eabd8d70123 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b37f expref: 34 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.425941:0:2535:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.425945:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.425946:0:2535:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999794.425951:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880129f49f80/2, rc 0, transno 2942 00010000:00010000:3.0:1716999794.425956:0:2535:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.425956:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483027584:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.425959:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1716999794.425961:0:2535:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6af40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.425964:0:2535:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.425964:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483029952:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999794.425971:0:2535:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.425978:0:2535:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1716999794.425981:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800897ae300/2, rc 0, transno 2943 00010000:00010000:3.0:1716999794.425984:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e6af40/0x6d188eabd8dc895a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.425985:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.425985:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483027136:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.426017:0:17697:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483029952 00000100:00100000:1.0:1716999794.426019:0:17697:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483029952 00000100:00100000:1.0:1716999794.426030:0:17697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10163 00000100:00100000:1.0:1716999794.426032:0:17697:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3219:x1800404483029952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.426041:0:17697:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:893 count 1 00010000:00010000:1.0:1716999794.426050:0:17697:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426058:0:17697:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800997c3cc0/0x6d188eabd8d7265a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c307 expref: 37 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426063:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.426064:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.426066:0:17697:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426079:0:17697:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800997c3cc0/0x6d188eabd8d7265a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c307 expref: 37 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426086:0:17697:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800997c3cc0/0x6d188eabd8d7265a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c307 expref: 37 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.426093:0:17697:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:17697:1800404483030144:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.426108:0:17697:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96480 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.426116:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483030080:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.426129:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.426138:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1716999794.426141:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483030016:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.426151:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1716999794.426157:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.426160:0:17474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.426161:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483030080 00000100:00100000:1.0:1716999794.426163:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483030080 00000100:00100000:1.0:1716999794.426173:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483030016 00000100:00100000:1.0:1716999794.426174:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483030016 00010000:00010000:2.0:1716999794.426176:0:17474:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800920f8d80/0x6d188eabd8d70123 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b37f expref: 34 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.426182:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10164 00010000:00010000:2.0:1716999794.426184:0:17474:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800920f8d80/0x6d188eabd8d70123 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b37f expref: 34 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.426185:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+52:3218:x1800404483030080:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.426192:0:17474:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:17474:1800404483030208:192.168.203.3@tcp:104: 00002000:00080000:1.0:1716999794.426193:0:17700:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:843 count 1 00010000:00010000:1.0:1716999794.426200:0:17700:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426207:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920f9440/0x6d188eabd8d70020 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b308 expref: 37 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.426209:0:17474:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6180 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.426212:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.426213:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.426214:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.426222:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10165 00010000:00010000:1.0:1716999794.426226:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920f9440/0x6d188eabd8d70020 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b308 expref: 37 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.426227:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+52:3218:x1800404483030016:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1716999794.426232:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920f9440/0x6d188eabd8d70020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b308 expref: 37 pid: 11262 timeout: 413 lvb_type: 0 00002000:00080000:2.0:1716999794.426236:0:19196:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:841 count 1 00000100:00100000:1.0:1716999794.426238:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483030272:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.426245:0:19196:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.426252:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f8e400/0x6d188eabd8d6ff2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b291 expref: 37 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.426252:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96780 going to sleep for 11 seconds 00010000:00010000:2.0:1716999794.426257:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.426258:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.426259:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426270:0:15837:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c575440/0x6d188eabd8d708c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b665 expref: 34 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.426272:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131f8e400/0x6d188eabd8d6ff2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b291 expref: 37 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.426277:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb89180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483028608:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.426279:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131f8e400/0x6d188eabd8d6ff2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b291 expref: 37 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.426287:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:19196:1800404483030336:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.426287:0:15837:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426292:0:15837:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426297:0:15837:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426302:0:15837:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.426303:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6a80 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.426306:0:15837:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426311:0:15837:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426315:0:15837:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695ef40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.426317:0:15837:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426322:0:15837:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426329:0:15837:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.426333:0:15837:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8953 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.426429:0:2535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+53:3217:x1800404483028224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3289us (3668us total) trans 4294970202 rc 0/0 00000100:00100000:3.0:1716999794.426435:0:2535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10152 00000100:00100000:3.0:1716999794.426550:0:19209:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+53:3220:x1800404483026944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19010us (19085us total) trans 4294970240 rc 0/0 00000100:00100000:3.0:1716999794.426555:0:19209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10139 00000100:00100000:1.0:1716999794.426590:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3217:x1800404483028544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3596us (3855us total) trans 4294970203 rc 0/0 00000100:00100000:1.0:1716999794.426595:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10151 00000004:00080000:2.0:1716999794.427200:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800897adc00/2, rc 0, transno 2906 00000100:00100000:2.0:1716999794.427216:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800897adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483028224:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1716999794.427224:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092e7c000/2, rc 0, transno 2907 00000100:00100000:2.0:1716999794.427226:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483028544:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1716999794.427238:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800889fc380/2, rc 0, transno 2944 00000100:00100000:2.0:1716999794.427250:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483026944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.427367:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1716999794.427376:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008b9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483030528:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.427380:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483030464:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.427397:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.427413:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.427424:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1716999794.427426:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483030528 00000100:00100000:3.0:1716999794.427429:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008fc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483030400:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.427429:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483030528 00000100:00100000:3.0:1716999794.427443:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.427443:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483030464 00000100:00100000:1.0:1716999794.427444:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483030464 00000100:00100000:1.0:1716999794.427452:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483030400 00000100:00100000:1.0:1716999794.427454:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483030400 00000100:00100000:3.0:1716999794.427457:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10166 00000100:00100000:3.0:1716999794.427461:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+54:3218:x1800404483030528:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.427463:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10167 00000100:00100000:1.0:1716999794.427466:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800897ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3220:x1800404483030464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.427472:0:19195:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:887 count 1 00002000:00080000:1.0:1716999794.427473:0:15837:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:842 count 1 00010000:00010000:3.0:1716999794.427482:0:19195:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.427482:0:15837:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.427492:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c576ac0/0x6d188eabd8d6ffa2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2d0 expref: 37 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.427493:0:19195:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a8901200/0x6d188eabd8d721f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c11d expref: 33 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.427498:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.427498:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.427499:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.427500:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.427501:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.427501:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.427515:0:19195:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a8901200/0x6d188eabd8d721f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c11d expref: 33 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.427515:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c576ac0/0x6d188eabd8d6ffa2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2d0 expref: 37 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.427522:0:19195:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a8901200/0x6d188eabd8d721f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c11d expref: 33 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.427522:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c576ac0/0x6d188eabd8d6ffa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2d0 expref: 37 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.427530:0:19195:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a694a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19195:1800404483030592:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.427530:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15837:1800404483030656:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.427551:0:19195:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219180 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.427552:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.427563:0:2535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10168 00000100:00100000:3.0:1716999794.427566:0:2535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+54:3220:x1800404483030400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.427575:0:2535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:886 count 1 00010000:00010000:3.0:1716999794.427583:0:2535:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.427592:0:2535:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8801339fad00/0x6d188eabd8d72159 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0d7 expref: 33 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.427597:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.427598:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.427600:0:2535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 4/0,1 mode: --/PW res: [0x240000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.427612:0:2535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8801339fad00/0x6d188eabd8d72159 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0d7 expref: 33 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.427619:0:2535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8801339fad00/0x6d188eabd8d72159 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0d7 expref: 33 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.427626:0:2535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6949880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483030720:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.427642:0:2535:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219d80 going to sleep for 11 seconds 00000100:00100000:0.0:1716999794.429222:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.429223:0:19200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:19200:1800404483029184:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.429240:0:19200:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.429260:0:21818:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:21818:1800404483029056:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.429268:0:21818:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.429277:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.429289:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.429302:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.429308:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853120 00000100:00100000:2.0:1716999794.429312:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853120 00000100:00100000:0.0:1716999794.429314:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.429328:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fef0fc0/0x6d188eabd8d70949 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b69d expref: 34 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.429337:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483028992:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.429343:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853248 00000100:00100000:2.0:1716999794.429345:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853248 00010000:00010000:3.0:1716999794.429348:0:17365:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.429352:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a65fa1c0/0x6d188eabd8d7297f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c42d expref: 38 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.429362:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853184 00000100:00100000:2.0:1716999794.429364:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853184 00010000:00010000:2.0:1716999794.429370:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880132e68000/0x6d188eabd8d71440 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb3c expref: 39 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.429521:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999794.429563:0:17860:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb8bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:17860:1800404483029120:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.429578:0:17860:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.429592:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483029632:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.429599:0:17864:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.429610:0:17697:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:17697:1800404483030144:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.429617:0:17697:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.429631:0:19197:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f4aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19197:1800404483029824:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.429639:0:19197:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.429700:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853376 00000100:00100000:3.0:1716999794.429701:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853312 00000100:00100000:2.0:1716999794.429703:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853376 00000100:00100000:3.0:1716999794.429705:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853312 00010000:00010000:2.0:1716999794.429713:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099f27180/0x6d188eabd8d714da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb82 expref: 41 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.429714:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999794.429718:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131f8cfc0/0x6d188eabd8d728ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3ee expref: 41 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.429723:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853440 00000100:00100000:0.0:1716999794.429724:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.429725:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853440 00010000:00010000:2.0:1716999794.429732:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f8f3c0/0x6d188eabd8d70089 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b339 expref: 35 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.429734:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853568 00000100:00100000:0.0:1716999794.429734:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.429736:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853568 00000100:00100000:2.0:1716999794.429740:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853504 00000100:00100000:2.0:1716999794.429742:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853504 00010000:00010000:3.0:1716999794.429743:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800920f8fc0/0x6d188eabd8d6ff39 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b29f expref: 36 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.429749:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f8f840/0x6d188eabd8d6ffe8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2ec expref: 37 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.429751:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853632 00000100:00100000:3.0:1716999794.429752:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853632 00010000:00010000:3.0:1716999794.429759:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800997c3cc0/0x6d188eabd8d7265a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c307 expref: 42 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.429759:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4669 00000100:00100000:0.0:1716999794.429761:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.429763:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+37:1959:x1800404480853120:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1716999794.429767:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853696 00000100:00100000:0.0:1716999794.429781:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.429783:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1716999794.429784:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853696 00010000:00010000:2.0:1716999794.429787:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fef0fc0/0x6d188eabd8d70949 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b69d expref: 38 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.429793:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009215c6c0/0x6d188eabd8d729e8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c45e expref: 38 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.429793:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.429795:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fef0fc0/0x6d188eabd8d70949 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b69d expref: 38 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.429801:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.429802:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853824 00000100:00100000:3.0:1716999794.429804:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853824 00010000:00010000:3.0:1716999794.429810:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a8901200/0x6d188eabd8d721f3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c11d expref: 39 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.429810:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fef0fc0/0x6d188eabd8d70949 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x355:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b69d expref: 39 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.429810:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.429818:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853952 00000100:00100000:0.0:1716999794.429818:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.429820:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853952 00010000:00010000:2.0:1716999794.429829:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.429830:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.429833:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.429843:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.429847:0:2535:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a6949880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483030720:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.429851:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.429856:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.429857:0:2535:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.429862:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854080 00000100:00100000:0.0:1716999794.429865:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854080 00010000:00010000:0.0:1716999794.429874:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8801339fad00/0x6d188eabd8d72159 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0d7 expref: 39 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.429875:0:19195:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a694a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19195:1800404483030592:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.429895:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a691180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+39:1959:x1800404480853120:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 113us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.429901:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4669 00010000:00010000:3.0:1716999794.429902:0:19195:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.429902:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853760 00000100:00100000:0.0:1716999794.429904:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853760 00010000:00010000:0.0:1716999794.429910:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131f8e400/0x6d188eabd8d6ff2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b291 expref: 44 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.429911:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480853888 00000100:00100000:2.0:1716999794.429913:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480853888 00000100:00100000:0.0:1716999794.429917:0:25864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854016 00010000:00010000:2.0:1716999794.429919:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800920f8d80/0x6d188eabd8d70123 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b37f expref: 39 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.429919:0:25864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854016 00010000:00010000:0.0:1716999794.429925:0:25864:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c576ac0/0x6d188eabd8d6ffa2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2d0 expref: 45 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.429928:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4670 00000100:00100000:2.0:1716999794.429932:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+45:1958:x1800404480853248:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1716999794.429933:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4671 00010000:00010000:2.0:1716999794.429937:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1716999794.429937:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+45:1959:x1800404480853184:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.429941:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a65fa1c0/0x6d188eabd8d7297f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c42d expref: 45 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.429941:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.429944:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880132e68000/0x6d188eabd8d71440 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb3c expref: 45 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.429948:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a65fa1c0/0x6d188eabd8d7297f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c42d expref: 45 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.429950:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880132e68000/0x6d188eabd8d71440 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb3c expref: 45 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.429959:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a65fa1c0/0x6d188eabd8d7297f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c42d expref: 45 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.429959:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e68000/0x6d188eabd8d71440 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x363:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb3c expref: 45 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.429966:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.429967:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1716999794.429969:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4672 00010000:00010000:2.0:1716999794.429970:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.429972:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1716999794.429973:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880136aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+43:1958:x1800404480853376:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.429973:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.429975:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.429975:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.429980:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.429980:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.429984:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099f27180/0x6d188eabd8d714da lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb82 expref: 43 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.429986:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.429989:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.429992:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099f27180/0x6d188eabd8d714da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb82 expref: 43 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.429994:0:21818:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.429999:0:21818:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.430002:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099f27180/0x6d188eabd8d714da lrc: 0/0,0 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bb82 expref: 43 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.430004:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+43:1959:x1800404480853184:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 66us (714us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999794.430006:0:21818:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.430009:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1716999794.430009:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4671 00010000:00010000:3.0:1716999794.430011:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.430012:0:21818:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.430013:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.430017:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4673 00010000:00010000:3.0:1716999794.430018:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.430018:0:21818:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.430020:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+41:1959:x1800404480853312:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.430024:0:21818:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832400 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.430025:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.430027:0:21818:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430028:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131f8cfc0/0x6d188eabd8d728ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3ee expref: 41 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.430030:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.430033:0:21818:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430035:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131f8cfc0/0x6d188eabd8d728ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3ee expref: 41 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.430043:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131f8cfc0/0x6d188eabd8d728ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c3ee expref: 41 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.430044:0:21818:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.430046:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880136aa1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+41:1958:x1800404480853376:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 72us (743us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999794.430049:0:21818:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091832400/0x6d188eabd8dc8968 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x380:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430050:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.430051:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1716999794.430052:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4672 00010000:00010000:0.0:1716999794.430053:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430058:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.430064:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4674 00010000:00010000:0.0:1716999794.430067:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.430068:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+39:1959:x1800404480853440:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.430074:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.430077:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f8f3c0/0x6d188eabd8d70089 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b339 expref: 39 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.430078:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+39:1959:x1800404480853312:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 57us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.430083:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4673 00010000:00010000:3.0:1716999794.430085:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f8f3c0/0x6d188eabd8d70089 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b339 expref: 39 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.430093:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4675 00010000:00010000:3.0:1716999794.430095:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1716999794.430096:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+39:1959:x1800404480853568:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.430097:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.430099:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430101:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.430105:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800920f8fc0/0x6d188eabd8d6ff39 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b29f expref: 39 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.430106:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430111:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800920f8fc0/0x6d188eabd8d6ff39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b29f expref: 39 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.430115:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.430119:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.430120:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.430123:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430127:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.430129:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+39:1959:x1800404480853440:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 60us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.430134:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4674 00010000:00010000:0.0:1716999794.430134:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.430144:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4676 00000100:00100000:0.0:1716999794.430145:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+38:1959:x1800404480853568:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 48us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.430148:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+38:1959:x1800404480853504:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1716999794.430150:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4675 00010000:00010000:3.0:1716999794.430153:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.430157:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f8f840/0x6d188eabd8d6ffe8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2ec expref: 37 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.430158:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4677 00000100:00100000:0.0:1716999794.430162:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+38:1959:x1800404480853632:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.430166:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.430167:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f8f840/0x6d188eabd8d6ffe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2ec expref: 37 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.430170:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800997c3cc0/0x6d188eabd8d7265a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c307 expref: 38 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.430176:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f8f840/0x6d188eabd8d6ffe8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2ec expref: 37 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.430176:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800997c3cc0/0x6d188eabd8d7265a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c307 expref: 38 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.430183:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.430184:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800997c3cc0/0x6d188eabd8d7265a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c307 expref: 38 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.430185:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.430187:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430191:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.430192:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430192:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.430194:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430199:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.430204:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.430209:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.430218:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+36:1959:x1800404480853504:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 68us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.430221:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+37:1959:x1800404480853632:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 58us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.430222:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4676 00000100:00100000:0.0:1716999794.430225:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4677 00000100:00100000:3.0:1716999794.430232:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4678 00000100:00100000:3.0:1716999794.430235:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+35:1959:x1800404480853696:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1716999794.430236:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4679 00000100:00100000:0.0:1716999794.430239:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+35:1959:x1800404480853824:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.430242:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.430245:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.430246:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009215c6c0/0x6d188eabd8d729e8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c45e expref: 35 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.430247:0:21818:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b87c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+54:3220:x1800404483028800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5976us (6787us total) trans 4294970241 rc 0/0 00010000:00010000:0.0:1716999794.430248:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a8901200/0x6d188eabd8d721f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c11d expref: 35 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.430252:0:21818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10154 00010000:00010000:3.0:1716999794.430253:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009215c6c0/0x6d188eabd8d729e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c45e expref: 35 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.430255:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a8901200/0x6d188eabd8d721f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c11d expref: 35 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.430263:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a8901200/0x6d188eabd8d721f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c11d expref: 35 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.430267:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.430269:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.430270:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.430271:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430271:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1716999794.430272:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092df0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+36:1958:x1800404480853248:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 339us (994us total) trans 0 rc 0/0 00010000:00010000:0.0:1716999794.430273:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.430276:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4670 00010000:00010000:3.0:1716999794.430277:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430278:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.430285:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.430288:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.430295:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+34:1959:x1800404480853696:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 59us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.430297:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+34:1959:x1800404480853824:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 57us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.430298:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4680 00000100:00100000:3.0:1716999794.430301:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4678 00000100:00100000:2.0:1716999794.430302:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+34:1959:x1800404480854080:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.430306:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.430310:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8801339fad00/0x6d188eabd8d72159 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0d7 expref: 33 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.430317:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8801339fad00/0x6d188eabd8d72159 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0d7 expref: 33 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.430326:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8801339fad00/0x6d188eabd8d72159 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x376:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0d7 expref: 33 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.430332:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1716999794.430333:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483030272:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.430334:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.430336:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.430341:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430343:0:17700:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.430351:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999794.430354:0:17864:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430359:0:17864:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.430360:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+32:1959:x1800404480854080:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 58us (558us total) trans 0 rc 0/0 00010000:00010000:1.0:1716999794.430366:0:17864:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430371:0:17864:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430376:0:17864:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430380:0:17864:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c6c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.430382:0:17864:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430387:0:17864:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430393:0:17864:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430398:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc897d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.430525:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+54:3217:x1800404483029248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5954us (5982us total) trans 4294970242 rc 0/0 00000100:00100000:1.0:1716999794.430530:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10158 00010000:00010000:1.0:1716999794.430542:0:17860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430547:0:17860:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430552:0:17860:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430557:0:17860:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430561:0:17860:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430565:0:17860:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695fcc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.430567:0:17860:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430572:0:17860:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430578:0:17860:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430584:0:17860:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc896f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.430727:0:17860:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+54:3218:x1800404483028736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6443us (7157us total) trans 4294970243 rc 0/0 00000100:00100000:1.0:1716999794.430731:0:17860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10155 00010000:00010000:1.0:1716999794.430796:0:17697:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430802:0:17697:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430807:0:17697:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430812:0:17697:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430817:0:17697:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430821:0:17697:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695d680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.430823:0:17697:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430828:0:17697:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430837:0:17697:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.430842:0:17697:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695d680/0x6d188eabd8dc89a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x37d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.430854:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4679 00000100:00100000:0.0:1716999794.430900:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4681 00000100:00100000:0.0:1716999794.430904:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+35:1959:x1800404480853760:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.430909:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.430913:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131f8e400/0x6d188eabd8d6ff2b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b291 expref: 35 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.430920:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131f8e400/0x6d188eabd8d6ff2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b291 expref: 35 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.430929:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.430930:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.430933:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430938:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430946:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.430956:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+35:1959:x1800404480853760:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 52us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.430961:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4681 00000100:00100000:0.0:1716999794.430970:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4682 00000100:00100000:0.0:1716999794.430973:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+31:1959:x1800404480853888:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1716999794.430979:0:17697:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3219:x1800404483029952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4946us (4998us total) trans 4294970244 rc 0/0 00010000:00010000:0.0:1716999794.430979:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.430982:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800920f8d80/0x6d188eabd8d70123 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b37f expref: 31 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.430984:0:17697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10163 00010000:00010000:0.0:1716999794.430989:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800920f8d80/0x6d188eabd8d70123 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b37f expref: 31 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.430996:0:19197:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.430997:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.430998:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.431001:0:19197:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.431001:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431007:0:19197:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.431007:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431012:0:19197:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.431014:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999794.431017:0:19197:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431022:0:19197:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695d8c0 already unused, calling callback (ffffffffa0864a40) 00000100:00100000:0.0:1716999794.431022:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+31:1959:x1800404480853888:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 48us (1203us total) trans 0 rc 0/0 00010000:00010000:1.0:1716999794.431024:0:19197:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.431026:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4682 00010000:00010000:1.0:1716999794.431030:0:19197:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.431034:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4683 00000100:00100000:0.0:1716999794.431037:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+34:1959:x1800404480854016:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.431038:0:19197:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.431042:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.431043:0:19197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8992 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.431045:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c576ac0/0x6d188eabd8d6ffa2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2d0 expref: 34 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.431051:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c576ac0/0x6d188eabd8d6ffa2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2d0 expref: 34 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.431057:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.431058:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.431060:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.431065:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.431071:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.431079:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+34:1959:x1800404480854016:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 41us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.431083:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4683 00000004:00080000:0.0:1716999794.431183:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092e7ca80/2, rc 0, transno 2947 00000100:00100000:0.0:1716999794.431191:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483028736:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.431193:0:19197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+55:3219:x1800404483029568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6474us (6524us total) trans 4294970204 rc 0/0 00000100:00100000:1.0:1716999794.431198:0:19197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10161 00000004:00080000:0.0:1716999794.431205:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fc1f480/2, rc 0, transno 2948 00000100:00100000:0.0:1716999794.431208:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008fc1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483029952:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1716999794.431216:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131caad80/2, rc 0, transno 2908 00000100:00100000:0.0:1716999794.431220:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483029568:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1716999794.431251:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800920f8fc0/0x6d188eabd8d6ff39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b29f expref: 30 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.431258:0:8342:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8342:1800404483029888:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.431266:0:8342:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.431269:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483030784:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1716999794.431272:0:8342:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431276:0:8342:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431285:0:8342:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.431287:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1716999794.431291:0:8342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431296:0:8342:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431302:0:8342:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f3c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.431304:0:8342:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431310:0:8342:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431317:0:8342:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431322:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8999 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.431473:0:8342:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+55:3217:x1800404483029440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6936us (6960us total) trans 4294970205 rc 0/0 00000100:00100000:1.0:1716999794.431477:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10157 00000100:00100000:1.0:1716999794.431483:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483030784 00000100:00100000:1.0:1716999794.431486:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483030784 00000100:00100000:1.0:1716999794.431504:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10169 00000100:00100000:1.0:1716999794.431508:0:8342:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3218:x1800404483030784:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.431522:0:8342:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:885 count 1 00010000:00010000:1.0:1716999794.431532:0:8342:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431541:0:8342:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339f8d80/0x6d188eabd8d7210c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0b4 expref: 33 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431546:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.431547:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.431549:0:8342:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431563:0:8342:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801339f8d80/0x6d188eabd8d7210c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0b4 expref: 33 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431570:0:8342:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801339f8d80/0x6d188eabd8d7210c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0b4 expref: 33 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.431577:0:8342:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483030976:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.431590:0:8342:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96300 going to sleep for 11 seconds 00000004:00080000:1.0:1716999794.431609:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb88380/2, rc 0, transno 2946 00000100:00100000:1.0:1716999794.431620:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483029248:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999794.431629:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131ca9880/2, rc 0, transno 2909 00000100:00100000:1.0:1716999794.431635:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483029440:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.431659:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483031040:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.431668:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483031104:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.431675:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.431681:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.431689:0:19197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483031040 00000100:00100000:1.0:1716999794.431691:0:19197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483031040 00000100:00100000:0.0:1716999794.431693:0:17697:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483031104 00000100:00100000:0.0:1716999794.431695:0:17697:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483031104 00000100:00100000:1.0:1716999794.431703:0:19197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10170 00000100:00100000:1.0:1716999794.431706:0:19197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+55:3217:x1800404483031040:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.431706:0:17697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10171 00000100:00100000:0.0:1716999794.431709:0:17697:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3218:x1800404483031104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.431715:0:19197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:889 count 1 00002000:00080000:0.0:1716999794.431715:0:17697:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:887 count 1 00010000:00010000:1.0:1716999794.431723:0:19197:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.431723:0:17697:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431731:0:19197:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e51200/0x6d188eabd8d72327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1a9 expref: 29 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.431731:0:17697:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009419ed00/0x6d188eabd8d72240 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c140 expref: 33 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431736:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.431736:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.431737:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.431737:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.431739:0:19197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.431740:0:17697:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 4/0,1 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431751:0:19197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e51200/0x6d188eabd8d72327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1a9 expref: 29 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.431751:0:17697:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009419ed00/0x6d188eabd8d72240 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c140 expref: 33 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.431757:0:19197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e51200/0x6d188eabd8d72327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1a9 expref: 29 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.431758:0:17697:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009419ed00/0x6d188eabd8d72240 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c140 expref: 33 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.431764:0:19197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19197:1800404483031232:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.431764:0:17697:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131c3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:17697:1800404483031168:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.431790:0:19197:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96780 going to sleep for 11 seconds 00000100:00100000:0.0:1716999794.431798:0:17697:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc96c0 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.431803:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483030848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.431818:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.431827:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1716999794.431830:0:17860:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483030848 00000100:00100000:1.0:1716999794.431831:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483030912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.431832:0:17860:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483030848 00000100:00100000:1.0:1716999794.431843:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.432147:0:17860:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483030912 00000100:00100000:0.0:1716999794.432150:0:17860:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483030912 00000100:00100000:1.0:1716999794.432166:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10172 00000100:00100000:1.0:1716999794.432170:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+56:3219:x1800404483030848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.432180:0:17864:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:886 count 1 00010000:00010000:1.0:1716999794.432188:0:17864:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432196:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339fa880/0x6d188eabd8d721a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0fa expref: 33 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432200:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.432201:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.432203:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432217:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801339fa880/0x6d188eabd8d721a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0fa expref: 33 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432223:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801339fa880/0x6d188eabd8d721a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0fa expref: 33 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.432230:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483031296:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.432243:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96900 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.432262:0:15837:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c576ac0/0x6d188eabd8d6ffa2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b2d0 expref: 33 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.432269:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:15837:1800404483030656:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.432279:0:15837:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432285:0:15837:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432290:0:15837:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432296:0:15837:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432301:0:15837:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432306:0:15837:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432310:0:15837:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.432312:0:15837:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432318:0:15837:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432330:0:15837:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.432335:0:15837:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc89bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.432453:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3220:x1800404483030464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4985us (5039us total) trans 4294970245 rc 0/0 00010000:00010000:3.0:1716999794.432513:0:2535:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.432522:0:2535:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.432529:0:2535:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.432534:0:2535:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.432539:0:17860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10173 00010000:00010000:3.0:1716999794.432540:0:2535:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.432545:0:17860:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3219:x1800404483030912:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.432549:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4680 00010000:00010000:3.0:1716999794.432550:0:2535:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.432553:0:2535:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1716999794.432554:0:17860:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:888 count 1 00010000:00010000:3.0:1716999794.432558:0:2535:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.432562:0:17860:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.432567:0:2535:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.432570:0:17860:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009419e1c0/0x6d188eabd8d7228d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c163 expref: 28 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.432572:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc89ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.432575:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.432576:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.432578:0:17860:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 4/0,1 mode: --/PW res: [0x240000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.432579:0:17474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800920f8d80/0x6d188eabd8d70123 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b37f expref: 28 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.432586:0:17474:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:17474:1800404483030208:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.432594:0:17860:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009419e1c0/0x6d188eabd8d7228d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c163 expref: 27 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.432596:0:17474:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.432601:0:17860:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009419e1c0/0x6d188eabd8d7228d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c163 expref: 27 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.432602:0:17474:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.432607:0:17474:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.432609:0:17860:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131c3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:17860:1800404483031360:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.432613:0:17474:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.432617:0:17474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.432621:0:17860:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc9600 going to sleep for 11 seconds 00010000:00010000:2.0:1716999794.432623:0:17474:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.432628:0:17474:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918321c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.432630:0:17474:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.432635:0:17474:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.432643:0:17474:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.432648:0:17474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918321c0/0x6d188eabd8dc89a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.432733:0:2535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+57:3220:x1800404483030400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5165us (5288us total) trans 4294970206 rc 0/0 00000100:00100000:3.0:1716999794.432739:0:2535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10168 00000100:00100000:2.0:1716999794.432835:0:17474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3219:x1800404483029376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8018us (8141us total) trans 4294970207 rc 0/0 00000100:00100000:2.0:1716999794.432840:0:17474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10162 00000004:00080000:0.0:1716999794.432860:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131caaa00/2, rc 0, transno 2911 00000100:00100000:0.0:1716999794.432867:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483029376:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.433003:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10167 00010000:00010000:2.0:1716999794.433978:0:19200:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.433985:0:19200:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.433992:0:19200:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.433999:0:19200:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.434002:0:17365:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434005:0:19200:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.434010:0:17365:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434010:0:19200:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832d00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.434012:0:19200:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.434017:0:17365:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434018:0:19200:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.434022:0:17365:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434027:0:19200:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.434028:0:17365:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.434032:0:17365:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918306c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.434032:0:19200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091832d00/0x6d188eabd8dc8976 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.434035:0:17365:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.434039:0:17365:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.434048:0:17365:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.434053:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8961 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.434203:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800897aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+57:3218:x1800404483028928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9829us (10269us total) trans 4294970208 rc 0/0 00000100:00100000:2.0:1716999794.434209:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10156 00010000:00010000:2.0:1716999794.434234:0:19205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009215c6c0/0x6d188eabd8d729e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x381:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c45e expref: 27 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.434242:0:19205:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_017:lustre-OST0000_UUID:19205:1800404483029760:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.434252:0:19205:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434257:0:19205:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434261:0:19205:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434266:0:19205:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434271:0:19205:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434275:0:19205:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434279:0:19205:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091832880 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.434281:0:19205:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434286:0:19205:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434292:0:19205:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434302:0:19205:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091832880/0x6d188eabd8dc898b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x381:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19205 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1716999794.434431:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880099582300/2, rc 0, transno 2912 00000100:00100000:0.0:1716999794.434436:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880099582300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483028928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.434521:0:19205:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+57:3219:x1800404483029312:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9806us (9871us total) trans 4294970209 rc 0/0 00000100:00100000:2.0:1716999794.434526:0:19205:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10160 00010000:00010000:2.0:1716999794.434550:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131f8e400/0x6d188eabd8d6ff2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b291 expref: 32 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.434557:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:19196:1800404483030336:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.434558:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483031424:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1716999794.434568:0:19196:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434573:0:19196:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434578:0:19196:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.434579:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1716999794.434584:0:19196:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.434590:0:19196:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1716999794.434594:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131d5e300/2, rc 0, transno 2913 00010000:00010000:2.0:1716999794.434599:0:19196:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.434608:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131d5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483029312:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.434616:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1716999794.434619:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483031488:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.434636:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.434646:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483031552:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.434668:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.434688:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483031424 00000100:00100000:1.0:1716999794.434692:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483031424 00000100:00100000:1.0:1716999794.434708:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483031488 00000100:00100000:1.0:1716999794.434709:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483031488 00000100:00100000:1.0:1716999794.434716:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483031552 00000100:00100000:1.0:1716999794.434717:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483031552 00000100:00100000:1.0:1716999794.434726:0:2535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10174 00000100:00100000:1.0:1716999794.434730:0:2535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+59:3219:x1800404483031424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.434742:0:2535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:878 count 1 00010000:00010000:1.0:1716999794.434753:0:2535:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.434762:0:2535:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009419e400/0x6d188eabd8d71c66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be92 expref: 26 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.434767:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.434777:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.434779:0:2535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.434794:0:2535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009419e400/0x6d188eabd8d71c66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be92 expref: 26 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.434801:0:2535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009419e400/0x6d188eabd8d71c66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be92 expref: 26 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.434809:0:2535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483031616:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.434824:0:2535:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.434835:0:17474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10175 00000100:00100000:1.0:1716999794.434839:0:17474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+59:3219:x1800404483031488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.434847:0:17474:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:890 count 1 00010000:00010000:1.0:1716999794.434855:0:17474:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.434863:0:17474:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f8eac0/0x6d188eabd8d723c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1ef expref: 26 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.434868:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.434870:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.434871:0:17474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.434900:0:17474:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f8eac0/0x6d188eabd8d723c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1ef expref: 26 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.434921:0:17474:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f8eac0/0x6d188eabd8d723c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1ef expref: 26 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.434929:0:17474:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:17474:1800404483031680:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.434942:0:17474:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96480 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.434953:0:19209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10176 00000100:00100000:1.0:1716999794.434956:0:19209:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+59:3217:x1800404483031552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.434965:0:19209:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:880 count 1 00010000:00010000:1.0:1716999794.434973:0:19209:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.434981:0:19209:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e51b00/0x6d188eabd8d71da1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf25 expref: 26 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.434986:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.434987:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.434989:0:19209:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.435002:0:19209:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e51b00/0x6d188eabd8d71da1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf25 expref: 26 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.435008:0:19209:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e51b00/0x6d188eabd8d71da1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf25 expref: 26 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.435015:0:19209:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483031744:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.435193:0:19196:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830b40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.435197:0:19196:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435203:0:19196:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435211:0:19196:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435216:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091830b40/0x6d188eabd8dc89b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.435228:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+57:3220:x1800404483028864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11073us (11791us total) trans 4294970246 rc 0/0 00000100:00100000:3.0:1716999794.435234:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10153 00010000:00010000:3.0:1716999794.435309:0:19195:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.435316:0:19195:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.435321:0:19195:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.435327:0:19195:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.435332:0:19195:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.435335:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+57:3218:x1800404483030016:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9107us (9181us total) trans 4294970247 rc 0/0 00010000:00010000:3.0:1716999794.435337:0:19195:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c521c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.435339:0:19195:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.435340:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10165 00010000:00010000:3.0:1716999794.435344:0:19195:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.435353:0:19195:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.435359:0:19195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c521c0/0x6d188eabd8dc89c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435373:0:8340:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f8f3c0/0x6d188eabd8d70089 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b339 expref: 26 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.435380:0:8340:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131caa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8340:1800404483029696:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.435382:0:19209:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96240 going to sleep for 11 seconds 00010000:00010000:2.0:1716999794.435390:0:8340:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1716999794.435428:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800889ff480/2, rc 0, transno 2951 00000100:00100000:0.0:1716999794.435436:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483030016:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.435485:0:8340:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435491:0:8340:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.435492:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1716999794.435497:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483031808:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.435498:0:8340:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435503:0:8340:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435508:0:8340:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435513:0:8340:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830d80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.435515:0:8340:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.435515:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1716999794.435521:0:8340:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435529:0:8340:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435534:0:8340:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091830d80/0x6d188eabd8dc8984 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1716999794.435568:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008b9fc700/2, rc 0, transno 2914 00000100:00100000:0.0:1716999794.435573:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008b9fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483030528:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.435645:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483031872:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.435660:0:8340:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+61:3217:x1800404483029504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11059us (11090us total) trans 4294970211 rc 0/0 00000100:00100000:0.0:1716999794.435660:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.435666:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10159 00000100:00100000:2.0:1716999794.435674:0:8340:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483031808 00000100:00100000:2.0:1716999794.435676:0:8340:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483031808 00000100:00100000:2.0:1716999794.435686:0:8340:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483031872 00000100:00100000:2.0:1716999794.435688:0:8340:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483031872 00000100:00100000:3.0:1716999794.435696:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+61:3218:x1800404483030528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8232us (8296us total) trans 4294970210 rc 0/0 00000100:00100000:2.0:1716999794.435697:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10177 00000100:00100000:2.0:1716999794.435700:0:8340:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3217:x1800404483031808:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.435703:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10166 00002000:00080000:2.0:1716999794.435709:0:8340:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:888 count 1 00000100:00100000:3.0:1716999794.435716:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10178 00010000:00010000:2.0:1716999794.435717:0:8340:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.435720:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+60:3219:x1800404483031872:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1716999794.435725:0:8340:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131f8c000/0x6d188eabd8d722d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c186 expref: 31 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435729:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00002000:00080000:3.0:1716999794.435730:0:19195:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:879 count 1 00010000:00010000:2.0:1716999794.435730:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.435732:0:8340:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.435740:0:19195:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435744:0:8340:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131f8c000/0x6d188eabd8d722d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c186 expref: 31 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.435749:0:19195:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e521c0/0x6d188eabd8d71d07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bedf expref: 25 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.435751:0:8340:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131f8c000/0x6d188eabd8d722d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c186 expref: 31 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.435755:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.435756:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.435758:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.435764:0:8340:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8340:1800404483031936:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.435784:0:19195:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e521c0/0x6d188eabd8d71d07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bedf expref: 25 pid: 17365 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999794.435788:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131cab100/2, rc 0, transno 2915 00000100:00100000:2.0:1716999794.435790:0:8340:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6000 going to sleep for 11 seconds 00010000:00010000:3.0:1716999794.435792:0:19195:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e521c0/0x6d188eabd8d71d07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bedf expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.435794:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483029504:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.435800:0:19195:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a694a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19195:1800404483032000:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.435814:0:19195:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219180 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.435815:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1716999794.435820:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483032064:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1716999794.435834:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008fc1f800/2, rc 0, transno 2910 00000100:00100000:3.0:1716999794.435841:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008fc1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483030400:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1716999794.435849:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995a2300/2, rc 0, transno 2949 00000100:00100000:3.0:1716999794.435854:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483030464:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1716999794.435861:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092e7c700/2, rc 0, transno 2945 00000100:00100000:3.0:1716999794.435863:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483028800:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1716999794.435869:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880092e7f800/2, rc 0, transno 2950 00000100:00100000:1.0:1716999794.435869:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.435872:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880092e7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483028864:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999794.435934:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483032192:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999794.435951:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.435961:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1716999794.435962:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483032064 00000100:00100000:2.0:1716999794.435964:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483032064 00000100:00100000:0.0:1716999794.435965:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483032128:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.435974:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483032192 00000100:00100000:2.0:1716999794.435976:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483032192 00000100:00100000:0.0:1716999794.435976:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.435982:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483032128 00000100:00100000:2.0:1716999794.435984:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483032128 00000100:00100000:0.0:1716999794.435989:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10179 00000100:00100000:0.0:1716999794.435992:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+61:3219:x1800404483032064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1716999794.436001:0:19200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:881 count 1 00010000:00010000:0.0:1716999794.436009:0:19200:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.436012:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483032320:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1716999794.436017:0:19200:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e50480/0x6d188eabd8d71e34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf64 expref: 25 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.436022:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.436023:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.436025:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.436028:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.436038:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1716999794.436039:0:19200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e50480/0x6d188eabd8d71e34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf64 expref: 25 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.436041:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483032256:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1716999794.436046:0:19200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e50480/0x6d188eabd8d71e34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf64 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.436054:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.436058:0:19200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:19200:1800404483032384:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.436066:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483032320 00000100:00100000:1.0:1716999794.436068:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483032320 00000100:00100000:0.0:1716999794.436069:0:19200:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.436095:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483032256 00000100:00100000:2.0:1716999794.436097:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483032256 00000100:00100000:0.0:1716999794.436103:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10180 00000100:00100000:0.0:1716999794.436107:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3218:x1800404483032192:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.436115:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10181 00002000:00080000:0.0:1716999794.436116:0:11262:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:878 count 1 00000100:00100000:2.0:1716999794.436118:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3218:x1800404483032128:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.436124:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:889 count 1 00010000:00010000:0.0:1716999794.436124:0:11262:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.436130:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.436132:0:11262:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009419c900/0x6d188eabd8d71d00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bed8 expref: 31 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.436136:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.436137:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.436138:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a8900d80/0x6d188eabd8d7236d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1c5 expref: 31 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.436139:0:11262:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.436143:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.436144:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.436145:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.436151:0:11262:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009419c900/0x6d188eabd8d71d00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bed8 expref: 31 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.436155:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a8900d80/0x6d188eabd8d7236d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1c5 expref: 31 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.436158:0:11262:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009419c900/0x6d188eabd8d71d00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bed8 expref: 31 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.436162:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a8900d80/0x6d188eabd8d7236d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1c5 expref: 31 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.436165:0:11262:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11262:1800404483032448:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.436169:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483032512:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.436176:0:11262:0:(client.c:2542:ptlrpc_set_wait()) set ffff880135bc9300 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.436178:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.436188:0:21818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10182 00000100:00100000:2.0:1716999794.436191:0:21818:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b87c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+62:3219:x1800404483032256:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1716999794.436198:0:21818:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:882 count 1 00010000:00010000:2.0:1716999794.436205:0:21818:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.436212:0:21818:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e50900/0x6d188eabd8d71ed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfb1 expref: 25 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.436216:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.436218:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.436219:0:21818:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.436229:0:21818:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e50900/0x6d188eabd8d71ed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfb1 expref: 25 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.436235:0:21818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e50900/0x6d188eabd8d71ed5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfb1 expref: 25 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.436241:0:21818:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:21818:1800404483032576:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.436252:0:21818:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.436282:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10183 00000100:00100000:2.0:1716999794.436286:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+60:3219:x1800404483032320:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.436294:0:19196:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:877 count 1 00010000:00010000:2.0:1716999794.436301:0:19196:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.436305:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920f9440/0x6d188eabd8d70020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b308 expref: 31 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.436308:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339faac0/0x6d188eabd8d71c6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be99 expref: 31 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.436313:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.436314:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.436316:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.436326:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801339faac0/0x6d188eabd8d71c6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be99 expref: 31 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.436333:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801339faac0/0x6d188eabd8d71c6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be99 expref: 31 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.436339:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:19196:1800404483032640:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.436344:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4684 00000100:00100000:3.0:1716999794.436349:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+31:1959:x1800404480853952:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1716999794.436349:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6180 going to sleep for 11 seconds 00010000:00010000:3.0:1716999794.436357:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.436361:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920f9440/0x6d188eabd8d70020 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b308 expref: 31 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.436369:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920f9440/0x6d188eabd8d70020 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b308 expref: 31 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.436379:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920f9440/0x6d188eabd8d70020 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b308 expref: 31 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.436385:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.436387:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.436390:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.436395:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.436416:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.436429:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+30:1959:x1800404480853952:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 80us (6635us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.436434:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4684 00010000:00010000:1.0:1716999794.436447:0:17700:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.436453:0:17700:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.436459:0:17700:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.436463:0:17700:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.436473:0:17700:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.436477:0:17700:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f840 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.436479:0:17700:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.436484:0:17700:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.436492:0:17700:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 2/0,0 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.436497:0:17700:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695f840/0x6d188eabd8dc89ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.436615:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3218:x1800404483030080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10428us (10484us total) trans 4294970248 rc 0/0 00000100:00100000:1.0:1716999794.436620:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10164 00000004:00080000:0.0:1716999794.436639:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800889fc000/2, rc 0, transno 2952 00000100:00100000:0.0:1716999794.436646:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483030080:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.436671:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1716999794.436676:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483032704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.436691:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.436702:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483032704 00000100:00100000:0.0:1716999794.436705:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483032704 00000100:00100000:0.0:1716999794.436716:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10184 00000100:00100000:0.0:1716999794.436719:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3218:x1800404483032704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1716999794.436728:0:17700:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:880 count 1 00010000:00010000:0.0:1716999794.436734:0:17700:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.436742:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339f86c0/0x6d188eabd8d71e3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf6b expref: 29 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.436747:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.436748:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.436750:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.436761:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801339f86c0/0x6d188eabd8d71e3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf6b expref: 29 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.436768:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801339f86c0/0x6d188eabd8d71e3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf6b expref: 29 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.436786:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88012b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483032768:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.436801:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ab9b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1716999794.439822:0:8342:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8342:1800404483030976:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.439842:0:8342:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.440923:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.440940:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999794.440942:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483031296:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.440956:0:17864:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.440959:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.440970:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999794.440978:0:19197:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19197:1800404483031232:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.440981:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999794.440987:0:19197:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.440990:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999794.441002:0:17474:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:17474:1800404483031680:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.441010:0:17474:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.441024:0:2535:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0000_UUID:2535:1800404483031616:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.441031:0:2535:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441041:0:8340:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8340:1800404483031936:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.441046:0:19209:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483031744:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.441053:0:19209:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441054:0:8340:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441071:0:19195:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a694a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19195:1800404483032000:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.441081:0:19195:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441098:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854720 00000100:00100000:3.0:1716999794.441103:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854720 00010000:00010000:3.0:1716999794.441121:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e50900/0x6d188eabd8d71ed5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfb1 expref: 26 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.441139:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854912 00000100:00100000:3.0:1716999794.441141:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854912 00010000:00010000:3.0:1716999794.441147:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009419e400/0x6d188eabd8d71c66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be92 expref: 27 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.441154:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854144 00000100:00100000:3.0:1716999794.441156:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854144 00010000:00010000:3.0:1716999794.441162:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801339f8d80/0x6d188eabd8d7210c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0b4 expref: 30 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.441169:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854272 00000100:00100000:3.0:1716999794.441170:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854272 00010000:00010000:3.0:1716999794.441175:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801339fa880/0x6d188eabd8d721a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0fa expref: 31 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.441186:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4685 00000100:00100000:3.0:1716999794.441191:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+27:1957:x1800404480854720:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.441201:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.441204:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e50900/0x6d188eabd8d71ed5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfb1 expref: 27 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.441212:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e50900/0x6d188eabd8d71ed5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfb1 expref: 27 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.441228:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.441230:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.441234:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.441235:0:21818:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e50900/0x6d188eabd8d71ed5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfb1 expref: 27 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.441241:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.441246:0:21818:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0000_UUID:21818:1800404483032576:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.441253:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.441257:0:21818:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.441267:0:21818:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.441273:0:21818:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441279:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+26:1957:x1800404480854720:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 87us (358us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999794.441280:0:21818:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441284:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4685 00010000:00010000:2.0:1716999794.441286:0:21818:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.441292:0:21818:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441294:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854400 00000100:00100000:3.0:1716999794.441296:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854400 00010000:00010000:2.0:1716999794.441297:0:21818:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918318c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.441300:0:21818:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441303:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e51b00/0x6d188eabd8d71da1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf25 expref: 26 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.441305:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.441306:0:21818:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441314:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854528 00010000:00010000:2.0:1716999794.441315:0:21818:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441316:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854528 00010000:00010000:2.0:1716999794.441320:0:21818:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800918318c0/0x6d188eabd8dc8a2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441321:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e521c0/0x6d188eabd8d71d07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bedf expref: 27 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.441327:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854656 00000100:00100000:3.0:1716999794.441328:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854656 00010000:00010000:3.0:1716999794.441334:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009419c900/0x6d188eabd8d71d00 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bed8 expref: 32 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.441342:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4686 00000100:00100000:3.0:1716999794.441346:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+27:1957:x1800404480854912:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.441351:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.441354:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009419e400/0x6d188eabd8d71c66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be92 expref: 27 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.441359:0:17860:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131c3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:17860:1800404483031360:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.441360:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009419e400/0x6d188eabd8d71c66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be92 expref: 27 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.441367:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009419e400/0x6d188eabd8d71c66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be92 expref: 27 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.441370:0:17860:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441374:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.441375:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.441377:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441386:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.441388:0:11262:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b7f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11262:1800404483032448:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.441395:0:11262:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441396:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.441409:0:19200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b7f6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0000_UUID:19200:1800404483032384:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.441417:0:19200:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441418:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+26:1957:x1800404480854912:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 70us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.441423:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4686 00000100:00100000:0.0:1716999794.441431:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4687 00000100:00100000:0.0:1716999794.441435:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+32:1958:x1800404480854144:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.441442:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.441445:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801339f8d80/0x6d188eabd8d7210c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0b4 expref: 32 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.441449:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4688 00000100:00100000:3.0:1716999794.441453:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+32:1958:x1800404480854272:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.441453:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801339f8d80/0x6d188eabd8d7210c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0b4 expref: 32 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.441459:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.441462:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801339fa880/0x6d188eabd8d721a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0fa expref: 32 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.441464:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801339f8d80/0x6d188eabd8d7210c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x375:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0b4 expref: 32 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.441470:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801339fa880/0x6d188eabd8d721a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0fa expref: 31 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.441474:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.441475:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.441477:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441480:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801339fa880/0x6d188eabd8d721a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c0fa expref: 31 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.441483:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441487:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.441488:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.441491:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441494:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.441495:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.441502:0:2535:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.441508:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+30:1958:x1800404480854144:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 72us (548us total) trans 0 rc 0/0 00010000:00010000:1.0:1716999794.441509:0:2535:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441510:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.441514:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4687 00010000:00010000:1.0:1716999794.441515:0:2535:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.441521:0:2535:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441523:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+29:1958:x1800404480854272:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 68us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.441524:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4689 00010000:00010000:1.0:1716999794.441526:0:2535:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441528:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4688 00000100:00100000:0.0:1716999794.441528:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+25:1958:x1800404480854400:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.441531:0:2535:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695cfc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.441533:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.441534:0:2535:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441537:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e51b00/0x6d188eabd8d71da1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf25 expref: 25 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.441538:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4690 00010000:00010000:1.0:1716999794.441539:0:2535:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441541:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+25:1958:x1800404480854528:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.441544:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e51b00/0x6d188eabd8d71da1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf25 expref: 25 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.441546:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.441547:0:2535:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441549:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e521c0/0x6d188eabd8d71d07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bedf expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.441552:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695cfc0/0x6d188eabd8dc89f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441556:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e521c0/0x6d188eabd8d71d07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bedf expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.441556:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e51b00/0x6d188eabd8d71da1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x370:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf25 expref: 25 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.441563:0:6809:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e521c0/0x6d188eabd8d71d07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bedf expref: 24 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.441563:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.441564:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.441566:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441571:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.441571:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441572:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.441574:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441580:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441581:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.441589:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.441593:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+23:1958:x1800404480854400:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 65us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.441598:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4689 00000100:00100000:3.0:1716999794.441601:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+23:1958:x1800404480854528:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 59us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.441605:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4690 00000100:00100000:0.0:1716999794.441608:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4691 00000100:00100000:0.0:1716999794.441612:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+28:1958:x1800404480854656:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.441617:0:19195:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441617:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.441620:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009419c900/0x6d188eabd8d71d00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bed8 expref: 28 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.441622:0:19195:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441627:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009419c900/0x6d188eabd8d71d00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bed8 expref: 28 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.441629:0:19195:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441635:0:19195:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441635:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009419c900/0x6d188eabd8d71d00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bed8 expref: 28 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.441640:0:19195:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441644:0:19195:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c51680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.441645:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.441646:0:19195:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441646:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.441648:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441651:0:19195:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441652:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441657:0:19195:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.441661:0:19195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c51680/0x6d188eabd8dc8a10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441662:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.441674:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+27:1958:x1800404480854656:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 61us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.441678:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4691 00010000:00010000:0.0:1716999794.441690:0:11262:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441695:0:11262:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441700:0:11262:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441706:0:11262:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.441707:0:2535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+63:3219:x1800404483031424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6976us (7128us total) trans 4294970212 rc 0/0 00010000:00010000:0.0:1716999794.441712:0:11262:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.441713:0:2535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10174 00010000:00010000:0.0:1716999794.441720:0:11262:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e68fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.441723:0:11262:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.441726:0:17864:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441728:0:11262:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.441732:0:17864:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441736:0:11262:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.441738:0:17864:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441741:0:11262:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e68fc0/0x6d188eabd8dc8a1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.441744:0:17864:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.441749:0:17864:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.441753:0:17864:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.441755:0:17864:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.441759:0:17864:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.441766:0:17864:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.441785:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695f180/0x6d188eabd8dc89e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x376:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.441815:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+63:3219:x1800404483031872:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6093us (6154us total) trans 4294970213 rc 0/0 00000100:00100000:3.0:1716999794.441820:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10178 00000004:00080000:1.0:1716999794.441894:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb2f480/2, rc 0, transno 2917 00000100:00100000:1.0:1716999794.441901:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483031872:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.441929:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+63:3218:x1800404483032192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5821us (5977us total) trans 4294970249 rc 0/0 00000100:00100000:0.0:1716999794.441934:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10180 00000100:00100000:0.0:1716999794.441960:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b7f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483032768:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.441969:0:17700:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441980:0:8342:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441985:0:8342:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.441995:0:8342:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.442000:0:8342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.442005:0:8342:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.442009:0:8342:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c900 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.442011:0:8342:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.442017:0:8342:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.442024:0:8342:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.442030:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695c900/0x6d188eabd8dc89d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999794.443141:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb2f800/2, rc 0, transno 2916 00000100:00100000:1.0:1716999794.443151:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483031424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.443182:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1716999794.443191:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483032896:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.443203:0:8342:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+63:3218:x1800404483030784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11692us (11913us total) trans 4294970251 rc 0/0 00000100:00100000:0.0:1716999794.443209:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10169 00000100:00100000:1.0:1716999794.443213:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+63:3219:x1800404483030848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11043us (11395us total) trans 4294970250 rc 0/0 00000100:00100000:3.0:1716999794.443216:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.443218:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10172 00000100:00100000:0.0:1716999794.443221:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483032896 00000100:00100000:0.0:1716999794.443225:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483032896 00000100:00100000:3.0:1716999794.443233:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1716999794.443238:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a694a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483032832:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.443239:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10185 00000004:00080000:1.0:1716999794.443240:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995a1500/2, rc 0, transno 2954 00000100:00100000:0.0:1716999794.443243:0:8342:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+64:3220:x1800404483032896:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.443246:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483030848:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.443252:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1716999794.443257:0:8342:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:885 count 1 00000100:00100000:3.0:1716999794.443264:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483032832 00000100:00100000:3.0:1716999794.443267:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483032832 00010000:00010000:0.0:1716999794.443269:0:8342:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.443271:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1716999794.443276:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483032960:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1716999794.443279:0:8342:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e53a80/0x6d188eabd8d720a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c083 expref: 21 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.443284:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1716999794.443286:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10186 00010000:00010000:0.0:1716999794.443286:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.443288:0:8342:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.443290:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3217:x1800404483032832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.443300:0:11262:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:883 count 1 00000100:00100000:1.0:1716999794.443304:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1716999794.443304:0:8342:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e53a80/0x6d188eabd8d720a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c083 expref: 21 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.443308:0:11262:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.443313:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483032960 00010000:00010000:0.0:1716999794.443313:0:8342:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e53a80/0x6d188eabd8d720a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c083 expref: 21 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.443315:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483032960 00010000:00010000:3.0:1716999794.443317:0:11262:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e533c0/0x6d188eabd8d71f6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bff7 expref: 21 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.443321:0:8342:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880088b2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8342:1800404483033024:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.443322:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.443323:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.443325:0:11262:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.443326:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10187 00000100:00100000:1.0:1716999794.443330:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+62:3219:x1800404483032960:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.443339:0:17864:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:879 count 1 00000100:00100000:0.0:1716999794.443343:0:8342:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ab9b9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.443347:0:17864:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443355:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339fa640/0x6d188eabd8d71d9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf1e expref: 26 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.443364:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.443388:0:21818:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b87c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+65:3219:x1800404483032256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7196us (7332us total) trans 4294970214 rc 0/0 00000100:00100000:2.0:1716999794.443393:0:21818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10182 00000100:00100000:2.0:1716999794.443419:0:17697:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131c3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:17697:1800404483031168:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.443422:0:11262:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e533c0/0x6d188eabd8d71f6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bff7 expref: 21 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.443430:0:11262:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e533c0/0x6d188eabd8d71f6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bff7 expref: 21 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.443431:0:17697:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.443438:0:11262:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800a694bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11262:1800404483033088:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.443451:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0001_UUID:19196:1800404483032640:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.443457:0:11262:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219d80 going to sleep for 11 seconds 00010000:00010000:2.0:1716999794.443460:0:19196:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.443479:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483032512:192.168.203.3@tcp:104: 00000004:00080000:3.0:1716999794.443481:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012b7f4000/2, rc 0, transno 2953 00000100:00100000:3.0:1716999794.443487:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b7f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483032192:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.443487:0:17365:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999794.443495:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995a0000/2, rc 0, transno 2955 00000100:00100000:3.0:1716999794.443497:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483030784:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.443514:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854848 00000100:00100000:3.0:1716999794.443516:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854848 00010000:00010000:3.0:1716999794.443526:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801339f86c0/0x6d188eabd8d71e3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf6b expref: 27 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.443526:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.443527:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.443529:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.443541:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4692 00000100:00100000:3.0:1716999794.443545:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+27:1958:x1800404480854848:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.443545:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801339fa640/0x6d188eabd8d71d9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf1e expref: 27 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.443551:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1716999794.443552:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801339fa640/0x6d188eabd8d71d9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf1e expref: 27 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.443555:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801339f86c0/0x6d188eabd8d71e3b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf6b expref: 27 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.443560:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c707b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483033152:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.443562:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801339f86c0/0x6d188eabd8d71e3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf6b expref: 27 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.443572:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801339f86c0/0x6d188eabd8d71e3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf6b expref: 27 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.443577:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96240 going to sleep for 11 seconds 00010000:00010000:3.0:1716999794.443580:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.443582:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.443585:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.443591:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.443603:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1716999794.443615:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb2dc00/2, rc 0, transno 2918 00000100:00100000:3.0:1716999794.443619:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+26:1958:x1800404480854848:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 72us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999794.443621:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483032256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.443624:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4692 00010000:00010000:3.0:1716999794.443638:0:17700:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.443644:0:17700:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.443644:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483033344:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999794.443650:0:17700:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.443660:0:17700:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.443660:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1716999794.443666:0:17700:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.443674:0:17700:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6a640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.443677:0:17700:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.443677:0:19195:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483033344 00000100:00100000:1.0:1716999794.443680:0:19195:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483033344 00010000:00010000:3.0:1716999794.443683:0:17700:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.443692:0:17700:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.443693:0:19195:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10188 00000100:00100000:1.0:1716999794.443696:0:19195:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+65:3219:x1800404483033344:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999794.443697:0:17700:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e6a640/0x6d188eabd8dc8a3a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00002000:00080000:1.0:1716999794.443705:0:19195:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1549 count 1 00010000:00010000:1.0:1716999794.443713:0:19195:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443720:0:19195:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f7b expref: 21 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443725:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.443726:0:19195:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.443728:0:19195:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443741:0:19195:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f7b expref: 21 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443752:0:19195:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f7b expref: 21 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.443759:0:19195:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c707100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19195:1800404483033408:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.443785:0:19195:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.443797:0:19209:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443803:0:19209:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443810:0:19209:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443815:0:19209:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443820:0:19209:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443826:0:19209:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695cb40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.443828:0:19209:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443833:0:19209:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443843:0:19209:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.443849:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695cb40/0x6d188eabd8dc8a02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.443872:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3218:x1800404483032704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7151us (7179us total) trans 4294970252 rc 0/0 00000100:00100000:3.0:1716999794.443877:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10184 00000100:00100000:1.0:1716999794.443995:0:19209:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+66:3217:x1800404483031552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9037us (9330us total) trans 4294970215 rc 0/0 00000100:00100000:1.0:1716999794.444000:0:19209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10176 00000100:00100000:3.0:1716999794.444139:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483033216:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.444158:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1716999794.444184:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb2ca80/2, rc 0, transno 2919 00000100:00100000:3.0:1716999794.444190:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483031552:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.444196:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1716999794.444197:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483033216 00000100:00100000:3.0:1716999794.444200:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008c704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483033280:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.444200:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483033216 00000100:00100000:3.0:1716999794.444216:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.444216:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10189 00000100:00100000:2.0:1716999794.444220:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3217:x1800404483033216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.444230:0:17700:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:881 count 1 00000004:00080000:3.0:1716999794.444231:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c705500/2, rc 0, transno 2956 00000100:00100000:3.0:1716999794.444236:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008c705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483032704:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.444238:0:17700:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.444247:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339f9b00/0x6d188eabd8d71ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfa3 expref: 25 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.444252:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.444253:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.444255:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.444261:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800889fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483033472:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.444269:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801339f9b00/0x6d188eabd8d71ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfa3 expref: 25 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.444274:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1716999794.444276:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801339f9b00/0x6d188eabd8d71ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfa3 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.444284:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483033536:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.444287:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483033280 00000100:00100000:3.0:1716999794.444290:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483033280 00000100:00100000:2.0:1716999794.444301:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.444302:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483033472 00000100:00100000:3.0:1716999794.444303:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483033472 00000100:00100000:3.0:1716999794.444312:0:2535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10190 00000100:00100000:3.0:1716999794.444315:0:2535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+65:3217:x1800404483033280:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.444316:0:21818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10191 00000100:00100000:2.0:1716999794.444320:0:21818:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800889fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+65:3220:x1800404483033472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1716999794.444324:0:2535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:882 count 1 00002000:00080000:2.0:1716999794.444330:0:21818:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:884 count 1 00010000:00010000:3.0:1716999794.444332:0:2535:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.444338:0:21818:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.444340:0:2535:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e52640/0x6d188eabd8d71f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfe9 expref: 25 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.444346:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.444346:0:21818:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e50240/0x6d188eabd8d72095 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c075 expref: 25 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.444347:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.444349:0:2535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.444350:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.444351:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.444353:0:21818:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.444361:0:2535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e52640/0x6d188eabd8d71f61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfe9 expref: 25 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.444367:0:2535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e52640/0x6d188eabd8d71f61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfe9 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.444370:0:21818:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e50240/0x6d188eabd8d72095 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c075 expref: 25 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.444375:0:2535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:2535:1800404483033600:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.444377:0:21818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e50240/0x6d188eabd8d72095 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c075 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.444385:0:21818:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:21818:1800404483033664:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.444390:0:2535:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219300 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.444401:0:21818:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6180 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.444785:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.444809:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.444819:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855040 00000100:00100000:2.0:1716999794.444822:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855040 00000100:00100000:3.0:1716999794.444823:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.444834:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a8900d80/0x6d188eabd8d7236d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1c5 expref: 26 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.444835:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.444846:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.444847:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854208 00000100:00100000:2.0:1716999794.444848:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854208 00010000:00010000:2.0:1716999794.444855:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009419ed00/0x6d188eabd8d72240 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c140 expref: 27 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.444865:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854336 00000100:00100000:2.0:1716999794.444867:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854336 00000100:00100000:3.0:1716999794.444870:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.444874:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009419e1c0/0x6d188eabd8d7228d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c163 expref: 22 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.444894:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.444900:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854464 00000100:00100000:2.0:1716999794.444902:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854464 00000100:00100000:3.0:1716999794.444907:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.444910:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131f8c000/0x6d188eabd8d722d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c186 expref: 28 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.444922:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854592 00000100:00100000:2.0:1716999794.444924:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854592 00010000:00010000:2.0:1716999794.444930:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e50480/0x6d188eabd8d71e34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf64 expref: 23 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.444935:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.444936:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854784 00000100:00100000:2.0:1716999794.444938:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854784 00010000:00010000:2.0:1716999794.444943:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801339faac0/0x6d188eabd8d71c6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be99 expref: 29 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.444947:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480854976 00000100:00100000:3.0:1716999794.444949:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480854976 00000100:00100000:2.0:1716999794.444950:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855104 00000100:00100000:2.0:1716999794.444952:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855104 00010000:00010000:3.0:1716999794.444957:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f8eac0/0x6d188eabd8d723c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1ef expref: 25 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.444957:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e51200/0x6d188eabd8d72327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1a9 expref: 25 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.444964:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855168 00000100:00100000:3.0:1716999794.444966:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4693 00000100:00100000:2.0:1716999794.444966:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855168 00000100:00100000:3.0:1716999794.444970:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+29:1958:x1800404480855040:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.444971:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e53a80/0x6d188eabd8d720a3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c083 expref: 26 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.444976:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.444979:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a8900d80/0x6d188eabd8d7236d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1c5 expref: 29 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.444979:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4694 00000100:00100000:2.0:1716999794.444983:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+29:1958:x1800404480854208:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.444986:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a8900d80/0x6d188eabd8d7236d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1c5 expref: 29 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.444987:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.444990:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009419ed00/0x6d188eabd8d72240 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c140 expref: 29 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.444996:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a8900d80/0x6d188eabd8d7236d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1c5 expref: 29 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.444996:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009419ed00/0x6d188eabd8d72240 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c140 expref: 29 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.445004:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.445005:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.445005:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009419ed00/0x6d188eabd8d72240 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c140 expref: 28 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.445008:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.445011:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.445012:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.445014:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.445015:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.445020:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.445025:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.445029:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.445041:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+27:1958:x1800404480855040:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 69us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.445041:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+27:1958:x1800404480854208:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 57us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.445045:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4694 00000100:00100000:1.0:1716999794.445114:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483033728:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.445133:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.445158:0:19209:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483033728 00000100:00100000:1.0:1716999794.445161:0:19209:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483033728 00000100:00100000:1.0:1716999794.445173:0:19209:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10192 00000100:00100000:1.0:1716999794.445176:0:19209:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+66:3217:x1800404483033728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.445185:0:19209:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:884 count 1 00010000:00010000:1.0:1716999794.445193:0:19209:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.445201:0:19209:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009419fa80/0x6d188eabd8d72009 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c03d expref: 26 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.445206:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.445207:0:19209:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.445209:0:19209:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.445398:0:19209:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009419fa80/0x6d188eabd8d72009 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c03d expref: 26 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.445407:0:19209:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009419fa80/0x6d188eabd8d72009 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c03d expref: 26 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.445415:0:19209:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483033792:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.445432:0:19209:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96480 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.446005:0:8342:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880088b2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8342:1800404483033024:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.446017:0:8342:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.446121:0:17365:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.446128:0:17365:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.446134:0:17365:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.446140:0:17365:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.446146:0:17365:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.446153:0:17365:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833a80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.446155:0:17365:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.446161:0:17365:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.446171:0:17365:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.446176:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091833a80/0x6d188eabd8dc8a25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.446368:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3218:x1800404483032128:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10248us (10389us total) trans 4294970253 rc 0/0 00000100:00100000:1.0:1716999794.446374:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10181 00000004:00080000:1.0:1716999794.446398:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131c3dc00/2, rc 0, transno 2957 00000100:00100000:1.0:1716999794.446405:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131c3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483032128:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.446432:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1716999794.446438:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483033856:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.446456:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.446469:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483033856 00000100:00100000:1.0:1716999794.446472:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483033856 00000100:00100000:1.0:1716999794.446485:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10193 00000100:00100000:1.0:1716999794.446488:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3217:x1800404483033856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.446499:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:883 count 1 00010000:00010000:1.0:1716999794.446508:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.446529:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4693 00000100:00100000:2.0:1716999794.446535:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4695 00000100:00100000:2.0:1716999794.446540:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+26:1958:x1800404480854336:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.446548:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.446551:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009419e1c0/0x6d188eabd8d7228d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c163 expref: 26 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.446559:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009419e1c0/0x6d188eabd8d7228d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c163 expref: 26 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.446561:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4696 00000100:00100000:3.0:1716999794.446566:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+25:1958:x1800404480854464:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.446569:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009419e1c0/0x6d188eabd8d7228d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x378:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c163 expref: 26 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.446573:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.446577:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131f8c000/0x6d188eabd8d722d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c186 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.446582:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.446584:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.446585:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131f8c000/0x6d188eabd8d722d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c186 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.446586:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446592:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.446594:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4697 00010000:00010000:3.0:1716999794.446596:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131f8c000/0x6d188eabd8d722d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c186 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.446600:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+25:1958:x1800404480854592:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.446603:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.446605:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.446605:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.446606:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.446607:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.446611:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e50480/0x6d188eabd8d71e34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf64 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.446614:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.446618:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e50480/0x6d188eabd8d71e34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf64 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.446619:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+25:1958:x1800404480854336:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 79us (1795us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.446623:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4695 00010000:00010000:3.0:1716999794.446627:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.446627:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e50480/0x6d188eabd8d71e34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x371:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf64 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.446634:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4698 00010000:00010000:0.0:1716999794.446636:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1716999794.446637:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+24:1958:x1800404480854784:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.446637:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.446639:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.446642:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+24:1958:x1800404480854464:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 76us (1806us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999794.446642:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.446645:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446646:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801339faac0/0x6d188eabd8d71c6d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be99 expref: 24 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.446647:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4696 00010000:00010000:2.0:1716999794.446652:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801339faac0/0x6d188eabd8d71c6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be99 expref: 24 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.446656:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.446659:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4699 00010000:00010000:2.0:1716999794.446660:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801339faac0/0x6d188eabd8d71c6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be99 expref: 23 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.446663:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+23:1958:x1800404480855104:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.446667:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1716999794.446667:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+23:1958:x1800404480854592:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 68us (1821us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999794.446668:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.446668:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.446671:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.446672:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e51200/0x6d188eabd8d72327 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1a9 expref: 23 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.446672:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4697 00010000:00010000:2.0:1716999794.446676:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.446680:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e51200/0x6d188eabd8d72327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1a9 expref: 22 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.446682:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4700 00000100:00100000:0.0:1716999794.446685:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+22:1958:x1800404480854976:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.446686:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.446689:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e51200/0x6d188eabd8d72327 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1a9 expref: 22 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.446691:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.446694:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f8eac0/0x6d188eabd8d723c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1ef expref: 22 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.446696:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+22:1958:x1800404480854784:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 59us (1826us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999794.446697:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.446698:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.446701:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.446701:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4698 00010000:00010000:0.0:1716999794.446701:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f8eac0/0x6d188eabd8d723c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1ef expref: 21 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.446707:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.446709:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4701 00010000:00010000:0.0:1716999794.446710:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f8eac0/0x6d188eabd8d723c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c1ef expref: 21 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.446712:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+21:1958:x1800404480855168:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.446717:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.446717:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.446717:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.446718:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.446720:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446721:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e53a80/0x6d188eabd8d720a3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c083 expref: 20 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.446726:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446727:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e53a80/0x6d188eabd8d720a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c083 expref: 20 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.446728:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+20:1958:x1800404480855104:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 65us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.446734:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4699 00010000:00010000:2.0:1716999794.446735:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e53a80/0x6d188eabd8d720a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x375:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c083 expref: 20 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.446736:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.446742:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.446743:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1716999794.446744:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+18:1958:x1800404480854976:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 58us (1865us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999794.446745:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.446748:0:8340:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.446749:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4700 00010000:00010000:2.0:1716999794.446750:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.446754:0:8340:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.446760:0:8340:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446760:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.446766:0:8340:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.446767:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+17:1958:x1800404480855168:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 54us (1832us total) trans 0 rc 0/0 00010000:00010000:0.0:1716999794.446780:0:17860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.446782:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4701 00010000:00010000:3.0:1716999794.446784:0:8340:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.446787:0:17860:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.446790:0:8340:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830480 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.446792:0:8340:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.446793:0:17860:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.446798:0:8340:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.446798:0:17860:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.446808:0:8340:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.446808:0:17860:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.446812:0:17860:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6bcc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.446813:0:8340:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091830480/0x6d188eabd8dc8a09 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.446815:0:17860:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.446820:0:17860:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.446827:0:17860:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446829:0:17697:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.446832:0:17860:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e6bcc0/0x6d188eabd8dc89ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x378:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446835:0:17697:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446840:0:17697:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446845:0:17697:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446851:0:17697:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446855:0:17697:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.446862:0:17697:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446867:0:17697:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446891:0:17697:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446897:0:17697:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e69680/0x6d188eabd8dc89df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x377:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446938:0:19196:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446945:0:19196:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446950:0:19196:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446955:0:19196:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446960:0:19196:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446965:0:19196:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830fc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.446967:0:19196:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446972:0:19196:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446980:0:19196:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.446984:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091830fc0/0x6d188eabd8dc8a33 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.447006:0:17860:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3219:x1800404483030912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14462us (15162us total) trans 4294970216 rc 0/0 00000100:00100000:0.0:1716999794.447012:0:17860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10173 00000100:00100000:3.0:1716999794.447017:0:8340:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3217:x1800404483031808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11315us (11500us total) trans 4294970254 rc 0/0 00000100:00100000:3.0:1716999794.447023:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10177 00010000:00010000:0.0:1716999794.447028:0:19200:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.447034:0:19200:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.447040:0:19200:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.447046:0:19200:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.447051:0:19200:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.447056:0:19200:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69f80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.447058:0:19200:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.447063:0:19200:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.447071:0:19200:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.447075:0:19200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e69f80/0x6d188eabd8dc8a17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.447117:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+68:3219:x1800404483032320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10829us (11087us total) trans 4294970255 rc 0/0 00000100:00100000:2.0:1716999794.447122:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10183 00000100:00100000:3.0:1716999794.447140:0:17697:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+67:3218:x1800404483031104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15429us (15457us total) trans 4294970256 rc 0/0 00000100:00100000:3.0:1716999794.447145:0:17697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10171 00000004:00080000:3.0:1716999794.447166:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb2e680/2, rc 0, transno 2958 00000100:00100000:3.0:1716999794.447173:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483031808:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1716999794.447192:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+67:3219:x1800404483032064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11198us (11322us total) trans 4294970217 rc 0/0 00000100:00100000:0.0:1716999794.447197:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10179 00000100:00100000:3.0:1716999794.447263:0:11262:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a694bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11262:1800404483033088:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.447275:0:11262:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447303:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339fbcc0/0x6d188eabd8d71ffb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c02f expref: 21 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447310:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.447311:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.447313:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.447316:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:17700:1800404483033536:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.447324:0:17700:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447327:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801339fbcc0/0x6d188eabd8d71ffb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c02f expref: 21 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447336:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801339fbcc0/0x6d188eabd8d71ffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c02f expref: 21 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.447339:0:2535:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb89880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:2535:1800404483033600:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.447344:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e441880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483033920:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.447344:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:3.0:1716999794.447347:0:2535:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.447360:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96780 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.447383:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008c707b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483033152:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.447393:0:17864:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447405:0:19197:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447415:0:19197:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447421:0:19197:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447427:0:19197:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447432:0:19197:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447436:0:19197:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695e640 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.447438:0:19197:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447443:0:19197:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447451:0:19197:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.447457:0:19197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695e640/0x6d188eabd8dc89d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x379:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.447875:0:21818:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:21818:1800404483033664:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.447899:0:21818:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.447916:0:6809:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855296 00000100:00100000:2.0:1716999794.447919:0:6809:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855296 00010000:00010000:2.0:1716999794.447931:0:6809:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f7b expref: 17 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.447945:0:6809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4702 00000100:00100000:2.0:1716999794.447948:0:6809:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+17:1958:x1800404480855296:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.447954:0:6809:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.447958:0:6809:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f7b expref: 17 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.447965:0:6809:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f7b expref: 17 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.447974:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.447976:0:6809:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.447978:0:6809:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.447984:0:6809:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.447993:0:6809:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.448091:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999794.448096:0:19197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+67:3217:x1800404483031040:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16388us (16419us total) trans 4294970218 rc 0/0 00000100:00100000:1.0:1716999794.448101:0:19197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10170 00000100:00100000:0.0:1716999794.448112:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999794.448117:0:17474:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448123:0:17474:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.448128:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999794.448130:0:17474:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448135:0:17474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448141:0:17474:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.448145:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999794.448146:0:17474:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695cd80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.448149:0:17474:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448154:0:17474:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448161:0:17474:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448166:0:17474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695cd80/0x6d188eabd8dc89fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x37a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.448208:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.448221:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855424 00000100:00100000:0.0:1716999794.448223:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855424 00010000:00010000:0.0:1716999794.448232:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e52640/0x6d188eabd8d71f61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfe9 expref: 22 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.448241:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855232 00000100:00100000:0.0:1716999794.448243:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855232 00010000:00010000:0.0:1716999794.448248:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e533c0/0x6d188eabd8d71f6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bff7 expref: 18 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.448255:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855360 00000100:00100000:0.0:1716999794.448257:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855360 00010000:00010000:0.0:1716999794.448262:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801339f9b00/0x6d188eabd8d71ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfa3 expref: 23 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.448269:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855488 00000100:00100000:0.0:1716999794.448270:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855488 00010000:00010000:0.0:1716999794.448275:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e50240/0x6d188eabd8d72095 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c075 expref: 24 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.448282:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855552 00000100:00100000:1.0:1716999794.448283:0:17474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3219:x1800404483031488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13444us (13646us total) trans 4294970219 rc 0/0 00000100:00100000:0.0:1716999794.448284:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855552 00000100:00100000:1.0:1716999794.448288:0:17474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10175 00010000:00010000:0.0:1716999794.448289:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801339fa640/0x6d188eabd8d71d9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf1e expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.448297:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4703 00000100:00100000:0.0:1716999794.448301:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+25:1958:x1800404480855424:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.448308:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.448311:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e52640/0x6d188eabd8d71f61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfe9 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.448316:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e52640/0x6d188eabd8d71f61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfe9 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.448320:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1716999794.448325:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e52640/0x6d188eabd8d71f61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfe9 expref: 25 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.448329:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483033984:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1716999794.448333:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.448334:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.448336:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448341:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.448350:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1716999794.448352:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00080000:1.0:1716999794.448362:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131c3c000/2, rc 0, transno 2960 00000100:00100000:0.0:1716999794.448369:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+24:1958:x1800404480855424:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 67us (278us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999794.448372:0:2535:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.448373:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4703 00000100:00100000:1.0:1716999794.448374:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483031104:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999794.448379:0:2535:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.448383:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4704 00000100:00100000:1.0:1716999794.448384:0:17474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483033984 00010000:00010000:3.0:1716999794.448386:0:2535:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.448387:0:17474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483033984 00000100:00100000:0.0:1716999794.448387:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+18:1958:x1800404480855232:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.448392:0:2535:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448392:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.448396:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e533c0/0x6d188eabd8d71f6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bff7 expref: 18 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.448397:0:2535:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.448397:0:17474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10194 00000100:00100000:1.0:1716999794.448400:0:17474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3220:x1800404483033984:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1716999794.448407:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e533c0/0x6d188eabd8d71f6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bff7 expref: 18 pid: 8340 timeout: 413 lvb_type: 0 00002000:00080000:1.0:1716999794.448409:0:17474:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:873 count 1 00010000:00010000:3.0:1716999794.448411:0:2535:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53840 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.448414:0:2535:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448416:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e533c0/0x6d188eabd8d71f6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x373:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bff7 expref: 18 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.448417:0:17474:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.448419:0:2535:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448423:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.448424:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1716999794.448425:0:17474:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e50000/0x6d188eabd8d719d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd6c expref: 23 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448426:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.448428:0:2535:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448430:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.448431:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.448431:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.448433:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c53840/0x6d188eabd8dc8a64 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448433:0:17474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448442:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999794.448444:0:17474:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e50000/0x6d188eabd8d719d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd6c expref: 23 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448451:0:17474:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e50000/0x6d188eabd8d719d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd6c expref: 23 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.448452:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+17:1958:x1800404480855232:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 64us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.448457:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4704 00000100:00100000:1.0:1716999794.448462:0:17474:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e440e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:17474:1800404483034048:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.448465:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4705 00000100:00100000:0.0:1716999794.448468:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+23:1958:x1800404480855360:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.448473:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1716999794.448476:0:17474:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96240 going to sleep for 11 seconds 00010000:00010000:0.0:1716999794.448476:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801339f9b00/0x6d188eabd8d71ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfa3 expref: 23 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.448483:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801339f9b00/0x6d188eabd8d71ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfa3 expref: 23 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.448492:0:19195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008efb7840/0x6d188eabd8dc68f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65f7b expref: 16 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.448495:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801339f9b00/0x6d188eabd8d71ec7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x371:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bfa3 expref: 23 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.448499:0:19195:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008c707100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:19195:1800404483033408:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.448500:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.448502:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.448504:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448507:0:19195:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448509:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448513:0:19195:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448518:0:19195:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448518:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999794.448524:0:19195:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.448528:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+22:1958:x1800404480855360:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 60us (399us total) trans 0 rc 0/0 00010000:00010000:1.0:1716999794.448529:0:19195:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.448533:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4705 00010000:00010000:1.0:1716999794.448535:0:19195:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448539:0:19195:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c000 already unused, calling callback (ffffffffa0864a40) 00000100:00100000:0.0:1716999794.448541:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4706 00010000:00010000:1.0:1716999794.448542:0:19195:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.448544:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+21:1958:x1800404480855488:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1716999794.448548:0:19195:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448549:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.448552:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e50240/0x6d188eabd8d72095 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c075 expref: 21 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.448555:0:19195:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448558:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e50240/0x6d188eabd8d72095 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c075 expref: 21 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.448561:0:19195:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695c000/0x6d188eabd8dc8a56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19195 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448566:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e50240/0x6d188eabd8d72095 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x374:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c075 expref: 21 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.448575:0:2535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+68:3217:x1800404483033280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4258us (4358us total) trans 4294970257 rc 0/0 00010000:00010000:0.0:1716999794.448576:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.448577:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.448579:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.448580:0:2535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10190 00010000:00010000:0.0:1716999794.448584:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448593:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.448598:0:11262:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.448604:0:11262:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.448604:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+20:1958:x1800404480855488:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 58us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.448608:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4706 00010000:00010000:3.0:1716999794.448610:0:11262:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.448616:0:11262:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.448617:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4707 00000100:00100000:0.0:1716999794.448620:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+19:1959:x1800404480855552:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.448621:0:11262:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448625:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.448626:0:11262:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52880 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.448628:0:11262:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448629:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801339fa640/0x6d188eabd8d71d9a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf1e expref: 19 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.448633:0:11262:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448635:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801339fa640/0x6d188eabd8d71d9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf1e expref: 19 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.448640:0:11262:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448643:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801339fa640/0x6d188eabd8d71d9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bf1e expref: 19 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.448646:0:11262:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c52880/0x6d188eabd8dc8a48 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448650:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.448651:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.448653:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448659:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.448669:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.448681:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+18:1959:x1800404480855552:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 60us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.448686:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4707 00000100:00100000:1.0:1716999794.448687:0:19195:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+67:3219:x1800404483033344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4990us (5026us total) trans 4294970220 rc 0/0 00000100:00100000:1.0:1716999794.448691:0:19195:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10188 00010000:00010000:1.0:1716999794.448702:0:17864:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448708:0:17864:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448714:0:17864:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448719:0:17864:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.448724:0:17864:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.448768:0:21818:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.448784:0:21818:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.448790:0:21818:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.448795:0:21818:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.448800:0:21818:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.448805:0:21818:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831d40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.448807:0:21818:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.448816:0:21818:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.448824:0:21818:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.448829:0:21818:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091831d40/0x6d188eabd8dc8a6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.449024:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+67:3217:x1800404483032832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5733us (5770us total) trans 4294970221 rc 0/0 00000100:00100000:2.0:1716999794.449025:0:21818:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800889fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+68:3220:x1800404483033472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4703us (4749us total) trans 4294970258 rc 0/0 00000100:00100000:3.0:1716999794.449030:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10186 00000100:00100000:2.0:1716999794.449033:0:21818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10191 00000004:00080000:3.0:1716999794.449051:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c704700/2, rc 0, transno 2961 00000100:00100000:3.0:1716999794.449058:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008c704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483033280:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1716999794.449067:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a694a300/2, rc 0, transno 2925 00000100:00100000:3.0:1716999794.449072:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a694a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483032832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.449078:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:3.0:1716999794.449079:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880129f4aa00/2, rc 0, transno 2922 00000100:00100000:3.0:1716999794.449082:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483031040:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.449083:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483034176:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999794.449092:0:17700:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.449098:0:17700:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.449104:0:17700:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.449109:0:17700:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.449114:0:17700:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.449120:0:17700:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.449122:0:17700:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.449127:0:17700:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.449135:0:17700:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.449141:0:17700:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091833180/0x6d188eabd8dc8a5d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.449225:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.449240:0:21818:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483034176 00000100:00100000:2.0:1716999794.449242:0:21818:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483034176 00000100:00100000:2.0:1716999794.449253:0:21818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10195 00000100:00100000:2.0:1716999794.449256:0:21818:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+69:3218:x1800404483034176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.449264:0:21818:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:874 count 1 00010000:00010000:2.0:1716999794.449272:0:21818:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.449280:0:21818:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339f8480/0x6d188eabd8d71a98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc0 expref: 17 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.449281:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+69:3217:x1800404483033216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5059us (5121us total) trans 4294970259 rc 0/0 00000100:00100000:3.0:1716999794.449287:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10189 00010000:00010000:2.0:1716999794.449289:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.449290:0:21818:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.449292:0:21818:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.449303:0:21818:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801339f8480/0x6d188eabd8d71a98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc0 expref: 17 pid: 17365 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999794.449306:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c705c00/2, rc 0, transno 2963 00010000:00010000:2.0:1716999794.449308:0:21818:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801339f8480/0x6d188eabd8d71a98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc0 expref: 17 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.449311:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008c705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483033216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.449315:0:21818:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:21818:1800404483034240:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.449329:0:21818:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6180 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.449352:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483034304:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.449365:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.449375:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483034304 00000100:00100000:2.0:1716999794.449377:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483034304 00000100:00100000:2.0:1716999794.449386:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10196 00000100:00100000:2.0:1716999794.449389:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+69:3218:x1800404483034304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.449396:0:11262:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:876 count 1 00010000:00010000:2.0:1716999794.449402:0:11262:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.449410:0:11262:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8801339fa400/0x6d188eabd8d71bcc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be4c expref: 17 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.449418:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.449420:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.449421:0:11262:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.449431:0:11262:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8801339fa400/0x6d188eabd8d71bcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be4c expref: 17 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.449437:0:11262:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8801339fa400/0x6d188eabd8d71bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be4c expref: 17 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.449443:0:11262:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11262:1800404483034368:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.449454:0:11262:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.449464:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483034112:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.449477:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1716999794.449489:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800889fca80/2, rc 0, transno 2962 00000100:00100000:2.0:1716999794.449493:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800889fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483033472:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.449508:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1716999794.449512:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483034432:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.449522:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.449532:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483034112 00000100:00100000:2.0:1716999794.449534:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483034112 00000100:00100000:2.0:1716999794.449544:0:2535:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483034432 00000100:00100000:2.0:1716999794.449546:0:2535:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483034432 00000100:00100000:2.0:1716999794.449555:0:2535:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10197 00000100:00100000:2.0:1716999794.449558:0:2535:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+71:3220:x1800404483034112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1716999794.449566:0:2535:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:875 count 1 00010000:00010000:2.0:1716999794.449574:0:2535:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.449582:0:2535:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092e50d80/0x6d188eabd8d71b32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdff expref: 17 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.449587:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.449588:0:2535:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.449590:0:2535:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449632:0:17864:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695fa80 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.449635:0:17864:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449641:0:17864:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449650:0:17864:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449655:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695fa80/0x6d188eabd8dc8a4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.449796:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c706300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+72:3219:x1800404483032960:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6463us (6491us total) trans 4294970260 rc 0/0 00000100:00100000:1.0:1716999794.449802:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10187 00000100:00100000:1.0:1716999794.449812:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10198 00000100:00100000:1.0:1716999794.449815:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+71:3220:x1800404483034432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.449824:0:17864:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1541 count 1 00010000:00010000:1.0:1716999794.449832:0:17864:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449841:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6594d expref: 17 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449846:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.449848:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.449849:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449861:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6594d expref: 17 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449868:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6594d expref: 17 pid: 17700 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.449875:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e442300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483034496:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.449908:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.449960:0:8342:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449967:0:8342:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449973:0:8342:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449978:0:8342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449984:0:8342:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449989:0:8342:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e68900 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.449991:0:8342:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.449996:0:8342:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.450003:0:8342:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.450009:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e68900/0x6d188eabd8dc8a41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.450042:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483034624:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.450064:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.450083:0:17697:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483034624 00000100:00100000:3.0:1716999794.450086:0:17697:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483034624 00000100:00100000:3.0:1716999794.450100:0:17697:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10199 00000100:00100000:3.0:1716999794.450104:0:17697:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+68:3217:x1800404483034624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.450115:0:17697:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1550 count 1 00010000:00010000:3.0:1716999794.450125:0:17697:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.450134:0:17697:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f6603f expref: 15 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.450135:0:8342:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6948e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+68:3220:x1800404483032896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6890us (6917us total) trans 4294970222 rc 0/0 00010000:00010000:3.0:1716999794.450140:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1716999794.450140:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10185 00010000:00010000:3.0:1716999794.450141:0:17697:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.450143:0:17697:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.450157:0:17697:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6603f expref: 15 pid: 19196 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999794.450162:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c706680/2, rc 0, transno 2924 00010000:00010000:3.0:1716999794.450165:0:17697:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6603f expref: 15 pid: 19196 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.450169:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008c706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483033344:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.450173:0:17697:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f48a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:17697:1800404483034688:192.168.203.3@tcp:104: 00000004:00080000:1.0:1716999794.450176:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008c707800/2, rc 0, transno 2964 00000100:00100000:1.0:1716999794.450181:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008c707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483032960:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1716999794.450188:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88012b7f5500/2, rc 0, transno 2959 00000100:00100000:1.0:1716999794.450190:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88012b7f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483032320:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.450191:0:17697:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219300 going to sleep for 11 seconds 00000004:00080000:1.0:1716999794.450196:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb2c380/2, rc 0, transno 2921 00000100:00100000:1.0:1716999794.450199:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483032064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.450205:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483034560:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1716999794.450205:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb2e300/2, rc 0, transno 2923 00000100:00100000:1.0:1716999794.450208:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483031488:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1716999794.450214:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880131c3f100/2, rc 0, transno 2920 00000100:00100000:1.0:1716999794.450217:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131c3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483030912:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.450266:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483034816:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.450280:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.450288:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483035072:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.450291:0:19200:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483034816 00000100:00100000:0.0:1716999794.450294:0:19200:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483034816 00000100:00100000:1.0:1716999794.450298:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.450306:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1716999794.450306:0:19200:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10200 00000100:00100000:1.0:1716999794.450309:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483034880:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.450309:0:19200:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+72:3219:x1800404483034816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1716999794.450317:0:19200:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1550 count 1 00000100:00100000:1.0:1716999794.450320:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1716999794.450325:0:19200:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.450331:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483035072 00000100:00100000:1.0:1716999794.450333:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483035072 00010000:00010000:0.0:1716999794.450333:0:19200:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fdd expref: 17 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.450338:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.450339:0:19200:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1716999794.450342:0:8342:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483034880 00010000:00010000:0.0:1716999794.450342:0:19200:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.450344:0:8342:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483034880 00000100:00100000:1.0:1716999794.450352:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10201 00010000:00010000:0.0:1716999794.450354:0:19200:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fdd expref: 17 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.450355:0:8342:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+69:3219:x1800404483035072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.450362:0:8342:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:1551 count 1 00010000:00010000:0.0:1716999794.450366:0:19200:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fdd expref: 17 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.450369:0:8342:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.450373:0:19200:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880088b2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483035136:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.450376:0:8342:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660bd expref: 15 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.450381:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.450382:0:8342:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.450384:0:8342:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.450388:0:19200:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ab9bf00 going to sleep for 11 seconds 00010000:00010000:1.0:1716999794.450396:0:8342:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660bd expref: 15 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.450399:0:17860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10202 00000100:00100000:0.0:1716999794.450402:0:17860:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+69:3219:x1800404483034880:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1716999794.450407:0:8342:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660bd expref: 15 pid: 19196 timeout: 413 lvb_type: 0 00002000:00080000:0.0:1716999794.450410:0:17860:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:875 count 1 00000100:00100000:1.0:1716999794.450415:0:8342:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e442d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8342:1800404483035200:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.450416:0:17860:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.450423:0:17860:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e51440/0x6d188eabd8d71a9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc7 expref: 15 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.450428:0:8342:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96900 going to sleep for 11 seconds 00010000:00010000:0.0:1716999794.450428:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.450429:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.450431:0:17860:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.450443:0:17860:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e51440/0x6d188eabd8d71a9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc7 expref: 15 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.450450:0:17860:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e51440/0x6d188eabd8d71a9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc7 expref: 15 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.450457:0:17860:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880088b2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:17860:1800404483035264:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.450471:0:17860:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ab9be40 going to sleep for 11 seconds 00010000:00010000:2.0:1716999794.450541:0:2535:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092e50d80/0x6d188eabd8d71b32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdff expref: 17 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.450548:0:2535:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092e50d80/0x6d188eabd8d71b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdff expref: 17 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.450556:0:2535:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:2535:1800404483035328:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.450575:0:2535:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.450587:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483034752:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.450599:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.450613:0:17700:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483034560 00000100:00100000:2.0:1716999794.450616:0:17700:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483034560 00000100:00100000:2.0:1716999794.450628:0:17700:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10203 00000100:00100000:2.0:1716999794.450632:0:17700:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:3220:x1800404483034560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1716999794.450640:0:17700:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:874 count 1 00010000:00010000:2.0:1716999794.450648:0:17700:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.450656:0:17700:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092e51d40/0x6d188eabd8d71a05 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd81 expref: 15 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.450661:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.450662:0:17700:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.450664:0:17700:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.450677:0:17700:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092e51d40/0x6d188eabd8d71a05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd81 expref: 15 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.450684:0:17700:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092e51d40/0x6d188eabd8d71a05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd81 expref: 15 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.450692:0:17700:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17700:1800404483035392:192.168.203.3@tcp:104: 00000004:00080000:3.0:1716999794.450701:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800a6949880/2, rc 0, transno 2926 00000100:00100000:2.0:1716999794.450706:0:17700:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6240 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.450707:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800a6949880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483032896:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.450717:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.450726:0:8340:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483034752 00000100:00100000:3.0:1716999794.450729:0:8340:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483034752 00000100:00100000:2.0:1716999794.450729:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483035008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999794.450742:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999794.450743:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10204 00000100:00100000:3.0:1716999794.450747:0:8340:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3218:x1800404483034752:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.450751:0:3218:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1716999794.450755:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483034944:0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1716999794.450757:0:8340:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1540 count 1 00000100:00100000:2.0:1716999794.450765:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1716999794.450766:0:8340:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.450791:0:8340:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f658cf expref: 17 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.450796:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.450798:0:8340:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.450800:0:8340:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.450807:0:19197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483035008 00000100:00100000:2.0:1716999794.450810:0:19197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483035008 00010000:00010000:3.0:1716999794.450814:0:8340:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658cf expref: 17 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.450821:0:8340:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658cf expref: 17 pid: 17700 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.450826:0:19197:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483034944 00000100:00100000:2.0:1716999794.450828:0:19197:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483034944 00000100:00100000:3.0:1716999794.450830:0:8340:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8340:1800404483035456:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.450842:0:19197:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10205 00000100:00100000:2.0:1716999794.450846:0:19197:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+72:3218:x1800404483035008:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.450848:0:8340:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219d80 going to sleep for 11 seconds 00002000:00080000:2.0:1716999794.450857:0:19197:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:877 count 1 00000100:00100000:3.0:1716999794.450860:0:19196:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10206 00000100:00100000:3.0:1716999794.450865:0:19196:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+72:3218:x1800404483034944:12345-0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1716999794.450867:0:19197:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00002000:00080000:3.0:1716999794.450875:0:19196:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:876 count 1 00010000:00010000:2.0:1716999794.450890:0:19197:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009419e640/0x6d188eabd8d71bd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be53 expref: 15 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.450899:0:19196:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.450901:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.450902:0:19197:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.450904:0:19197:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.450909:0:19196:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131f8e1c0/0x6d188eabd8d71b39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be0d expref: 15 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.450918:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.450919:0:19196:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1716999794.450921:0:19196:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.450922:0:19197:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009419e640/0x6d188eabd8d71bd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be53 expref: 15 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.450930:0:19197:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009419e640/0x6d188eabd8d71bd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be53 expref: 15 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.450935:0:19196:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131f8e1c0/0x6d188eabd8d71b39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be0d expref: 15 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.450942:0:19197:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19197:1800404483035520:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.450943:0:19196:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131f8e1c0/0x6d188eabd8d71b39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be0d expref: 15 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.450951:0:19196:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483035584:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.450961:0:19197:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.450969:0:19196:0:(client.c:2542:ptlrpc_set_wait()) set ffff880136219000 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.450982:0:6809:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:107d663a-2216-406b-94c6-b2fcb1558728+15:1958:x1800404480855296:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 3030us (3635us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.450989:0:6809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4702 00000100:00100000:1.0:1716999794.451247:0:3219:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1716999794.451253:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8800995a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483035648:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.451269:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.451907:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483035648 00000100:00100000:1.0:1716999794.451911:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483035648 00000100:00100000:1.0:1716999794.451930:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10207 00000100:00100000:1.0:1716999794.451934:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+73:3219:x1800404483035648:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999794.451946:0:15837:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:839 count 1 00010000:00010000:1.0:1716999794.451959:0:15837:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.451971:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800920f8b40/0x6d188eabd8d6f680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4afc0 expref: 14 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.451977:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.451978:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.451980:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.451995:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800920f8b40/0x6d188eabd8d6f680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4afc0 expref: 14 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.452007:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800920f8b40/0x6d188eabd8d6f680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4afc0 expref: 14 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.452015:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483035712:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.452036:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96840 going to sleep for 11 seconds 00000100:00100000:1.0:1716999794.453329:0:19209:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_018:lustre-OST0000_UUID:19209:1800404483033792:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.453342:0:19209:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.453356:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999794.453359:0:17474:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e440e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:17474:1800404483034048:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.453368:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:1.0:1716999794.453369:0:17474:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.453384:0:21818:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_019:lustre-OST0001_UUID:21818:1800404483034240:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.453396:0:21818:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.453417:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855680 00000100:00100000:3.0:1716999794.453420:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855680 00010000:00010000:3.0:1716999794.453434:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e50000/0x6d188eabd8d719d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd6c expref: 18 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.453449:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855808 00000100:00100000:3.0:1716999794.453451:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855808 00010000:00010000:3.0:1716999794.453459:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801339f8480/0x6d188eabd8d71a98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc0 expref: 19 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.453476:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4708 00000100:00100000:3.0:1716999794.453479:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+19:1958:x1800404480855680:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.453487:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.453491:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e50000/0x6d188eabd8d719d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd6c expref: 19 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.453498:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e50000/0x6d188eabd8d719d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd6c expref: 19 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.453512:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e50000/0x6d188eabd8d719d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x369:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd6c expref: 19 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.453522:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.453523:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.453526:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.453532:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.453545:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1716999794.453645:0:17474:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.453651:0:17474:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.453658:0:17474:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.453664:0:17474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.453675:0:17474:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.453681:0:17474:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695f3c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.453684:0:17474:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.453690:0:17474:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.453699:0:17474:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.453705:0:17474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695f3c0/0x6d188eabd8dc8a80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.453806:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.453819:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.453829:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.453865:0:17365:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e441880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:17365:1800404483033920:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.453874:0:17365:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.453876:0:17697:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f48a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:17697:1800404483034688:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.453905:0:17697:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.453910:0:11262:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11262:1800404483034368:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.453919:0:11262:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.453934:0:17474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+74:3220:x1800404483033984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5533us (5583us total) trans 4294970261 rc 0/0 00000100:00100000:1.0:1716999794.453940:0:17474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10194 00000100:00100000:1.0:1716999794.453959:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e442300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483034496:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999794.453968:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855872 00010000:00010000:1.0:1716999794.453969:0:17864:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.453970:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855872 00010000:00010000:2.0:1716999794.453979:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801339fa400/0x6d188eabd8d71bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be4c expref: 19 pid: 17365 timeout: 413 lvb_type: 0 00000004:00080000:1.0:1716999794.453986:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a6a1c00/2, rc 0, transno 2965 00000100:00100000:2.0:1716999794.453988:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855936 00000100:00100000:2.0:1716999794.453989:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855936 00000100:00100000:1.0:1716999794.453992:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483033984:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.453995:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6594d expref: 20 pid: 17700 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.454002:0:16642:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856000 00000100:00100000:2.0:1716999794.454003:0:16642:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856000 00010000:00010000:2.0:1716999794.454010:0:16642:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6603f expref: 15 pid: 19196 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.454017:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4709 00000100:00100000:2.0:1716999794.454022:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+20:1958:x1800404480855808:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1716999794.454026:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483035776:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.454027:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.454030:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801339f8480/0x6d188eabd8d71a98 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc0 expref: 20 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.454037:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801339f8480/0x6d188eabd8d71a98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc0 expref: 20 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.454043:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1716999794.454047:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801339f8480/0x6d188eabd8d71a98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc0 expref: 20 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.454054:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.454055:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1716999794.454056:0:17474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483035776 00010000:00010000:2.0:1716999794.454058:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.454058:0:17474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483035776 00010000:00010000:2.0:1716999794.454063:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.454069:0:17474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10208 00000100:00100000:1.0:1716999794.454072:0:17474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+74:3217:x1800404483035776:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.454074:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00080000:1.0:1716999794.454082:0:17474:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1552 count 1 00010000:00010000:1.0:1716999794.454090:0:17474:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.454091:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+19:1958:x1800404480855808:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 69us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.454096:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4709 00010000:00010000:1.0:1716999794.454098:0:17474:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f66126 expref: 19 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.454103:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.454104:0:17474:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1716999794.454106:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4710 00010000:00010000:1.0:1716999794.454106:0:17474:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.454109:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+18:1957:x1800404480855872:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.454114:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.454117:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801339fa400/0x6d188eabd8d71bcc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be4c expref: 18 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.454118:0:17474:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66126 expref: 18 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.454124:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801339fa400/0x6d188eabd8d71bcc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be4c expref: 18 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.454126:0:17474:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66126 expref: 18 pid: 8341 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.454132:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801339fa400/0x6d188eabd8d71bcc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be4c expref: 18 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.454133:0:17474:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:17474:1800404483035840:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.454142:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.454143:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.454145:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.454147:0:17474:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1716999794.454151:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.454160:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999794.454172:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+17:1957:x1800404480855872:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 61us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.454177:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4710 00010000:00010000:3.0:1716999794.454178:0:21818:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.454184:0:21818:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.454190:0:21818:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.454195:0:21818:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.454200:0:21818:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.454204:0:21818:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800918306c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.454206:0:21818:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.454211:0:21818:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.454218:0:21818:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.454223:0:21818:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918306c0/0x6d188eabd8dc8a87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21818 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.454366:0:21818:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_019:lustre-MDT0000-mdtlov_UUID+75:3218:x1800404483034176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5107us (5139us total) trans 4294970262 rc 0/0 00000100:00100000:3.0:1716999794.454372:0:21818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10195 00000004:00080000:1.0:1716999794.454494:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a6a2680/2, rc 0, transno 2966 00000100:00100000:1.0:1716999794.454501:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483034176:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.454524:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1716999794.454529:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008e442300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483035904:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.454545:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.454567:0:15837:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483035712:192.168.203.3@tcp:104: 00010000:00010000:1.0:1716999794.454577:0:15837:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.454673:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4711 00000100:00100000:3.0:1716999794.454679:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+16:1957:x1800404480855936:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1716999794.454679:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4712 00000100:00100000:0.0:1716999794.454684:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+15:1957:x1800404480856000:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.454687:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.454690:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.454692:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6594d expref: 16 pid: 17700 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.454695:0:19197:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_015:lustre-OST0000_UUID:19197:1800404483035520:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.454695:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6603f expref: 15 pid: 19196 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.454699:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6594d expref: 16 pid: 17700 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.454702:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6603f expref: 15 pid: 19196 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.454703:0:19197:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.454710:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdcfc0/0x6d188eabd8dc56b6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x605:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6594d expref: 16 pid: 17700 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.454713:0:11262:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.454713:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090c94fc0/0x6d188eabd8dc6b38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f6603f expref: 15 pid: 19196 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.454718:0:11262:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.454720:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.454720:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.454721:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.454722:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.454723:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.454724:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.454725:0:11262:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.454730:0:11262:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.454730:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.454736:0:11262:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.454741:0:11262:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833600 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.454743:0:11262:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.454746:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.454749:0:11262:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.454756:0:11262:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.454762:0:11262:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091833600/0x6d188eabd8dc8a8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.454779:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+14:1957:x1800404480856000:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 87us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.454784:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4712 00000100:00100000:2.0:1716999794.454932:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3218:x1800404483034304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5541us (5565us total) trans 4294970263 rc 0/0 00000100:00100000:2.0:1716999794.454938:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10196 00010000:00010000:0.0:1716999794.454940:0:17697:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.454945:0:17697:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.454946:0:11262:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483035904 00000100:00100000:2.0:1716999794.454948:0:11262:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483035904 00010000:00010000:0.0:1716999794.454951:0:17697:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.454958:0:11262:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10209 00010000:00010000:0.0:1716999794.454958:0:17697:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.454961:0:11262:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+75:3217:x1800404483035904:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1716999794.454963:0:17697:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.454968:0:17697:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c52d00 already unused, calling callback (ffffffffa0864a40) 00002000:00080000:2.0:1716999794.454970:0:11262:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1551 count 1 00010000:00010000:0.0:1716999794.454971:0:17697:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.454975:0:17697:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.454978:0:11262:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.454983:0:17697:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.454990:0:11262:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f660af expref: 15 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.454993:0:17697:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c52d00/0x6d188eabd8dc8aa3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17697 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.454995:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.454996:0:11262:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999794.454998:0:11262:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.455009:0:11262:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660af expref: 15 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.455015:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.455017:0:11262:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660af expref: 15 pid: 19196 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.455024:0:11262:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11262:1800404483035968:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.455034:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999794.455043:0:11262:0:(client.c:2542:ptlrpc_set_wait()) set ffff8800a58b6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1716999794.455052:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+15:1957:x1800404480855936:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 372us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.455059:0:17700:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:17700:1800404483035392:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.455061:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4711 00010000:00010000:2.0:1716999794.455068:0:17700:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.455082:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+14:1958:x1800404480855680:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1602us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.455083:0:2535:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_020:lustre-OST0001_UUID:2535:1800404483035328:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.455087:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4708 00010000:00010000:2.0:1716999794.455090:0:2535:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.455141:0:17697:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+74:3217:x1800404483034624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5035us (5076us total) trans 4294970223 rc 0/0 00000100:00100000:0.0:1716999794.455147:0:17697:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10199 00000100:00100000:0.0:1716999794.455166:0:19196:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f48380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_014:lustre-OST0000_UUID:19196:1800404483035584:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.455177:0:19196:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.455194:0:8340:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8340:1800404483035456:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.455201:0:8340:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.455245:0:17864:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.455252:0:17864:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.455258:0:17864:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.455268:0:17864:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.455273:0:17864:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.455278:0:17864:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695d8c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.455280:0:17864:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.455289:0:17864:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.455297:0:17864:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.455300:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695d8c0/0x6d188eabd8dc8a9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x605:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.455402:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+76:3220:x1800404483034432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5585us (5878us total) trans 4294970264 rc 0/0 00000100:00100000:1.0:1716999794.455407:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10198 00000004:00080000:2.0:1716999794.455426:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a6a0700/2, rc 0, transno 2968 00000004:00080000:1.0:1716999794.455426:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e440380/2, rc 0, transno 2927 00000100:00100000:2.0:1716999794.455442:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483034432:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.455442:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e440380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483034624:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1716999794.455455:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a6a1180/2, rc 0, transno 2967 00000100:00100000:1.0:1716999794.455458:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483034304:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.455852:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483036032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.455871:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.455948:0:8341:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036032 00000100:00100000:0.0:1716999794.455952:0:8341:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036032 00000100:00100000:0.0:1716999794.455968:0:8341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10210 00000100:00100000:0.0:1716999794.455971:0:8341:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+76:3219:x1800404483036032:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1716999794.455981:0:8341:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:1548 count 1 00010000:00010000:0.0:1716999794.455990:0:8341:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.455999:0:8341:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e7f expref: 13 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.456009:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.456010:0:8341:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.456012:0:8341:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.456027:0:8341:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e7f expref: 13 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.456034:0:8341:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e7f expref: 13 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.456042:0:8341:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880088b2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8341:1800404483036096:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.456062:0:8341:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ab9b240 going to sleep for 11 seconds 00000100:00100000:2.0:1716999794.456135:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880129f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483036160:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.456154:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1716999794.456245:0:17864:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036160 00000100:00100000:1.0:1716999794.456249:0:17864:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036160 00000100:00100000:1.0:1716999794.456276:0:17864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10211 00000100:00100000:1.0:1716999794.456280:0:17864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+77:3220:x1800404483036160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1716999794.456290:0:17864:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:839 count 1 00010000:00010000:1.0:1716999794.456298:0:17864:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.456308:0:17864:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800920fbcc0/0x6d188eabd8d6f791 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x40000000020000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b022 expref: 13 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.456313:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.456314:0:17864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999794.456316:0:17864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.456332:0:17864:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800920fbcc0/0x6d188eabd8d6f791 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x50000000030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b022 expref: 13 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.456339:0:17864:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800920fbcc0/0x6d188eabd8d6f791 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x70000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b022 expref: 13 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:1.0:1716999794.456347:0:17864:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483036224:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999794.456365:0:17864:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099e96840 going to sleep for 11 seconds 00000100:00100000:0.0:1716999794.457478:0:19200:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880088b2ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_016:lustre-OST0001_UUID:19200:1800404483035136:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.457492:0:19200:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.457561:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.457579:0:17860:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880088b2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:17860:1800404483035264:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.457587:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:0.0:1716999794.457589:0:17860:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.457601:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.457613:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.457622:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.457631:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.457636:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855616 00000100:00100000:3.0:1716999794.457640:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.457640:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855616 00000100:00100000:3.0:1716999794.457650:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.457654:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8801339fbcc0/0x6d188eabd8d71ffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c02f expref: 14 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.457658:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.457667:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.457667:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856128 00000100:00100000:2.0:1716999794.457669:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856128 00000100:00100000:3.0:1716999794.457677:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00010000:00010000:2.0:1716999794.457677:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e51d40/0x6d188eabd8d71a05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd81 expref: 14 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.457686:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480855744 00000100:00100000:2.0:1716999794.457688:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480855744 00010000:00010000:2.0:1716999794.457694:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009419fa80/0x6d188eabd8d72009 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c03d expref: 15 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.457702:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856256 00000100:00100000:2.0:1716999794.457703:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856256 00010000:00010000:2.0:1716999794.457709:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009419e640/0x6d188eabd8d71bd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be53 expref: 16 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.457716:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856064 00000100:00100000:2.0:1716999794.457718:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856064 00000100:00100000:1.0:1716999794.457723:0:8342:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e442d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8342:1800404483035200:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.457724:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092e50d80/0x6d188eabd8d71b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdff expref: 15 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.457731:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856384 00000100:00100000:2.0:1716999794.457733:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856384 00010000:00010000:1.0:1716999794.457735:0:8342:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.457739:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131f8e1c0/0x6d188eabd8d71b39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be0d expref: 17 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.457747:0:6807:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856192 00000100:00100000:2.0:1716999794.457748:0:6807:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856192 00010000:00010000:2.0:1716999794.457754:0:6807:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658cf expref: 16 pid: 17700 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.457857:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856512 00000100:00100000:0.0:1716999794.457861:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856512 00010000:00010000:0.0:1716999794.457870:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092e51440/0x6d188eabd8d71a9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc7 expref: 18 pid: 8340 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.457899:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856320 00000100:00100000:0.0:1716999794.457901:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856320 00010000:00010000:0.0:1716999794.457908:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800920f8b40/0x6d188eabd8d6f680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4afc0 expref: 19 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.457915:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856448 00000100:00100000:0.0:1716999794.457917:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856448 00010000:00010000:0.0:1716999794.457922:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fdd expref: 17 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.457929:0:20877:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856576 00000100:00100000:0.0:1716999794.457931:0:20877:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856576 00010000:00010000:0.0:1716999794.457936:0:20877:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660bd expref: 20 pid: 19196 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.457946:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4713 00000100:00100000:0.0:1716999794.457950:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+17:1959:x1800404480855616:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.457958:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.457961:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8801339fbcc0/0x6d188eabd8d71ffb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c02f expref: 17 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.457969:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8801339fbcc0/0x6d188eabd8d71ffb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c02f expref: 17 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.457982:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8801339fbcc0/0x6d188eabd8d71ffb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x373:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c02f expref: 17 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.457995:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.457996:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.458000:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.458006:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.458020:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1716999794.458041:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:1959:x1800404480855616:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 89us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.458046:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4713 00000100:00100000:0.0:1716999794.458057:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4714 00000100:00100000:0.0:1716999794.458061:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+20:1958:x1800404480856128:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1716999794.458066:0:17474:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:17474:1800404483035840:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.458067:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1716999794.458071:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e51d40/0x6d188eabd8d71a05 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd81 expref: 20 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:1.0:1716999794.458077:0:17474:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.458078:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e51d40/0x6d188eabd8d71a05 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd81 expref: 20 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.458087:0:20877:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e51d40/0x6d188eabd8d71a05 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bd81 expref: 20 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.458095:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.458096:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.458098:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.458159:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4715 00000100:00100000:2.0:1716999794.458163:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+19:1959:x1800404480855744:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.458170:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.458175:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009419fa80/0x6d188eabd8d72009 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c03d expref: 19 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.458182:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009419fa80/0x6d188eabd8d72009 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c03d expref: 19 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.458192:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009419fa80/0x6d188eabd8d72009 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x374:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4c03d expref: 19 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.458201:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.458203:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.458205:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458211:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.458217:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4716 00000100:00100000:3.0:1716999794.458222:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+18:1958:x1800404480856256:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.458227:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.458229:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.458233:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009419e640/0x6d188eabd8d71bd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be53 expref: 18 pid: 17860 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.458241:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009419e640/0x6d188eabd8d71bd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be53 expref: 18 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.458243:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+18:1959:x1800404480855744:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 79us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.458248:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4715 00010000:00010000:3.0:1716999794.458251:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009419e640/0x6d188eabd8d71bd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be53 expref: 18 pid: 17860 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.458257:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4717 00000100:00100000:2.0:1716999794.458261:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+15:1959:x1800404480856064:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.458263:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.458264:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.458266:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.458267:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458270:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092e50d80/0x6d188eabd8d71b32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdff expref: 15 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.458273:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458277:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092e50d80/0x6d188eabd8d71b32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdff expref: 15 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.458286:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.458286:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092e50d80/0x6d188eabd8d71b32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdff expref: 15 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.458293:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.458294:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.458297:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.458302:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f49880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+16:1958:x1800404480856256:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 80us (688us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999794.458303:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.458308:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4716 00010000:00010000:2.0:1716999794.458313:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.458320:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4718 00000100:00100000:3.0:1716999794.458324:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+15:1958:x1800404480856384:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1716999794.458325:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+14:1959:x1800404480856064:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 63us (702us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999794.458329:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1716999794.458330:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4717 00010000:00010000:3.0:1716999794.458333:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131f8e1c0/0x6d188eabd8d71b39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be0d expref: 15 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.458339:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4719 00010000:00010000:3.0:1716999794.458340:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131f8e1c0/0x6d188eabd8d71b39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be0d expref: 15 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.458343:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+15:1958:x1800404480856512:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.458348:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.458349:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131f8e1c0/0x6d188eabd8d71b39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4be0d expref: 15 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.458351:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092e51440/0x6d188eabd8d71a9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc7 expref: 15 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.458355:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.458356:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.458359:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458359:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092e51440/0x6d188eabd8d71a9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc7 expref: 14 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.458363:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458367:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092e51440/0x6d188eabd8d71a9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 61440->65535) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4bdc7 expref: 14 pid: 8340 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.458374:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.458375:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.458375:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.458377:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458383:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.458389:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+13:1958:x1800404480856384:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 64us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.458395:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4718 00010000:00010000:2.0:1716999794.458399:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.458406:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4720 00000100:00100000:3.0:1716999794.458409:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+12:1959:x1800404480856320:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1716999794.458411:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+12:1958:x1800404480856512:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 68us (760us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999794.458414:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1716999794.458416:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4719 00010000:00010000:3.0:1716999794.458418:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800920f8b40/0x6d188eabd8d6f680 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4afc0 expref: 12 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.458425:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800920f8b40/0x6d188eabd8d6f680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4afc0 expref: 11 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.458427:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4721 00000100:00100000:2.0:1716999794.458431:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+13:1959:x1800404480856448:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.458434:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800920f8b40/0x6d188eabd8d6f680 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4194303) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4afc0 expref: 11 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.458436:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.458439:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fdd expref: 13 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.458441:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.458442:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.458444:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458446:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fdd expref: 13 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.458449:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458455:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090c95b00/0x6d188eabd8dc6a2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65fdd expref: 13 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.458462:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.458462:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.458463:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.458465:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458471:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.458476:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+10:1959:x1800404480856320:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 66us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.458481:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4720 00010000:00010000:2.0:1716999794.458481:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.458492:0:25864:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4722 00000100:00100000:2.0:1716999794.458493:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+12:1959:x1800404480856448:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 61us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.458495:0:25864:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+9:1959:x1800404480856576:12345-192.168.203.3@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1716999794.458498:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4721 00010000:00010000:3.0:1716999794.458501:0:25864:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.458505:0:25864:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660bd expref: 9 pid: 19196 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.458507:0:6807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4723 00000100:00100000:2.0:1716999794.458510:0:6807:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+11:1959:x1800404480856192:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.458512:0:25864:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660bd expref: 9 pid: 19196 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.458515:0:6807:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.458519:0:6807:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658cf expref: 11 pid: 17700 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.458521:0:25864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091832ac0/0x6d188eabd8dc6c8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660bd expref: 9 pid: 19196 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.458526:0:6807:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658cf expref: 11 pid: 17700 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.458527:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.458528:0:25864:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.458531:0:25864:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.458536:0:25864:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458536:0:6807:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918ea640/0x6d188eabd8dc5535 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f658cf expref: 11 pid: 17700 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.458543:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.458544:0:6807:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.458546:0:6807:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.458547:0:25864:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.458552:0:6807:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.458561:0:25864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:107d663a-2216-406b-94c6-b2fcb1558728+8:1959:x1800404480856576:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 64us (883us total) trans 0 rc 0/0 00010000:00010000:2.0:1716999794.458563:0:6807:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1716999794.458565:0:25864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4722 00000100:00100000:2.0:1716999794.458573:0:6807:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:107d663a-2216-406b-94c6-b2fcb1558728+10:1959:x1800404480856192:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 61us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.458578:0:6807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4723 00010000:00010000:3.0:1716999794.458582:0:19197:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.458588:0:19197:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.458594:0:19197:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.458600:0:19197:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.458606:0:19197:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.458606:0:11262:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11262:1800404483035968:192.168.203.3@tcp:104: 00010000:00010000:3.0:1716999794.458611:0:19197:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091830240 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.458614:0:19197:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458615:0:11262:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.458620:0:19197:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458627:0:8340:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458633:0:8340:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.458634:0:19197:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.458638:0:19197:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091830240/0x6d188eabd8dc8acd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19197 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458640:0:8340:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.458645:0:8342:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458646:0:8340:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458651:0:8340:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.458653:0:8342:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458656:0:8340:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c521c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.458659:0:8340:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.458660:0:8342:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458664:0:8340:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.458666:0:8342:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.458671:0:8342:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458672:0:8340:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.458676:0:8342:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695d680 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.458678:0:8340:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131c521c0/0x6d188eabd8dc8ac6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x604:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8340 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.458678:0:8342:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.458684:0:8342:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.458693:0:8342:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.458699:0:8342:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695d680/0x6d188eabd8dc8ab1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8342 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.458845:0:8340:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+78:3218:x1800404483034752:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8096us (8126us total) trans 4294970265 rc 0/0 00000100:00100000:3.0:1716999794.458849:0:19197:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+75:3218:x1800404483035008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8001us (8104us total) trans 4294970224 rc 0/0 00000100:00100000:2.0:1716999794.458851:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10204 00000100:00100000:3.0:1716999794.458857:0:19197:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10205 00010000:00010000:2.0:1716999794.458867:0:2535:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.458867:0:8342:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:3219:x1800404483035072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8510us (8567us total) trans 4294970225 rc 0/0 00010000:00010000:3.0:1716999794.458873:0:19196:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458874:0:2535:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.458874:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10201 00010000:00010000:3.0:1716999794.458893:0:19196:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458894:0:2535:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.458900:0:19196:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458900:0:2535:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.458906:0:19196:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.458906:0:2535:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.458911:0:19196:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999794.458915:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e443800/2, rc 0, transno 2969 00010000:00010000:3.0:1716999794.458916:0:19196:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880131c53cc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.458918:0:19196:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.458922:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483034752:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1716999794.458923:0:19196:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1716999794.458931:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e442680/2, rc 0, transno 2928 00010000:00010000:3.0:1716999794.458932:0:19196:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.458937:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e442680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483035008:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1716999794.458938:0:19196:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131c53cc0/0x6d188eabd8dc8ad4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19196 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459015:0:19209:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459022:0:19209:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459029:0:19209:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459034:0:19209:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459040:0:19209:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459044:0:19209:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695e400 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.459046:0:19209:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459046:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459051:0:19209:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459058:0:17860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459063:0:19209:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459064:0:17860:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459069:0:19209:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695e400/0x6d188eabd8dc8a72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19209 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.459071:0:19196:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+74:3218:x1800404483034944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8205us (8304us total) trans 4294970226 rc 0/0 00010000:00010000:0.0:1716999794.459071:0:17860:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.459076:0:19196:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10206 00010000:00010000:0.0:1716999794.459076:0:17860:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459082:0:17860:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459087:0:17860:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6b180 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.459089:0:17860:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459094:0:17860:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459102:0:17860:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459108:0:17860:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880132e6b180/0x6d188eabd8dc8ab8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999794.459152:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e443480/2, rc 0, transno 2929 00000100:00100000:3.0:1716999794.459158:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e443480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483035072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999794.459203:0:19209:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+74:3217:x1800404483033728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14025us (14068us total) trans 4294970227 rc 0/0 00000100:00100000:1.0:1716999794.459209:0:19209:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10192 00000100:00100000:1.0:1716999794.459227:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483036288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.459248:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999794.459258:0:17860:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+74:3219:x1800404483034880:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8853us (8935us total) trans 4294970228 rc 0/0 00000004:00080000:1.0:1716999794.459262:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb2d180/2, rc 0, transno 2931 00000100:00100000:0.0:1716999794.459263:0:17860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10202 00000100:00100000:1.0:1716999794.459267:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483033728:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.459272:0:17860:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036288 00000100:00100000:0.0:1716999794.459275:0:17860:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036288 00000004:00080000:1.0:1716999794.459281:0:3218:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e440700/2, rc 0, transno 2930 00000100:00100000:1.0:1716999794.459284:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e440700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483034944:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1716999794.459288:0:17860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10212 00000100:00100000:0.0:1716999794.459292:0:17860:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b87c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:3217:x1800404483036288:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1716999794.459299:0:15837:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00002000:00080000:0.0:1716999794.459304:0:17860:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:840 count 1 00010000:00010000:1.0:1716999794.459305:0:15837:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459310:0:15837:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459314:0:17860:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459316:0:15837:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459322:0:15837:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459324:0:17860:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012facc6c0/0x6d188eabd8d6f9b3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0d1 expref: 9 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459327:0:15837:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695fcc0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.459329:0:15837:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459329:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.459330:0:17860:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1716999794.459332:0:17860:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459335:0:15837:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459342:0:15837:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459346:0:17860:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012facc6c0/0x6d188eabd8d6f9b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0d1 expref: 9 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.459348:0:15837:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a695fcc0/0x6d188eabd8dc8adb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459354:0:17860:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012facc6c0/0x6d188eabd8d6f9b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0d1 expref: 9 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.459367:0:17860:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880088b2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:17860:1800404483036352:192.168.203.3@tcp:104: 00000100:00100000:0.0:1716999794.459389:0:17860:0:(client.c:2542:ptlrpc_set_wait()) set ffff88009ab9be40 going to sleep for 11 seconds 00010000:00010000:0.0:1716999794.459400:0:19200:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459406:0:19200:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459412:0:19200:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459417:0:19200:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459422:0:19200:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459427:0:19200:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6b600 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.459429:0:19200:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459434:0:19200:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459443:0:19200:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.459448:0:19200:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e6b600/0x6d188eabd8dc8aaa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19200 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999794.459511:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e441500/2, rc 0, transno 2932 00000100:00100000:3.0:1716999794.459518:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e441500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483034880:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1716999794.459545:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999794.459647:0:19200:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+79:3219:x1800404483034816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9336us (9365us total) trans 4294970266 rc 0/0 00000100:00100000:0.0:1716999794.459652:0:19200:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10200 00010000:00010000:0.0:1716999794.459672:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1716999794.459698:0:2535:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831440 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.459701:0:2535:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.459707:0:2535:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.459714:0:2535:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.459718:0:2535:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091831440/0x6d188eabd8dc8a95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 2535 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.459729:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.459855:0:2535:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_020:lustre-MDT0000-mdtlov_UUID+79:3220:x1800404483034112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10295us (10376us total) trans 4294970267 rc 0/0 00000100:00100000:2.0:1716999794.459861:0:2535:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10197 00010000:00010000:2.0:1716999794.459877:0:17700:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.459897:0:17700:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.459903:0:17700:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.459909:0:17700:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.459914:0:17700:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.459918:0:17700:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091833840 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:2.0:1716999794.459920:0:17700:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.459926:0:17700:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.459934:0:17700:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.459939:0:17700:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091833840/0x6d188eabd8dc8abf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17700 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.459954:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999794.459975:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000004:00080000:3.0:1716999794.459992:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e443100/2, rc 0, transno 2970 00000100:00100000:3.0:1716999794.459996:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e443100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483034816:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1716999794.460007:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856640 00000100:00100000:3.0:1716999794.460010:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856640 00010000:00010000:3.0:1716999794.460022:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66126 expref: 10 pid: 8341 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.460032:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856704 00000100:00100000:3.0:1716999794.460034:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856704 00010000:00010000:3.0:1716999794.460040:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660af expref: 11 pid: 19196 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.460051:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856768 00000100:00100000:3.0:1716999794.460052:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856768 00010000:00010000:3.0:1716999794.460059:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e7f expref: 12 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.460059:0:17700:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+74:3220:x1800404483034560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9426us (9459us total) trans 4294970229 rc 0/0 00000100:00100000:2.0:1716999794.460064:0:17700:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10203 00000100:00100000:3.0:1716999794.460066:0:15839:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856832 00000100:00100000:3.0:1716999794.460068:0:15839:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856832 00010000:00010000:3.0:1716999794.460074:0:15839:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800920fbcc0/0x6d188eabd8d6f791 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b022 expref: 13 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.460080:0:16642:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4724 00000100:00100000:3.0:1716999794.460094:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4725 00000100:00100000:3.0:1716999794.460098:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+13:1958:x1800404480856704:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1716999794.460104:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.460107:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660af expref: 13 pid: 19196 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.460114:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660af expref: 13 pid: 19196 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.460117:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+7:1958:x1800404480856128:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 1622us (2096us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.460122:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4714 00010000:00010000:3.0:1716999794.460125:0:15839:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918333c0/0x6d188eabd8dc6c73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f660af expref: 13 pid: 19196 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.460132:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.460134:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.460137:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.460146:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.460148:0:20877:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4726 00000100:00100000:0.0:1716999794.460152:0:20877:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a694bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+12:1956:x1800404480856768:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.460158:0:20877:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.460160:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.460162:0:20877:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e7f expref: 12 pid: 17365 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.460170:0:20877:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e7f expref: 12 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:3.0:1716999794.460177:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6949f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+12:1958:x1800404480856704:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 78us (448us total) trans 0 rc 0/0 00010000:00010000:0.0:1716999794.460179:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1716999794.460180:0:20877:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1716999794.460183:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4725 00010000:00010000:0.0:1716999794.460183:0:20877:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460188:0:20877:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.460194:0:15839:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4727 00000100:00100000:3.0:1716999794.460198:0:15839:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+11:1959:x1800404480856832:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1716999794.460201:0:20877:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.460204:0:15839:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1716999794.460207:0:15839:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800920fbcc0/0x6d188eabd8d6f791 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b022 expref: 11 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:3.0:1716999794.460214:0:15839:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800920fbcc0/0x6d188eabd8d6f791 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b022 expref: 11 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.460214:0:20877:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a694bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:107d663a-2216-406b-94c6-b2fcb1558728+11:1956:x1800404480856768:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 61us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999794.460219:0:20877:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4726 00010000:00010000:3.0:1716999794.460223:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.460224:0:15839:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1716999794.460227:0:15839:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.460232:0:15839:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.460241:0:15839:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1716999794.460241:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880135bdc900/0x6d188eabd8dc65f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f65e7f expref: 10 pid: 17365 timeout: 413 lvb_type: 0 00000100:00100000:0.0:1716999794.460251:0:8341:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880088b2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8341:1800404483036096:192.168.203.3@tcp:104: 00000100:00100000:3.0:1716999794.460254:0:15839:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:107d663a-2216-406b-94c6-b2fcb1558728+9:1959:x1800404480856832:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 56us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999794.460260:0:15839:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4727 00010000:00010000:0.0:1716999794.460260:0:8341:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460266:0:8341:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460272:0:8341:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.460275:0:11262:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.460275:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800920fbcc0/0x6d188eabd8d6f791 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x347:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->45055) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b022 expref: 8 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:0.0:1716999794.460278:0:8341:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.460281:0:11262:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1716999794.460284:0:17864:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_011:lustre-OST0001_UUID:17864:1800404483036224:192.168.203.3@tcp:104: 00010000:00010000:0.0:1716999794.460284:0:8341:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.460287:0:11262:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460289:0:8341:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.460292:0:11262:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.460293:0:17864:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.460297:0:11262:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460298:0:8341:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e69d40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.460299:0:17864:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460300:0:8341:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.460302:0:11262:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880091831b00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.460305:0:11262:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460306:0:8341:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.460308:0:17864:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.460310:0:11262:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460313:0:8341:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.460314:0:17864:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.460318:0:11262:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460318:0:8341:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e69d40/0x6d188eabd8dc8af0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.460319:0:17864:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.460323:0:11262:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091831b00/0x6d188eabd8dc8ae9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x60f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.460324:0:17864:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.460329:0:17864:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695ef40 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:1.0:1716999794.460331:0:17864:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.460337:0:17864:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.460345:0:17864:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999794.460350:0:17864:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695ef40/0x6d188eabd8dc8af7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17864 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.460489:0:8341:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+80:3219:x1800404483036032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4516us (4616us total) trans 4294970268 rc 0/0 00000100:00100000:0.0:1716999794.460494:0:8341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10210 00000100:00100000:1.0:1716999794.460517:0:17864:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+79:3220:x1800404483036160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4235us (4361us total) trans 4294970269 rc 0/0 00000100:00100000:1.0:1716999794.460522:0:17864:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10211 00000100:00100000:2.0:1716999794.460546:0:16642:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+13:1958:x1800404480856640:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.460555:0:16642:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.460560:0:16642:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66126 expref: 7 pid: 8341 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.460567:0:16642:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66126 expref: 7 pid: 8341 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.460576:0:16642:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091365b00/0x6d188eabd8dc6dd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x610:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.203.3@tcp remote: 0xa74134e555f66126 expref: 7 pid: 8341 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.460584:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.460585:0:16642:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.460588:0:16642:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.460593:0:16642:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.460605:0:16642:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1716999794.460620:0:16642:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:107d663a-2216-406b-94c6-b2fcb1558728+6:1958:x1800404480856640:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 535us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.460628:0:16642:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4724 00010000:00010000:2.0:1716999794.460683:0:17365:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.460689:0:17365:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.460695:0:17365:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.460700:0:17365:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.460702:0:11262:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+79:3217:x1800404483035904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5738us (6154us total) trans 4294970270 rc 0/0 00010000:00010000:2.0:1716999794.460706:0:17365:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.460708:0:11262:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10209 00000004:00080000:1.0:1716999794.460708:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e442300/2, rc 0, transno 2974 00010000:00010000:2.0:1716999794.460710:0:17365:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c480 already unused, calling callback (ffffffffa0864a40) 00000100:00100000:1.0:1716999794.460712:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e442300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483035904:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1716999794.460713:0:17365:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.460718:0:17365:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.460726:0:17365:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999794.460729:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880129f48a80/2, rc 0, transno 2972 00010000:00010000:2.0:1716999794.460731:0:17365:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695c480/0x6d188eabd8dc8a79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.460732:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483036032:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.460899:0:17365:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+79:3217:x1800404483033856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14409us (14442us total) trans 4294970271 rc 0/0 00000100:00100000:2.0:1716999794.460906:0:17365:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10193 00000004:00080000:1.0:1716999794.460906:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb2fb80/2, rc 0, transno 2975 00000100:00100000:1.0:1716999794.460910:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483033856:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1716999794.460937:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff880129f4a680/2, rc 0, transno 2973 00000100:00100000:3.0:1716999794.460942:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880129f4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483036160:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1716999794.460949:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008e441f80/2, rc 0, transno 2933 00000100:00100000:3.0:1716999794.460955:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008e441f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483034560:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1716999794.460959:0:17474:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1716999794.460961:0:3220:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a6a0a80/2, rc 0, transno 2971 00000100:00100000:3.0:1716999794.460964:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483034112:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1716999794.460966:0:17474:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460973:0:17474:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460978:0:17474:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460984:0:17474:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.460989:0:17474:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff8800a695c6c0 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:0.0:1716999794.460991:0:17474:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.461002:0:17474:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.461011:0:17474:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1716999794.461017:0:17474:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a695c6c0/0x6d188eabd8dc8ae2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x610:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17474 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.461142:0:17474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+79:3217:x1800404483035776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7067us (7097us total) trans 4294970272 rc 0/0 00000004:00080000:1.0:1716999794.461147:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88008eb2df80/2, rc 0, transno 2976 00000100:00100000:0.0:1716999794.461147:0:17474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10208 00000100:00100000:1.0:1716999794.461151:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483035776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1716999794.461752:0:17860:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880088b2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:17860:1800404483036352:192.168.203.3@tcp:104: 00010000:00010000:2.0:1716999794.461766:0:17860:0:(ldlm_request.c:290:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1716999794.462323:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999794.462417:0:6808:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480856896 00000100:00100000:2.0:1716999794.462422:0:6808:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480856896 00010000:00010000:2.0:1716999794.462439:0:6808:0:(ldlm_lockd.c:2705:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012facc6c0/0x6d188eabd8d6f9b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0d1 expref: 6 pid: 11262 timeout: 413 lvb_type: 0 00000100:00100000:2.0:1716999794.462461:0:6808:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 4728 00000100:00100000:2.0:1716999794.462467:0:6808:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+6:1959:x1800404480856896:12345-192.168.203.3@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1716999794.462474:0:6808:0:(ldlm_lockd.c:1791:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1716999794.462478:0:6808:0:(ldlm_lockd.c:1836:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012facc6c0/0x6d188eabd8d6f9b3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x60000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0d1 expref: 6 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.462486:0:6808:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012facc6c0/0x6d188eabd8d6f9b3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0d1 expref: 6 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.462524:0:6808:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012facc6c0/0x6d188eabd8d6f9b3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x44801400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0d1 expref: 6 pid: 11262 timeout: 413 lvb_type: 0 00010000:00010000:2.0:1716999794.462533:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.462535:0:6808:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1716999794.462538:0:6808:0:(ldlm_lock.c:735:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.462544:0:6808:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999794.462564:0:6808:0:(ldlm_lockd.c:1849:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1716999794.462574:0:17860:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.462579:0:17860:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.462584:0:17860:0:(ldlm_lock.c:851:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.462586:0:6808:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:107d663a-2216-406b-94c6-b2fcb1558728+5:1959:x1800404480856896:12345-192.168.203.3@tcp:103:ldlm_bl.0 Request processed in 119us (264us total) trans 0 rc 0/0 00010000:00010000:3.0:1716999794.462587:0:17860:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.462591:0:17860:0:(ldlm_lockd.c:1946:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1716999794.462592:0:6808:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 4728 00010000:00010000:3.0:1716999794.462595:0:17860:0:(ldlm_lockd.c:1960:ldlm_handle_bl_callback()) Lock ffff880132e6ad00 already unused, calling callback (ffffffffa0864a40) 00010000:00010000:3.0:1716999794.462597:0:17860:0:(ldlm_request.c:371:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.462601:0:17860:0:(ldlm_request.c:1322:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.462606:0:17860:0:(ldlm_lockd.c:1970:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1716999794.462609:0:17860:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880132e6ad00/0x6d188eabd8dc8afe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 17860 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1716999794.462798:0:17860:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b87c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+79:3217:x1800404483036288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3504us (3548us total) trans 4294970273 rc 0/0 00000100:00100000:3.0:1716999794.462804:0:17860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10212 00000004:00080000:0.0:1716999794.462829:0:3217:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff88009a6a1500/2, rc 0, transno 2977 00000100:00100000:0.0:1716999794.462833:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88009a6a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483036288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1716999794.471221:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800995a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+74:3219:x1800404483035648:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19280us (19945us total) trans 4294970230 rc 0/0 00000100:00100000:1.0:1716999794.471231:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10207 00000004:00080000:0.0:1716999794.471260:0:3219:0:(osp_sync.c:550:osp_sync_interpret()) reply req ffff8800995a3480/2, rc 0, transno 2934 00000100:00100000:0.0:1716999794.471270:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff8800995a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3219:1800404483035648:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1716999794.534912:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970272 is committed 00000001:00080000:0.0:1716999794.535003:0:10147:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0001: transno 4294970273 is committed 00000001:00080000:1.0:1716999794.554306:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970228 is committed 00000001:00080000:1.0:1716999794.554331:0:8538:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-OST0000: transno 4294970230 is committed 00000004:00080000:2.0:1716999794.610197:0:8677:0:(osp_sync.c:1639:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 313809315091ns, next at 314809309621ns, rc = 0 00000100:00100000:0.0:1716999794.610240:0:3217:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1716999794.610255:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483036416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1716999794.610303:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999794.610398:0:26516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036416 00000100:00100000:2.0:1716999794.610404:0:26516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036416 00000100:00100000:2.0:1716999794.610473:0:26516:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1716999794.610479:0:26516:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1800404483036416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1716999794.610503:0:26516:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 27262976 granted 259457024 pending 0 free 3857711104 avail 3855613952 00000100:00100000:2.0:1716999794.610672:0:26516:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1800404483036416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 193us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999794.610678:0:26516:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1716999794.610750:0:3217:0:(client.c:2952:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294970230 gen 2 00000004:00080000:3.0:1716999794.610754:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9fe680, transno 4294970162 00000004:00080000:3.0:1716999794.610776:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9fce00, transno 4294970163 00000004:00080000:3.0:1716999794.610779:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9ffb80, transno 4294970164 00000004:00080000:3.0:1716999794.610781:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9ff800, transno 4294970165 00000004:00080000:3.0:1716999794.610783:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9ff100, transno 4294970166 00000004:00080000:3.0:1716999794.610785:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9fd500, transno 4294970167 00000004:00080000:3.0:1716999794.610787:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9ff480, transno 4294970168 00000004:00080000:3.0:1716999794.610789:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9fed80, transno 4294970169 00000004:00080000:3.0:1716999794.610791:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092df2680, transno 4294970170 00000004:00080000:3.0:1716999794.610794:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a694b100, transno 4294970171 00000004:00080000:3.0:1716999794.610796:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a6948380, transno 4294970172 00000004:00080000:3.0:1716999794.610798:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a694a680, transno 4294970173 00000004:00080000:3.0:1716999794.610800:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a6949180, transno 4294970174 00000004:00080000:3.0:1716999794.610802:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092df1c00, transno 4294970175 00000004:00080000:3.0:1716999794.610803:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a6948a80, transno 4294970176 00000004:00080000:3.0:1716999794.610805:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a694b480, transno 4294970177 00000004:00080000:3.0:1716999794.610807:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ca9f80, transno 4294970178 00000004:00080000:3.0:1716999794.610809:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800897af800, transno 4294970179 00000004:00080000:3.0:1716999794.610810:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800897ad880, transno 4294970180 00000004:00080000:3.0:1716999794.610812:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a5c11f80, transno 4294970181 00000004:00080000:3.0:1716999794.610814:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a5c12680, transno 4294970182 00000004:00080000:3.0:1716999794.610816:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ca8380, transno 4294970183 00000004:00080000:3.0:1716999794.610818:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995a3800, transno 4294970184 00000004:00080000:3.0:1716999794.610820:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a5c13800, transno 4294970185 00000004:00080000:3.0:1716999794.610821:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a5c11c00, transno 4294970186 00000004:00080000:3.0:1716999794.610823:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a5c13480, transno 4294970187 00000004:00080000:3.0:1716999794.610825:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995a2d80, transno 4294970188 00000004:00080000:3.0:1716999794.610826:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995a1f80, transno 4294970189 00000004:00080000:3.0:1716999794.610828:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995a1c00, transno 4294970190 00000004:00080000:3.0:1716999794.610830:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995a0a80, transno 4294970191 00000004:00080000:3.0:1716999794.610831:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995a0700, transno 4294970192 00000004:00080000:3.0:1716999794.610833:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995a2a00, transno 4294970193 00000004:00080000:3.0:1716999794.610835:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800889ff800, transno 4294970194 00000004:00080000:3.0:1716999794.610838:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb8b800, transno 4294970195 00000004:00080000:3.0:1716999794.610839:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb8b480, transno 4294970196 00000004:00080000:3.0:1716999794.610841:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a6948700, transno 4294970197 00000004:00080000:3.0:1716999794.610843:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092df2d80, transno 4294970198 00000004:00080000:3.0:1716999794.610845:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092df1500, transno 4294970199 00000004:00080000:3.0:1716999794.610847:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800897ae680, transno 4294970200 00000004:00080000:3.0:1716999794.610849:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092df3100, transno 4294970201 00000004:00080000:3.0:1716999794.610852:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800897adc00, transno 4294970202 00000004:00080000:3.0:1716999794.610854:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092e7c000, transno 4294970203 00000004:00080000:3.0:1716999794.610855:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131caad80, transno 4294970204 00000004:00080000:3.0:1716999794.610857:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131ca9880, transno 4294970205 00000004:00080000:3.0:1716999794.610859:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc1f800, transno 4294970206 00000004:00080000:3.0:1716999794.610861:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131caaa00, transno 4294970207 00000004:00080000:3.0:1716999794.610862:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880099582300, transno 4294970208 00000004:00080000:3.0:1716999794.610865:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131d5e300, transno 4294970209 00000004:00080000:3.0:1716999794.610866:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9fc700, transno 4294970210 00000004:00080000:3.0:1716999794.610868:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131cab100, transno 4294970211 00000004:00080000:3.0:1716999794.610870:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb2f800, transno 4294970212 00000004:00080000:3.0:1716999794.610872:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb2f480, transno 4294970213 00000004:00080000:3.0:1716999794.610874:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb2dc00, transno 4294970214 00000004:00080000:3.0:1716999794.610876:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb2ca80, transno 4294970215 00000004:00080000:3.0:1716999794.610896:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131c3f100, transno 4294970216 00000004:00080000:3.0:1716999794.610898:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb2c380, transno 4294970217 00000004:00080000:3.0:1716999794.610900:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880129f4aa00, transno 4294970218 00000004:00080000:3.0:1716999794.610903:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb2e300, transno 4294970219 00000004:00080000:3.0:1716999794.610905:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c706680, transno 4294970220 00000004:00080000:3.0:1716999794.610907:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a694a300, transno 4294970221 00000004:00080000:3.0:1716999794.610909:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a6949880, transno 4294970222 00000004:00080000:3.0:1716999794.610911:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e440380, transno 4294970223 00000004:00080000:3.0:1716999794.610913:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e442680, transno 4294970224 00000004:00080000:3.0:1716999794.610915:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e443480, transno 4294970225 00000004:00080000:3.0:1716999794.610917:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e440700, transno 4294970226 00000004:00080000:3.0:1716999794.610919:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb2d180, transno 4294970227 00000004:00080000:3.0:1716999794.610921:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e441500, transno 4294970228 00000004:00080000:3.0:1716999794.610923:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e441f80, transno 4294970229 00000004:00080000:3.0:1716999794.610925:0:3217:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995a3480, transno 4294970230 00000100:00100000:3.0:1716999794.610933:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483036416:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1716999794.611283:0:8674:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 0 in progress, 0 in flight, 69 done 00010000:00010000:0.0:1716999795.109204:0:6810:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1716999796.111506:0:6811:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1716999796.865979:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6183665d-a269-4a7c-8dd8-59206e554b99:3219:1800404483036480:0@lo:400:kworker.0 00000100:00100000:2.0:1716999796.866020:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3220:1800404483036544:0@lo:400:kworker.0 00000100:00100000:0.0:1716999796.866040:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999796.866046:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999796.866068:0:3219:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3219:1800404483036736:0@lo:400:kworker.0 00000100:00100000:3.0:1716999796.866214:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3217:1800404483036608:0@lo:400:kworker.0 00000100:00100000:1.0:1716999796.866263:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036544 00000100:00100000:2.0:1716999796.866293:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483036800:0@lo:400:kworker.0 00000100:00100000:0.0:1716999796.866303:0:3219:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999796.866311:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999796.866326:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036736 00000100:00100000:2.0:1716999796.866329:0:6816:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036480 00000100:00100000:0.0:1716999796.866331:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036736 00000100:00100000:2.0:1716999796.866332:0:6816:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036480 00000100:00100000:0.0:1716999796.866363:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1716999796.866368:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3219:x1800404483036736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1716999796.866405:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3219:x1800404483036736:12345-0@lo:400:kworker.0 Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1716999796.866410:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1716999796.866437:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131caaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3219:1800404483036736:0@lo:400:kworker.0 00000100:00100000:0.0:1716999796.866457:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483036672:0@lo:400:kworker.0 00000100:00100000:0.0:1716999796.866474:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999796.866496:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036800 00000100:00100000:0.0:1716999796.866498:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036800 00000100:00100000:1.0:1716999796.866536:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036544 00000100:00100000:1.0:1716999796.866557:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1716999796.866561:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3220:x1800404483036544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1716999796.866589:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3220:x1800404483036544:12345-0@lo:400:kworker.0 Request processed in 27us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999796.866594:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1716999796.866656:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999796.867244:0:6816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1716999796.867248:0:6816:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6183665d-a269-4a7c-8dd8-59206e554b99+18:3219:x1800404483036480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1716999796.867275:0:6816:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6183665d-a269-4a7c-8dd8-59206e554b99+18:3219:x1800404483036480:12345-0@lo:400:kworker.0 Request processed in 26us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999796.867280:0:6816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1716999796.867297:0:6823:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036608 00000100:00100000:2.0:1716999796.867300:0:6823:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036608 00000100:00100000:2.0:1716999796.867312:0:6823:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1716999796.867316:0:6823:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3217:x1800404483036608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1716999796.867336:0:6823:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880092e7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3217:x1800404483036608:12345-0@lo:400:kworker.0 Request processed in 20us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999796.867340:0:6823:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1716999796.867359:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3220:1800404483036544:0@lo:400:kworker.0 00000100:00100000:2.0:1716999796.867374:0:3219:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6183665d-a269-4a7c-8dd8-59206e554b99:3219:1800404483036480:0@lo:400:kworker.0 00000100:00100000:2.0:1716999796.867392:0:17860:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036672 00000100:00100000:2.0:1716999796.867394:0:17860:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036672 00000100:00100000:2.0:1716999796.867408:0:17860:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1716999796.867411:0:17860:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3218:x1800404483036672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1716999796.867430:0:17860:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3218:x1800404483036672:12345-0@lo:400:kworker.0 Request processed in 18us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999796.867434:0:17860:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1716999796.867451:0:3218:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131ca9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483036672:0@lo:400:kworker.0 00000100:00100000:2.0:1716999796.867463:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131caad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3217:1800404483036608:0@lo:400:kworker.0 00000100:00080000:3.0:1716999796.867774:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1716999766 00000100:00080000:3.0:1716999796.867777:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1716999766 00000100:00080000:3.0:1716999796.867779:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1716999766 00000100:00080000:3.0:1716999796.867781:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1716999766 00000100:00100000:1.0:1716999796.867841:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1716999796.867846:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3220:x1800404483036800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1716999796.867896:0:15837:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3220:x1800404483036800:12345-0@lo:400:kworker.0 Request processed in 49us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999796.867900:0:15837:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1716999796.867954:0:3220:0:(client.c:2952:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294970273 gen 2 00000004:00080000:3.0:1716999796.867958:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9fdf80, transno 4294970200 00000004:00080000:3.0:1716999796.867976:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9fd880, transno 4294970201 00000004:00080000:3.0:1716999796.867978:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ea9f800, transno 4294970202 00000004:00080000:3.0:1716999796.867980:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ea9c380, transno 4294970203 00000004:00080000:3.0:1716999796.867982:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008b9fc380, transno 4294970204 00000004:00080000:3.0:1716999796.867984:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ea9e300, transno 4294970205 00000004:00080000:3.0:1716999796.867986:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ea9ed80, transno 4294970206 00000004:00080000:3.0:1716999796.867988:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012ea9c700, transno 4294970207 00000004:00080000:3.0:1716999796.867990:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a694aa00, transno 4294970208 00000004:00080000:3.0:1716999796.867991:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a6949c00, transno 4294970209 00000004:00080000:3.0:1716999796.867994:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800897ad500, transno 4294970210 00000004:00080000:3.0:1716999796.867996:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800a694ad80, transno 4294970211 00000004:00080000:3.0:1716999796.867998:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800897afb80, transno 4294970212 00000004:00080000:3.0:1716999796.868000:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb8a680, transno 4294970213 00000004:00080000:3.0:1716999796.868002:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb89500, transno 4294970214 00000004:00080000:3.0:1716999796.868004:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092df0000, transno 4294970215 00000004:00080000:3.0:1716999796.868006:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb8aa00, transno 4294970216 00000004:00080000:3.0:1716999796.868008:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131d5ed80, transno 4294970217 00000004:00080000:3.0:1716999796.868010:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb88e00, transno 4294970218 00000004:00080000:3.0:1716999796.868041:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb88a80, transno 4294970219 00000004:00080000:3.0:1716999796.868044:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb89f80, transno 4294970220 00000004:00080000:3.0:1716999796.868046:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb8a300, transno 4294970221 00000004:00080000:3.0:1716999796.868047:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb88700, transno 4294970222 00000004:00080000:3.0:1716999796.868052:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131d5f480, transno 4294970223 00000004:00080000:3.0:1716999796.868055:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131d5d180, transno 4294970224 00000004:00080000:3.0:1716999796.868056:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131d5d880, transno 4294970225 00000004:00080000:3.0:1716999796.868058:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131d5dc00, transno 4294970226 00000004:00080000:3.0:1716999796.868060:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092e7f100, transno 4294970227 00000004:00080000:3.0:1716999796.868062:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092e7e680, transno 4294970228 00000004:00080000:3.0:1716999796.868063:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092e7d180, transno 4294970229 00000004:00080000:3.0:1716999796.868065:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092e7c380, transno 4294970230 00000004:00080000:3.0:1716999796.868067:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092e7df80, transno 4294970231 00000004:00080000:3.0:1716999796.868069:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800889fce00, transno 4294970232 00000004:00080000:3.0:1716999796.868071:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800889fd880, transno 4294970233 00000004:00080000:3.0:1716999796.868072:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800897af480, transno 4294970234 00000004:00080000:3.0:1716999796.868074:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092e7fb80, transno 4294970235 00000004:00080000:3.0:1716999796.868076:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880129f4a300, transno 4294970236 00000004:00080000:3.0:1716999796.868078:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880129f49180, transno 4294970237 00000004:00080000:3.0:1716999796.868080:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880129f49f80, transno 4294970238 00000004:00080000:3.0:1716999796.868082:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800897ae300, transno 4294970239 00000004:00080000:3.0:1716999796.868083:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800889fc380, transno 4294970240 00000004:00080000:3.0:1716999796.868085:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092e7c700, transno 4294970241 00000004:00080000:3.0:1716999796.868087:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb88380, transno 4294970242 00000004:00080000:3.0:1716999796.868089:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092e7ca80, transno 4294970243 00000004:00080000:3.0:1716999796.868090:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008fc1f480, transno 4294970244 00000004:00080000:3.0:1716999796.868092:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995a2300, transno 4294970245 00000004:00080000:3.0:1716999796.868094:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880092e7f800, transno 4294970246 00000004:00080000:3.0:1716999796.868096:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800889ff480, transno 4294970247 00000004:00080000:3.0:1716999796.868098:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800889fc000, transno 4294970248 00000004:00080000:3.0:1716999796.868101:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b7f4000, transno 4294970249 00000004:00080000:3.0:1716999796.868103:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995a1500, transno 4294970250 00000004:00080000:3.0:1716999796.868104:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800995a0000, transno 4294970251 00000004:00080000:3.0:1716999796.868106:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c705500, transno 4294970252 00000004:00080000:3.0:1716999796.868108:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131c3dc00, transno 4294970253 00000004:00080000:3.0:1716999796.868110:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb2e680, transno 4294970254 00000004:00080000:3.0:1716999796.868149:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88012b7f5500, transno 4294970255 00000004:00080000:3.0:1716999796.868151:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880131c3c000, transno 4294970256 00000004:00080000:3.0:1716999796.868153:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c704700, transno 4294970257 00000004:00080000:3.0:1716999796.868154:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff8800889fca80, transno 4294970258 00000004:00080000:3.0:1716999796.868156:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c705c00, transno 4294970259 00000004:00080000:3.0:1716999796.868159:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008c707800, transno 4294970260 00000004:00080000:3.0:1716999796.868161:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6a1c00, transno 4294970261 00000004:00080000:3.0:1716999796.868163:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6a2680, transno 4294970262 00000004:00080000:3.0:1716999796.868164:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6a1180, transno 4294970263 00000004:00080000:3.0:1716999796.868166:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6a0700, transno 4294970264 00000004:00080000:3.0:1716999796.868168:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e443800, transno 4294970265 00000004:00080000:3.0:1716999796.868169:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e443100, transno 4294970266 00000004:00080000:3.0:1716999796.868171:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6a0a80, transno 4294970267 00000004:00080000:3.0:1716999796.868173:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880129f48a80, transno 4294970268 00000004:00080000:3.0:1716999796.868175:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff880129f4a680, transno 4294970269 00000004:00080000:3.0:1716999796.868177:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008e442300, transno 4294970270 00000004:00080000:3.0:1716999796.868179:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb2fb80, transno 4294970271 00000004:00080000:3.0:1716999796.868181:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88008eb2df80, transno 4294970272 00000004:00080000:3.0:1716999796.868183:0:3220:0:(osp_sync.c:496:osp_sync_request_commit_cb()) commit req ffff88009a6a1500, transno 4294970273 00000100:00100000:3.0:1716999796.868186:0:3220:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff880131cab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483036800:0@lo:400:kworker.0 00000004:00080000:0.0:1716999796.868340:0:10149:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 61 in progress, 0 in flight, 13 done 00000004:00080000:0.0:1716999796.868572:0:10149:0:(osp_sync.c:1105:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 61 done 00000100:00100000:2.0:1716999796.946595:0:3217:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483036864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1716999796.946651:0:3217:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1716999796.946847:0:26516:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036864 00000100:00100000:0.0:1716999796.946854:0:26516:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036864 00000100:00100000:2.0:1716999796.947018:0:8344:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1716999796.947025:0:8344:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1800404483036864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1716999796.947055:0:8344:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 28966912 granted 244121600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1716999796.948143:0:8344:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131caad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3217:x1800404483036864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1116us (1488us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999796.948150:0:8344:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1716999796.948230:0:3217:0:(client.c:2261:ptlrpc_check_set()) Completed RPC req@ffff88008eb2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3217:1800404483036864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1716999797.113056:0:11317:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1716999797.757192:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.757327:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857024 00000100:00100000:1.0:1716999797.757336:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857024 00000100:00100000:1.0:1716999797.757389:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46759 00000100:00100000:1.0:1716999797.757395:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+11:11604:x1800404480857024:12345-192.168.203.3@tcp:101:diff.0 00010000:00010000:1.0:1716999797.757411:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999797.757425:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8b05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f663bf expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1716999797.757518:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6ac:0x0]: returning size 11776 00010000:00010000:1.0:1716999797.757664:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8b05 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663bf expref: 13 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999797.757672:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695f600/0x6d188eabd8dc8b05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663bf expref: 13 pid: 7785 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1716999797.757677:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 older than 1716999767 00010000:00010000:1.0:1716999797.757913:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a695f600, rc 0) 00000100:00100000:1.0:1716999797.758548:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+12:11604:x1800404480857024:12345-192.168.203.3@tcp:101:diff.0 Request processed in 1150us (1360us total) trans 4294986643 rc 301/301 00000100:00100000:1.0:1716999797.758554:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46759 00000100:00100000:0.0:1716999797.763220:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.763275:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857088 00000100:00100000:3.0:1716999797.763282:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857088 00000100:00100000:3.0:1716999797.763325:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9461 00000100:00100000:3.0:1716999797.763332:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+12:11604:x1800404480857088:12345-192.168.203.3@tcp:37:diff.0 00000100:00100000:3.0:1716999797.768725:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+12:11604:x1800404480857088:12345-192.168.203.3@tcp:37:diff.0 Request processed in 5384us (5502us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.768736:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9461 00000100:00100000:0.0:1716999797.772973:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.773060:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857216 00000100:00100000:3.0:1716999797.773069:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857216 00000100:00100000:3.0:1716999797.773115:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9462 00000100:00100000:3.0:1716999797.773121:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ec21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+12:11604:x1800404480857216:12345-192.168.203.3@tcp:35:diff.0 00000100:00100000:3.0:1716999797.773517:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ec21850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+13:11604:x1800404480857216:12345-192.168.203.3@tcp:35:diff.0 Request processed in 395us (550us total) trans 4294986644 rc 0/0 00000100:00100000:3.0:1716999797.773524:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9462 00000100:00100000:0.0:1716999797.775117:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.775571:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857280 00000100:00100000:1.0:1716999797.775578:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857280 00000100:00100000:1.0:1716999797.775648:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46760 00000100:00100000:1.0:1716999797.775654:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+13:11604:x1800404480857280:12345-192.168.203.3@tcp:101:diff.0 00010000:00010000:1.0:1716999797.775670:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999797.775686:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d200/0x6d188eabd8dc8b13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f663c6 expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999797.775732:0:7785:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc8b1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6af:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999797.775743:0:7785:0:(ldlm_lock.c:1095:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc8b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6af:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999797.775764:0:7785:0:(ldlm_request.c:535:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc8b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6af:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00000004:00200000:1.0:1716999797.775817:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6af:0x0]: returning size 11776 00000004:00200000:1.0:1716999797.775820:0:7785:0:(mdt_handler.c:1570:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1716999797.775831:0:7785:0:(mdt_handler.c:2447:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc8b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6af:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7785 initiator: MDT0 00010000:00010000:1.0:1716999797.775847:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d200/0x6d188eabd8dc8b13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663c6 expref: 15 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999797.776335:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695d440/0x6d188eabd8dc8b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6af:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663c6 expref: 14 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999797.776375:0:7785:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6af:0x0].0x0 (ffff88009ab4aa00) 00010000:00010000:1.0:1716999797.776378:0:7785:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1716999797.776381:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a695d440, rc 0) 00000100:00100000:1.0:1716999797.776422:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+14:11604:x1800404480857280:12345-192.168.203.3@tcp:101:diff.0 Request processed in 768us (1308us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.776428:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46760 00000100:00100000:0.0:1716999797.777803:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.777915:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857408 00000100:00100000:1.0:1716999797.777921:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857408 00000100:00100000:1.0:1716999797.777959:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46761 00000100:00100000:1.0:1716999797.777965:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+14:11604:x1800404480857408:12345-192.168.203.3@tcp:101:diff.0 00010000:00010000:1.0:1716999797.777977:0:7785:0:(ldlm_lockd.c:1317:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1716999797.777990:0:7785:0:(ldlm_lockd.c:1389:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc8b21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xa74134e555f663cd expref: -99 pid: 7785 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1716999797.778745:0:7785:0:(mdt_handler.c:938:mdt_pack_attr2body()) [0x200000401:0x6af:0x0]: returning size 11776 00010000:00010000:1.0:1716999797.778856:0:7785:0:(ldlm_lockd.c:1559:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc8b21 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663cd expref: 16 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999797.778864:0:7785:0:(ldlm_lock.c:215:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a695ed00/0x6d188eabd8dc8b21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6ac:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f663cd expref: 16 pid: 7785 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999797.778872:0:7785:0:(ldlm_lockd.c:1637:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a695ed00, rc 0) 00000100:00100000:1.0:1716999797.779438:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+15:11604:x1800404480857408:12345-192.168.203.3@tcp:101:diff.0 Request processed in 1471us (1636us total) trans 4294986645 rc 301/301 00000100:00100000:1.0:1716999797.779445:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46761 00000100:00100000:0.0:1716999797.783266:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.783415:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857472 00000100:00100000:3.0:1716999797.783422:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857472 00000100:00100000:3.0:1716999797.783850:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9463 00000100:00100000:3.0:1716999797.783857:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+15:11604:x1800404480857472:12345-192.168.203.3@tcp:37:diff.0 00000100:00100000:3.0:1716999797.787456:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+15:11604:x1800404480857472:12345-192.168.203.3@tcp:37:diff.0 Request processed in 3592us (4190us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.787466:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9463 00000100:00100000:0.0:1716999797.789344:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.789449:0:14949:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857600 00000100:00100000:3.0:1716999797.789456:0:14949:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857600 00000100:00100000:3.0:1716999797.789495:0:14949:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 9464 00000100:00100000:3.0:1716999797.789500:0:14949:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+15:11604:x1800404480857600:12345-192.168.203.3@tcp:35:diff.0 00000100:00100000:3.0:1716999797.789857:0:14949:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:107d663a-2216-406b-94c6-b2fcb1558728+16:11604:x1800404480857600:12345-192.168.203.3@tcp:35:diff.0 Request processed in 356us (516us total) trans 4294986646 rc 0/0 00000100:00100000:3.0:1716999797.789864:0:14949:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 9464 00000100:00100000:0.0:1716999797.812518:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.812714:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857664 00000100:00100000:1.0:1716999797.812723:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857664 00000100:00100000:1.0:1716999797.812904:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46762 00000100:00100000:1.0:1716999797.812911:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480857664:12345-192.168.203.3@tcp:501:chlg_load_threa.0 00000100:00100000:1.0:1716999797.813047:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480857664:12345-192.168.203.3@tcp:501:chlg_load_threa.0 Request processed in 136us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.813054:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46762 00000100:00100000:0.0:1716999797.814557:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.814610:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857728 00000100:00100000:2.0:1716999797.814615:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857728 00000100:00100000:2.0:1716999797.814645:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46763 00000100:00100000:2.0:1716999797.814650:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480857728:12345-192.168.203.3@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1716999797.814814:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480857728:12345-192.168.203.3@tcp:503:chlg_load_threa.0 Request processed in 163us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.814820:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46763 00000100:00100000:0.0:1716999797.815693:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.815996:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857792 00000100:00100000:1.0:1716999797.816000:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857792 00000100:00100000:1.0:1716999797.816029:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46764 00000100:00100000:1.0:1716999797.816033:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480857792:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.816165:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480857792:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 130us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.816171:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46764 00000100:00100000:0.0:1716999797.818610:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.818847:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857856 00000100:00100000:2.0:1716999797.818856:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857856 00000100:00100000:2.0:1716999797.818928:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46765 00000100:00100000:2.0:1716999797.818935:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480857856:12345-192.168.203.3@tcp:501:chlg_load_threa.0 00000100:00100000:2.0:1716999797.819024:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480857856:12345-192.168.203.3@tcp:501:chlg_load_threa.0 Request processed in 89us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.819030:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46765 00000100:00100000:0.0:1716999797.822953:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.823048:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857920 00000100:00100000:2.0:1716999797.823056:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857920 00000100:00100000:2.0:1716999797.823101:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46766 00000100:00100000:2.0:1716999797.823107:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480857920:12345-192.168.203.3@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1716999797.823264:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480857920:12345-192.168.203.3@tcp:503:chlg_load_threa.0 Request processed in 157us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.823275:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46766 00000100:00100000:0.0:1716999797.825489:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.825548:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480857984 00000100:00100000:2.0:1716999797.825556:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480857984 00000100:00100000:2.0:1716999797.825610:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46767 00000100:00100000:2.0:1716999797.825617:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880088b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480857984:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999797.825823:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880088b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480857984:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 205us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.825830:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46767 00000100:00100000:1.0:1716999797.833254:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.833313:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858048 00000100:00100000:2.0:1716999797.833324:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858048 00000100:00100000:2.0:1716999797.833374:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46768 00000100:00100000:2.0:1716999797.833381:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858048:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999797.833564:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858048:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 184us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.833571:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46768 00000100:00100000:0.0:1716999797.837358:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.837471:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858112 00000100:00100000:2.0:1716999797.837480:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858112 00000100:00100000:2.0:1716999797.837524:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46769 00000100:00100000:2.0:1716999797.837533:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858112:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999797.838850:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858112:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 1312us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.838859:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46769 00000100:00100000:0.0:1716999797.842570:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.842722:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858176 00000100:00100000:2.0:1716999797.842732:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858176 00000100:00100000:2.0:1716999797.842791:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46770 00000100:00100000:2.0:1716999797.842798:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858176:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999797.844788:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858176:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 1979us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.844801:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46770 00000100:00100000:0.0:1716999797.847815:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.848073:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858240 00000100:00100000:2.0:1716999797.848084:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858240 00000100:00100000:2.0:1716999797.848126:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46771 00000100:00100000:2.0:1716999797.848134:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858240:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999797.848342:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858240:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 207us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.848349:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46771 00000100:00100000:0.0:1716999797.852008:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.852128:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858304 00000100:00100000:2.0:1716999797.852138:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858304 00000100:00100000:2.0:1716999797.852180:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46772 00000100:00100000:2.0:1716999797.852187:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858304:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999797.852417:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858304:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 228us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.852428:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46772 00000100:00100000:0.0:1716999797.854856:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.855107:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858368 00000100:00100000:2.0:1716999797.855115:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858368 00000100:00100000:2.0:1716999797.855150:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46773 00000100:00100000:2.0:1716999797.855157:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858368:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999797.855429:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858368:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 271us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.855440:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46773 00000100:00100000:0.0:1716999797.857541:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.857652:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858432 00000100:00100000:2.0:1716999797.857660:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858432 00000100:00100000:2.0:1716999797.857706:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46774 00000100:00100000:2.0:1716999797.857714:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880099582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858432:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999797.857992:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880099582300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858432:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 277us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.858000:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46774 00000100:00100000:0.0:1716999797.859811:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.859913:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858496 00000100:00100000:1.0:1716999797.859922:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858496 00000100:00100000:1.0:1716999797.859965:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46775 00000100:00100000:1.0:1716999797.859972:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858496:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.860218:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858496:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 246us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.860225:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46775 00000100:00100000:0.0:1716999797.862018:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.862138:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858560 00000100:00100000:1.0:1716999797.862145:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858560 00000100:00100000:1.0:1716999797.862187:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46776 00000100:00100000:1.0:1716999797.862193:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858560:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.862340:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858560:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 146us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.862348:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46776 00000100:00100000:1.0:1716999797.865131:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.865656:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858624 00000100:00100000:3.0:1716999797.865666:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858624 00000100:00100000:3.0:1716999797.865713:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46777 00000100:00100000:3.0:1716999797.865721:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858624:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.865939:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858624:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 218us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.865946:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46777 00000100:00100000:0.0:1716999797.869364:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.869760:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858688 00000100:00100000:1.0:1716999797.869770:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858688 00000100:00100000:1.0:1716999797.869821:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46778 00000100:00100000:1.0:1716999797.869828:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858688:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.870051:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858688:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 222us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.870061:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46778 00000100:00100000:0.0:1716999797.872175:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.872861:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858752 00000100:00100000:3.0:1716999797.872870:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858752 00000100:00100000:3.0:1716999797.873162:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46779 00000100:00100000:3.0:1716999797.873169:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858752:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.873643:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858752:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 473us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.874026:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46779 00000100:00100000:0.0:1716999797.876399:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.876560:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858816 00000100:00100000:3.0:1716999797.876570:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858816 00000100:00100000:3.0:1716999797.877178:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46780 00000100:00100000:3.0:1716999797.877186:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858816:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.877373:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858816:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 188us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.877381:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46780 00000100:00100000:0.0:1716999797.879462:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.879758:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858880 00000100:00100000:1.0:1716999797.879765:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858880 00000100:00100000:1.0:1716999797.880360:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46781 00000100:00100000:1.0:1716999797.880368:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858880:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.880556:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858880:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 188us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.880563:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46781 00000100:00100000:0.0:1716999797.883155:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.883241:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480858944 00000100:00100000:3.0:1716999797.883250:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480858944 00000100:00100000:3.0:1716999797.883320:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46782 00000100:00100000:3.0:1716999797.883327:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858944:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.883657:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480858944:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 329us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.883664:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46782 00000100:00100000:0.0:1716999797.885642:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.885842:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859008 00000100:00100000:3.0:1716999797.885850:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859008 00000100:00100000:3.0:1716999797.886259:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46783 00000100:00100000:3.0:1716999797.886266:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859008:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.886448:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859008:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 182us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.886455:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46783 00000100:00100000:0.0:1716999797.889405:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.889623:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859072 00000100:00100000:1.0:1716999797.889633:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859072 00000100:00100000:1.0:1716999797.889695:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46784 00000100:00100000:1.0:1716999797.889703:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859072:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.889939:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859072:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 235us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.889947:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46784 00000100:00100000:0.0:1716999797.891833:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.891925:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859136 00000100:00100000:3.0:1716999797.891933:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859136 00000100:00100000:3.0:1716999797.891979:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46785 00000100:00100000:3.0:1716999797.891986:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859136:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.892162:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859136:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 175us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.892169:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46785 00000100:00100000:0.0:1716999797.893456:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.893543:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859200 00000100:00100000:3.0:1716999797.893548:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859200 00000100:00100000:3.0:1716999797.893586:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46786 00000100:00100000:3.0:1716999797.893591:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859200:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.893727:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859200:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 134us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.893736:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46786 00000100:00100000:0.0:1716999797.897605:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.897798:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859264 00000100:00100000:1.0:1716999797.897808:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859264 00000100:00100000:1.0:1716999797.897860:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46787 00000100:00100000:1.0:1716999797.897868:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859264:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.898083:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859264:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 215us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.898091:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46787 00000100:00100000:0.0:1716999797.901959:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.902082:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859328 00000100:00100000:3.0:1716999797.902091:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859328 00000100:00100000:3.0:1716999797.902134:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46788 00000100:00100000:3.0:1716999797.902140:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859328:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.902386:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859328:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 244us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.902393:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46788 00000100:00100000:0.0:1716999797.904175:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.904253:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859392 00000100:00100000:3.0:1716999797.904260:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859392 00000100:00100000:3.0:1716999797.904297:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46789 00000100:00100000:3.0:1716999797.904304:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859392:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.904459:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859392:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 155us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.904467:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46789 00000100:00100000:0.0:1716999797.906044:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.907028:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859456 00000100:00100000:1.0:1716999797.907038:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859456 00000100:00100000:1.0:1716999797.907460:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46790 00000100:00100000:1.0:1716999797.907468:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859456:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.907664:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859456:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 197us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.907675:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46790 00000100:00100000:0.0:1716999797.913705:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.914825:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859520 00000100:00100000:3.0:1716999797.914837:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859520 00000100:00100000:3.0:1716999797.914905:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46791 00000100:00100000:3.0:1716999797.914914:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859520:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.915140:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859520:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 227us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.915148:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46791 00000100:00100000:0.0:1716999797.924125:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.924229:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859584 00000100:00100000:1.0:1716999797.924239:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859584 00000100:00100000:1.0:1716999797.924293:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46792 00000100:00100000:1.0:1716999797.924300:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859584:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.924595:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859584:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 294us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.924603:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46792 00000100:00100000:0.0:1716999797.930293:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.930505:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859648 00000100:00100000:1.0:1716999797.930516:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859648 00000100:00100000:1.0:1716999797.930569:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46793 00000100:00100000:1.0:1716999797.930576:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859648:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.931891:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859648:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 1301us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.931901:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46793 00000100:00100000:0.0:1716999797.935165:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.935269:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859712 00000100:00100000:1.0:1716999797.935280:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859712 00000100:00100000:1.0:1716999797.935334:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46794 00000100:00100000:1.0:1716999797.935341:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859712:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.935532:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859712:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 189us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.935540:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46794 00000100:00100000:0.0:1716999797.937714:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.938370:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859776 00000100:00100000:1.0:1716999797.938380:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859776 00000100:00100000:1.0:1716999797.938581:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46795 00000100:00100000:1.0:1716999797.938589:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859776:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.939440:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859776:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 849us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.939449:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46795 00000100:00100000:0.0:1716999797.941660:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.941783:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859840 00000100:00100000:1.0:1716999797.941792:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859840 00000100:00100000:1.0:1716999797.941938:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46796 00000100:00100000:1.0:1716999797.941946:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859840:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.942133:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859840:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 186us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.942139:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46796 00000100:00100000:0.0:1716999797.943327:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.943389:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859904 00000100:00100000:1.0:1716999797.943395:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859904 00000100:00100000:1.0:1716999797.943431:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46797 00000100:00100000:1.0:1716999797.943437:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859904:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.943567:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859904:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 128us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.943574:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46797 00000100:00100000:0.0:1716999797.945189:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.945249:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480859968 00000100:00100000:3.0:1716999797.945257:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480859968 00000100:00100000:3.0:1716999797.945298:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46798 00000100:00100000:3.0:1716999797.945304:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859968:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.945462:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480859968:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 157us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.945469:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46798 00000100:00100000:0.0:1716999797.947402:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.947855:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860032 00000100:00100000:3.0:1716999797.947863:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860032 00000100:00100000:3.0:1716999797.948077:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46799 00000100:00100000:3.0:1716999797.948085:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860032:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.948269:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860032:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 184us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.948276:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46799 00000100:00100000:0.0:1716999797.950241:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.950350:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860096 00000100:00100000:3.0:1716999797.950359:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860096 00000100:00100000:3.0:1716999797.950409:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46800 00000100:00100000:3.0:1716999797.950416:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860096:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.950719:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860096:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 302us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.950726:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46800 00000100:00100000:0.0:1716999797.953376:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.953512:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860160 00000100:00100000:1.0:1716999797.953521:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860160 00000100:00100000:1.0:1716999797.953573:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46801 00000100:00100000:1.0:1716999797.953583:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860160:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.953788:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860160:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 207us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.953799:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46801 00000100:00100000:0.0:1716999797.955862:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.955928:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860224 00000100:00100000:1.0:1716999797.955937:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860224 00000100:00100000:1.0:1716999797.955999:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46802 00000100:00100000:1.0:1716999797.956013:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860224:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.956274:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860224:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 262us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.956281:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46802 00000100:00100000:0.0:1716999797.959408:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.959570:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860288 00000100:00100000:1.0:1716999797.959581:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860288 00000100:00100000:1.0:1716999797.959635:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46803 00000100:00100000:1.0:1716999797.959643:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860288:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.960004:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860288:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 360us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.960011:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46803 00000100:00100000:0.0:1716999797.963358:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.963457:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860352 00000100:00100000:1.0:1716999797.963470:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860352 00000100:00100000:1.0:1716999797.963517:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46804 00000100:00100000:1.0:1716999797.963525:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860352:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.963703:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860352:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 178us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.963710:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46804 00000100:00100000:0.0:1716999797.965710:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.965874:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860416 00000100:00100000:3.0:1716999797.965903:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860416 00000100:00100000:3.0:1716999797.965946:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46805 00000100:00100000:3.0:1716999797.965952:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860416:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.966113:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860416:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 160us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.966124:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46805 00000100:00100000:0.0:1716999797.968526:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.968707:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860480 00000100:00100000:3.0:1716999797.968717:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860480 00000100:00100000:3.0:1716999797.968773:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46806 00000100:00100000:3.0:1716999797.968780:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860480:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.968969:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860480:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 188us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.968975:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46806 00000100:00100000:0.0:1716999797.972833:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.973197:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860544 00000100:00100000:1.0:1716999797.973207:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860544 00000100:00100000:1.0:1716999797.973266:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46807 00000100:00100000:1.0:1716999797.973273:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860544:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.973489:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860544:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 215us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.973496:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46807 00000100:00100000:0.0:1716999797.977570:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:1.0:1716999797.977674:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860608 00000100:00100000:1.0:1716999797.977682:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860608 00000100:00100000:1.0:1716999797.977733:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46808 00000100:00100000:1.0:1716999797.977740:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860608:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:1.0:1716999797.977922:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860608:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 181us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1716999797.977928:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46808 00000100:00100000:0.0:1716999797.979959:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.980302:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860672 00000100:00100000:3.0:1716999797.980310:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860672 00000100:00100000:3.0:1716999797.980351:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46809 00000100:00100000:3.0:1716999797.980357:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860672:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.980500:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860672:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 142us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.980507:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46809 00000100:00100000:0.0:1716999797.983114:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.983721:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860736 00000100:00100000:2.0:1716999797.983728:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860736 00000100:00100000:2.0:1716999797.983778:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46810 00000100:00100000:2.0:1716999797.983785:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860736:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999797.983958:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860736:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 172us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.983965:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46810 00000100:00100000:0.0:1716999797.986326:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.986393:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860800 00000100:00100000:3.0:1716999797.986399:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860800 00000100:00100000:3.0:1716999797.986669:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46811 00000100:00100000:3.0:1716999797.986676:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860800:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.986826:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860800:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 150us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.986833:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46811 00000100:00100000:0.0:1716999797.989498:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999797.989626:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860864 00000100:00100000:2.0:1716999797.989632:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860864 00000100:00100000:2.0:1716999797.989674:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46812 00000100:00100000:2.0:1716999797.989681:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860864:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999797.989832:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860864:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 150us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999797.989839:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46812 00000100:00100000:0.0:1716999797.993179:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999797.993252:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860928 00000100:00100000:3.0:1716999797.993260:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860928 00000100:00100000:3.0:1716999797.993396:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46813 00000100:00100000:3.0:1716999797.993402:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860928:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999797.993806:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860928:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 402us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999797.993812:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46813 00000100:00100000:0.0:1716999797.997557:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.000744:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480860992 00000100:00100000:3.0:1716999798.000763:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480860992 00000100:00100000:3.0:1716999798.001058:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46814 00000100:00100000:3.0:1716999798.001065:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860992:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.001217:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480860992:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 152us (3667us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.001223:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46814 00000100:00100000:0.0:1716999798.004213:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.004307:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861056 00000100:00100000:2.0:1716999798.004315:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861056 00000100:00100000:2.0:1716999798.004363:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46815 00000100:00100000:2.0:1716999798.004370:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861056:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.008847:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861056:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 4466us (4629us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.008858:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46815 00000100:00100000:0.0:1716999798.011730:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.014036:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861120 00000100:00100000:2.0:1716999798.014047:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861120 00000100:00100000:2.0:1716999798.014818:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46816 00000100:00100000:2.0:1716999798.014826:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861120:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.016861:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861120:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 2028us (5131us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.016872:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46816 00000100:00100000:0.0:1716999798.019721:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.020059:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861184 00000100:00100000:2.0:1716999798.020068:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861184 00000100:00100000:2.0:1716999798.020110:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46817 00000100:00100000:2.0:1716999798.020116:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861184:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.020257:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861184:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 141us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.020263:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46817 00000100:00100000:0.0:1716999798.022158:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.022235:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861248 00000100:00100000:3.0:1716999798.022241:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861248 00000100:00100000:3.0:1716999798.022276:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46818 00000100:00100000:3.0:1716999798.022282:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861248:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.022407:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861248:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 125us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.022413:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46818 00000100:00100000:0.0:1716999798.024966:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.025182:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861312 00000100:00100000:2.0:1716999798.025189:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861312 00000100:00100000:2.0:1716999798.025233:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46819 00000100:00100000:2.0:1716999798.025239:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861312:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.025384:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861312:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 144us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.025395:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46819 00000100:00100000:0.0:1716999798.029699:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.029794:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861376 00000100:00100000:3.0:1716999798.029801:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861376 00000100:00100000:3.0:1716999798.029848:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46820 00000100:00100000:3.0:1716999798.029855:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861376:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.030032:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861376:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 177us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.030042:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46820 00000100:00100000:0.0:1716999798.032073:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.032214:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861440 00000100:00100000:2.0:1716999798.032220:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861440 00000100:00100000:2.0:1716999798.032257:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46821 00000100:00100000:2.0:1716999798.032263:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861440:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.032386:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861440:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 122us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.032392:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46821 00000100:00100000:0.0:1716999798.034546:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.034618:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861504 00000100:00100000:3.0:1716999798.034625:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861504 00000100:00100000:3.0:1716999798.034668:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46822 00000100:00100000:3.0:1716999798.034674:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861504:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.034857:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861504:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 182us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.034863:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46822 00000100:00100000:0.0:1716999798.037023:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.037179:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861568 00000100:00100000:2.0:1716999798.037186:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861568 00000100:00100000:2.0:1716999798.037228:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46823 00000100:00100000:2.0:1716999798.037234:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861568:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.037369:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861568:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 134us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.037375:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46823 00000100:00100000:0.0:1716999798.039699:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.039770:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861632 00000100:00100000:3.0:1716999798.039776:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861632 00000100:00100000:3.0:1716999798.039811:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46824 00000100:00100000:3.0:1716999798.039816:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861632:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.039973:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861632:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 156us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.039981:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46824 00000100:00100000:0.0:1716999798.041567:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.042049:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861696 00000100:00100000:2.0:1716999798.042055:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861696 00000100:00100000:2.0:1716999798.042122:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46825 00000100:00100000:2.0:1716999798.042128:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861696:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.042256:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861696:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 127us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.042262:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46825 00000100:00100000:0.0:1716999798.044110:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.044177:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861760 00000100:00100000:3.0:1716999798.044184:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861760 00000100:00100000:3.0:1716999798.044220:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46826 00000100:00100000:3.0:1716999798.044226:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861760:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.044345:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861760:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 118us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.044352:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46826 00000100:00100000:0.0:1716999798.046079:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.046152:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861824 00000100:00100000:2.0:1716999798.046158:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861824 00000100:00100000:2.0:1716999798.046192:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46827 00000100:00100000:2.0:1716999798.046198:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861824:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.046321:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861824:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 122us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.046327:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46827 00000100:00100000:0.0:1716999798.048402:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.048473:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861888 00000100:00100000:3.0:1716999798.048479:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861888 00000100:00100000:3.0:1716999798.048518:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46828 00000100:00100000:3.0:1716999798.048523:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861888:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.048662:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861888:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 138us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.048668:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46828 00000100:00100000:0.0:1716999798.050210:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.050296:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480861952 00000100:00100000:3.0:1716999798.050301:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480861952 00000100:00100000:3.0:1716999798.050335:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46829 00000100:00100000:3.0:1716999798.050340:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861952:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.050454:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480861952:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 110us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.050461:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46829 00000100:00100000:0.0:1716999798.053197:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.053294:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862016 00000100:00100000:2.0:1716999798.053301:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862016 00000100:00100000:2.0:1716999798.053342:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46830 00000100:00100000:2.0:1716999798.053348:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862016:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.053492:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862016:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 143us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.053498:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46830 00000100:00100000:0.0:1716999798.054875:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.055068:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862080 00000100:00100000:3.0:1716999798.055074:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862080 00000100:00100000:3.0:1716999798.055108:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46831 00000100:00100000:3.0:1716999798.055114:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862080:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.055266:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862080:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 120us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.055273:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46831 00000100:00100000:0.0:1716999798.057050:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.057125:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862144 00000100:00100000:2.0:1716999798.057131:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862144 00000100:00100000:2.0:1716999798.057167:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46832 00000100:00100000:2.0:1716999798.057173:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862144:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.057296:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862144:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 122us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.057302:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46832 00000100:00100000:0.0:1716999798.058914:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.059221:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862208 00000100:00100000:2.0:1716999798.059226:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862208 00000100:00100000:2.0:1716999798.059266:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46833 00000100:00100000:2.0:1716999798.059272:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862208:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.059395:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862208:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 122us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.059405:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46833 00000100:00100000:0.0:1716999798.061566:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.061653:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862272 00000100:00100000:3.0:1716999798.061660:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862272 00000100:00100000:3.0:1716999798.061696:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46834 00000100:00100000:3.0:1716999798.061703:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862272:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.061840:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862272:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 137us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.061850:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46834 00000100:00100000:0.0:1716999798.064320:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.064492:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862336 00000100:00100000:2.0:1716999798.064500:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862336 00000100:00100000:2.0:1716999798.064539:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46835 00000100:00100000:2.0:1716999798.064546:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862336:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.064683:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862336:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 137us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.064689:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46835 00000100:00100000:0.0:1716999798.066609:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.066854:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862400 00000100:00100000:3.0:1716999798.066860:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862400 00000100:00100000:3.0:1716999798.066913:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46836 00000100:00100000:3.0:1716999798.066919:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862400:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.067047:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862400:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 127us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.067053:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46836 00000100:00100000:0.0:1716999798.068338:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.068414:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862464 00000100:00100000:2.0:1716999798.068420:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862464 00000100:00100000:2.0:1716999798.068639:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46837 00000100:00100000:2.0:1716999798.068645:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862464:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.068793:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862464:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 148us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.068800:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46837 00000100:00100000:0.0:1716999798.070678:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.070821:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862528 00000100:00100000:3.0:1716999798.070827:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862528 00000100:00100000:3.0:1716999798.070865:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46838 00000100:00100000:3.0:1716999798.070870:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862528:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.071035:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862528:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 164us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.071041:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46838 00000100:00100000:0.0:1716999798.073381:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.073441:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862592 00000100:00100000:2.0:1716999798.073449:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862592 00000100:00100000:2.0:1716999798.073494:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46839 00000100:00100000:2.0:1716999798.073500:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862592:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.073643:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862592:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 142us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.073649:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46839 00000100:00100000:0.0:1716999798.074858:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.074966:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862656 00000100:00100000:3.0:1716999798.074971:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862656 00000100:00100000:3.0:1716999798.075006:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46840 00000100:00100000:3.0:1716999798.075012:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862656:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.075115:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862656:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 102us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.075121:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46840 00000100:00100000:0.0:1716999798.077540:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.077708:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862720 00000100:00100000:2.0:1716999798.077715:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862720 00000100:00100000:2.0:1716999798.077766:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46841 00000100:00100000:2.0:1716999798.077772:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862720:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.077937:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862720:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 165us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.077944:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46841 00000100:00100000:0.0:1716999798.080607:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.080965:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862784 00000100:00100000:3.0:1716999798.080973:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862784 00000100:00100000:3.0:1716999798.081018:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46842 00000100:00100000:3.0:1716999798.081025:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862784:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.081172:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862784:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 146us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.081179:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46842 00000100:00100000:0.0:1716999798.083472:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.083712:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862848 00000100:00100000:2.0:1716999798.083719:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862848 00000100:00100000:2.0:1716999798.083766:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46843 00000100:00100000:2.0:1716999798.083771:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862848:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.084314:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862848:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 540us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.084320:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46843 00000100:00100000:0.0:1716999798.086675:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.087086:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862912 00000100:00100000:2.0:1716999798.087093:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862912 00000100:00100000:2.0:1716999798.087127:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46844 00000100:00100000:2.0:1716999798.087132:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862912:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.087457:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862912:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 323us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.087463:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46844 00000100:00100000:0.0:1716999798.089177:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.090283:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480862976 00000100:00100000:2.0:1716999798.090291:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480862976 00000100:00100000:2.0:1716999798.090474:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46845 00000100:00100000:2.0:1716999798.090480:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862976:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.090632:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f77b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480862976:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 150us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.090642:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46845 00000100:00100000:0.0:1716999798.092421:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.092896:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863040 00000100:00100000:3.0:1716999798.092903:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863040 00000100:00100000:3.0:1716999798.092940:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46846 00000100:00100000:3.0:1716999798.092946:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863040:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.093077:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863040:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 130us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.093083:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46846 00000100:00100000:0.0:1716999798.095796:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.096014:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863104 00000100:00100000:2.0:1716999798.096021:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863104 00000100:00100000:2.0:1716999798.096063:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46847 00000100:00100000:2.0:1716999798.096069:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863104:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.096861:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863104:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 790us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.096869:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46847 00000100:00100000:0.0:1716999798.098604:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.099118:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863168 00000100:00100000:2.0:1716999798.099124:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863168 00000100:00100000:2.0:1716999798.099160:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46848 00000100:00100000:2.0:1716999798.099165:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863168:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.099298:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863168:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 132us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.099305:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46848 00000100:00100000:0.0:1716999798.101184:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.101294:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863232 00000100:00100000:3.0:1716999798.101300:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863232 00000100:00100000:3.0:1716999798.101333:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46849 00000100:00100000:3.0:1716999798.101338:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863232:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.101454:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863232:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 115us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.101461:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46849 00000100:00100000:0.0:1716999798.103722:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.103800:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863296 00000100:00100000:2.0:1716999798.103806:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863296 00000100:00100000:2.0:1716999798.103867:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46850 00000100:00100000:2.0:1716999798.103873:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863296:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.104009:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863296:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 136us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.104015:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46850 00000100:00100000:0.0:1716999798.106309:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.106474:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863360 00000100:00100000:3.0:1716999798.106480:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863360 00000100:00100000:3.0:1716999798.106518:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46851 00000100:00100000:3.0:1716999798.106524:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863360:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.106651:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863360:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 126us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.106660:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46851 00000100:00100000:0.0:1716999798.108774:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.108861:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863424 00000100:00100000:2.0:1716999798.108867:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863424 00000100:00100000:2.0:1716999798.108919:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46852 00000100:00100000:2.0:1716999798.108925:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863424:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.109051:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863424:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 124us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.109057:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46852 00000100:00100000:0.0:1716999798.111078:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.111321:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863488 00000100:00100000:3.0:1716999798.111327:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863488 00000100:00100000:3.0:1716999798.111365:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46853 00000100:00100000:3.0:1716999798.111370:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863488:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.111491:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863488:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 119us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.111497:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46853 00000100:00100000:0.0:1716999798.113452:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.113535:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863552 00000100:00100000:2.0:1716999798.113541:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863552 00000100:00100000:2.0:1716999798.113576:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46854 00000100:00100000:2.0:1716999798.113580:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863552:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.113699:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863552:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 117us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.113705:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46854 00000100:00100000:0.0:1716999798.115196:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.115481:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863616 00000100:00100000:3.0:1716999798.115487:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863616 00000100:00100000:3.0:1716999798.115510:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46855 00000100:00100000:3.0:1716999798.115516:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863616:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00010000:00010000:1.0:1716999798.115575:0:11316:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1716999798.115626:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863616:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 109us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.115633:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46855 00000100:00100000:0.0:1716999798.117967:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.118067:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863680 00000100:00100000:3.0:1716999798.118073:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863680 00000100:00100000:3.0:1716999798.118112:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46856 00000100:00100000:3.0:1716999798.118118:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863680:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.118249:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863680:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 130us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.118256:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46856 00000100:00100000:0.0:1716999798.120628:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.121048:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863744 00000100:00100000:2.0:1716999798.121054:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863744 00000100:00100000:2.0:1716999798.121092:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46857 00000100:00100000:2.0:1716999798.121098:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863744:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.121233:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863744:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 134us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.121240:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46857 00000100:00100000:0.0:1716999798.122349:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.122919:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863808 00000100:00100000:3.0:1716999798.122925:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863808 00000100:00100000:3.0:1716999798.122961:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46858 00000100:00100000:3.0:1716999798.122967:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863808:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.123084:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863808:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 117us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.123091:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46858 00000100:00100000:0.0:1716999798.124666:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.124769:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863872 00000100:00100000:2.0:1716999798.124774:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863872 00000100:00100000:2.0:1716999798.124804:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46859 00000100:00100000:2.0:1716999798.124809:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863872:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.124951:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863872:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 140us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.124960:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46859 00000100:00100000:0.0:1716999798.127162:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.127335:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480863936 00000100:00100000:3.0:1716999798.127342:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480863936 00000100:00100000:3.0:1716999798.127381:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46860 00000100:00100000:3.0:1716999798.127387:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863936:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.127519:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480863936:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 131us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.127526:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46860 00000100:00100000:0.0:1716999798.129696:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.129816:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864000 00000100:00100000:2.0:1716999798.129822:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864000 00000100:00100000:2.0:1716999798.129858:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46861 00000100:00100000:2.0:1716999798.129864:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864000:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.130014:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864000:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 149us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.130020:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46861 00000100:00100000:0.0:1716999798.131738:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.131825:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864064 00000100:00100000:3.0:1716999798.131831:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864064 00000100:00100000:3.0:1716999798.131861:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46862 00000100:00100000:3.0:1716999798.131866:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864064:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.131991:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864064:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 124us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.131997:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46862 00000100:00100000:0.0:1716999798.133377:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.134109:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864128 00000100:00100000:2.0:1716999798.134114:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864128 00000100:00100000:2.0:1716999798.134155:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46863 00000100:00100000:2.0:1716999798.134160:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864128:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.134282:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864128:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 121us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.134289:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46863 00000100:00100000:0.0:1716999798.135609:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.135689:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864192 00000100:00100000:3.0:1716999798.135694:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864192 00000100:00100000:3.0:1716999798.135725:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46864 00000100:00100000:3.0:1716999798.135731:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864192:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.135834:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008927d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864192:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 102us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.135844:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46864 00000100:00100000:0.0:1716999798.137111:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.137267:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864256 00000100:00100000:2.0:1716999798.137272:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864256 00000100:00100000:2.0:1716999798.137303:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46865 00000100:00100000:2.0:1716999798.137308:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864256:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.137409:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864256:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 99us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.137415:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46865 00000100:00100000:0.0:1716999798.140020:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.140113:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864320 00000100:00100000:3.0:1716999798.140120:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864320 00000100:00100000:3.0:1716999798.140163:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46866 00000100:00100000:3.0:1716999798.140169:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864320:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.140312:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864320:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 142us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.140318:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46866 00000100:00100000:0.0:1716999798.141872:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.142196:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864384 00000100:00100000:2.0:1716999798.142202:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864384 00000100:00100000:2.0:1716999798.142475:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46867 00000100:00100000:2.0:1716999798.142482:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864384:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.142607:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864384:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 124us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.142613:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46867 00000100:00100000:0.0:1716999798.144713:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.144797:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864448 00000100:00100000:3.0:1716999798.144803:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864448 00000100:00100000:3.0:1716999798.144840:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46868 00000100:00100000:3.0:1716999798.144845:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864448:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.145050:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864448:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 203us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.145056:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46868 00000100:00100000:0.0:1716999798.147274:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.147357:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864512 00000100:00100000:2.0:1716999798.147364:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864512 00000100:00100000:2.0:1716999798.147406:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46869 00000100:00100000:2.0:1716999798.147413:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864512:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.147538:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864512:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 126us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.147545:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46869 00000100:00100000:0.0:1716999798.149627:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.149700:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864576 00000100:00100000:3.0:1716999798.149706:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864576 00000100:00100000:3.0:1716999798.149742:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46870 00000100:00100000:3.0:1716999798.149758:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864576:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.149877:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864576:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 118us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.149902:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46870 00000100:00100000:2.0:1716999798.151682:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999798.151821:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864640 00000100:00100000:0.0:1716999798.151827:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864640 00000100:00100000:3.0:1716999798.152103:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46871 00000100:00100000:3.0:1716999798.152109:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864640:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.152223:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880131ca9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864640:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 113us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.152229:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46871 00000100:00100000:0.0:1716999798.154084:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.154223:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864704 00000100:00100000:2.0:1716999798.154228:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864704 00000100:00100000:2.0:1716999798.154257:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46872 00000100:00100000:2.0:1716999798.154263:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864704:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.154371:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864704:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 107us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.154378:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46872 00000100:00100000:0.0:1716999798.156430:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.156452:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864768 00000100:00100000:3.0:1716999798.156458:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864768 00000100:00100000:3.0:1716999798.156502:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46873 00000100:00100000:3.0:1716999798.156508:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864768:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.156632:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864768:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 123us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.156638:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46873 00000100:00100000:0.0:1716999798.159385:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.159465:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864832 00000100:00100000:2.0:1716999798.159472:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864832 00000100:00100000:2.0:1716999798.159507:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46874 00000100:00100000:2.0:1716999798.159513:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864832:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.159638:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864832:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 124us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.159645:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46874 00000100:00100000:0.0:1716999798.161694:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.162033:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864896 00000100:00100000:2.0:1716999798.162040:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864896 00000100:00100000:2.0:1716999798.162084:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46875 00000100:00100000:2.0:1716999798.162090:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864896:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.162495:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864896:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 403us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.162502:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46875 00000100:00100000:0.0:1716999798.164502:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.164578:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480864960 00000100:00100000:2.0:1716999798.164584:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480864960 00000100:00100000:2.0:1716999798.164620:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46876 00000100:00100000:2.0:1716999798.164625:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864960:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.164758:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480864960:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 132us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.164765:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46876 00000100:00100000:0.0:1716999798.167074:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.167308:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865024 00000100:00100000:3.0:1716999798.167315:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865024 00000100:00100000:3.0:1716999798.167354:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46877 00000100:00100000:3.0:1716999798.167360:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865024:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.167492:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865024:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 131us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.167499:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46877 00000100:00100000:0.0:1716999798.169343:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.169985:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865088 00000100:00100000:2.0:1716999798.169992:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865088 00000100:00100000:2.0:1716999798.170033:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46878 00000100:00100000:2.0:1716999798.170038:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865088:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.170159:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865088:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 120us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.170165:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46878 00000100:00100000:0.0:1716999798.171468:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.172155:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865152 00000100:00100000:3.0:1716999798.172162:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865152 00000100:00100000:3.0:1716999798.172199:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46879 00000100:00100000:3.0:1716999798.172205:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865152:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.172323:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865152:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 118us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.172330:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46879 00000100:00100000:0.0:1716999798.174086:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.174197:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865216 00000100:00100000:2.0:1716999798.174202:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865216 00000100:00100000:2.0:1716999798.174235:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46880 00000100:00100000:2.0:1716999798.174241:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865216:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.174353:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865216:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 111us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.174359:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46880 00000100:00100000:0.0:1716999798.175925:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.176595:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865280 00000100:00100000:3.0:1716999798.176602:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865280 00000100:00100000:3.0:1716999798.176638:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46881 00000100:00100000:3.0:1716999798.176644:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865280:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.176771:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865280:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 127us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.176778:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46881 00000100:00100000:0.0:1716999798.178996:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.179081:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865344 00000100:00100000:2.0:1716999798.179087:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865344 00000100:00100000:2.0:1716999798.179121:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46882 00000100:00100000:2.0:1716999798.179126:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865344:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.179245:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865344:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 118us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.179251:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46882 00000100:00100000:0.0:1716999798.180492:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.181069:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865408 00000100:00100000:3.0:1716999798.181074:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865408 00000100:00100000:3.0:1716999798.181105:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46883 00000100:00100000:3.0:1716999798.181110:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865408:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.181201:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865408:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 90us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.181206:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46883 00000100:00100000:0.0:1716999798.182409:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.182864:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865472 00000100:00100000:2.0:1716999798.182869:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865472 00000100:00100000:2.0:1716999798.182916:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46884 00000100:00100000:2.0:1716999798.182921:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801327e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865472:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.183003:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801327e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865472:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 81us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.183008:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46884 00000100:00100000:0.0:1716999798.184654:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.184836:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865536 00000100:00100000:3.0:1716999798.184841:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865536 00000100:00100000:3.0:1716999798.184873:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46885 00000100:00100000:3.0:1716999798.184877:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801327e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865536:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.184992:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801327e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865536:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 114us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.184998:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46885 00000100:00100000:0.0:1716999798.186687:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.186842:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865600 00000100:00100000:2.0:1716999798.186847:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865600 00000100:00100000:2.0:1716999798.186875:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46886 00000100:00100000:2.0:1716999798.186896:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801327e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865600:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.187063:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801327e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865600:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 182us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.187071:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46886 00000100:00100000:0.0:1716999798.188740:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.188894:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865664 00000100:00100000:3.0:1716999798.188899:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865664 00000100:00100000:3.0:1716999798.189029:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46887 00000100:00100000:3.0:1716999798.189035:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801327e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865664:12345-192.168.203.3@tcp:501:chlg_load_threa.0 00000100:00100000:3.0:1716999798.189092:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801327e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865664:12345-192.168.203.3@tcp:501:chlg_load_threa.0 Request processed in 57us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.189097:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46887 00000100:00100000:1.0:1716999798.190014:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.190079:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865728 00000100:00100000:2.0:1716999798.190082:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865728 00000100:00100000:2.0:1716999798.190107:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46888 00000100:00100000:2.0:1716999798.190111:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff88008eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865728:12345-192.168.203.3@tcp:503:chlg_load_threa.0 00000100:00100000:2.0:1716999798.190197:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff88008eb2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865728:12345-192.168.203.3@tcp:503:chlg_load_threa.0 Request processed in 84us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.190202:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46888 00000100:00100000:0.0:1716999798.191020:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.191167:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865792 00000100:00100000:3.0:1716999798.191171:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865792 00000100:00100000:3.0:1716999798.191193:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46889 00000100:00100000:3.0:1716999798.191197:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801327e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865792:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.191285:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801327e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865792:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.191291:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46889 00000100:00100000:0.0:1716999798.192862:0:3210:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.192945:0:7785:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865856 00000100:00100000:2.0:1716999798.192950:0:7785:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865856 00000100:00100000:2.0:1716999798.192984:0:7785:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46890 00000100:00100000:2.0:1716999798.192990:0:7785:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801327e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865856:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:2.0:1716999798.193100:0:7785:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801327e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865856:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 109us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.193106:0:7785:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46890 00000100:00100000:0.0:1716999798.194642:0:3211:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:3.0:1716999798.194794:0:11055:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865920 00000100:00100000:3.0:1716999798.194799:0:11055:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865920 00000100:00100000:3.0:1716999798.194896:0:11055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 46891 00000100:00100000:3.0:1716999798.194902:0:11055:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801327e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865920:12345-192.168.203.3@tcp:502:chlg_load_threa.0 00000100:00100000:3.0:1716999798.195109:0:11055:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801327e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:107d663a-2216-406b-94c6-b2fcb1558728+16:11606:x1800404480865920:12345-192.168.203.3@tcp:502:chlg_load_threa.0 Request processed in 206us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.195115:0:11055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 46891 00000100:00100000:0.0:1716999798.332108:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999798.332153:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:0.0:1716999798.332188:0:3212:0:(events.c:359:request_in_callback()) peer: 12345-192.168.203.3@tcp (source: 12345-192.168.203.3@tcp) 00000100:00100000:2.0:1716999798.332320:0:17474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480866048 00000100:00100000:2.0:1716999798.332328:0:17474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480866048 00000100:00100000:3.0:1716999798.332337:0:6818:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480865984 00000100:00100000:3.0:1716999798.332342:0:6818:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480865984 00000100:00100000:2.0:1716999798.332363:0:17474:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404480866112 00000100:00100000:2.0:1716999798.332365:0:17474:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404480866112 00000100:00100000:3.0:1716999798.332367:0:6818:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 289 00000100:00100000:3.0:1716999798.332373:0:6818:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880130ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb23a41-fd22-43b9-8f02-427ab7f7699a+9:1956:x1800404480865984:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1716999798.332381:0:17474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:2.0:1716999798.332386:0:17474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801327e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:107d663a-2216-406b-94c6-b2fcb1558728+7:1956:x1800404480866048:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1716999798.332438:0:17474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801327e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:107d663a-2216-406b-94c6-b2fcb1558728+7:1956:x1800404480866048:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 50us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.332444:0:17474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 88 00000100:00100000:2.0:1716999798.332457:0:17474:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00100000:2.0:1716999798.332461:0:17474:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff8801327e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:107d663a-2216-406b-94c6-b2fcb1558728+5:1956:x1800404480866112:12345-192.168.203.3@tcp:400:kworker.0 00000100:00100000:2.0:1716999798.332482:0:17474:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff8801327e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:107d663a-2216-406b-94c6-b2fcb1558728+5:1956:x1800404480866112:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 19us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1716999798.332486:0:17474:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 89 00000100:00080000:2.0:1716999798.332504:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 older than 1716999768 00000100:00080000:2.0:1716999798.332507:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd MGS older than 1716999768 00000100:00080000:2.0:1716999798.332509:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1716999768 00000100:00100000:3.0:1716999798.332810:0:6818:0:(service.c:2384:ptlrpc_server_handle_request()) Handled RPC req@ffff880130ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfb23a41-fd22-43b9-8f02-427ab7f7699a+9:1956:x1800404480865984:12345-192.168.203.3@tcp:400:kworker.0 Request processed in 436us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1716999798.332817:0:6818:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.3@tcp, seq: 289 00000001:02000400:1.0:1716999798.753762:0:22949:0:(debug.c:671:libcfs_debug_mark_buffer()) DEBUG MARKER: lustre-rsync-test test_2c: @@@@@@ FAIL: Failure in replication; differences found. 00010000:00010000:0.0:1716999799.117565:0:6810:0:(ldlm_lockd.c:2859:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1716999799.388617:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986645 is committed 00000004:00080000:0.0:1716999799.388631:0:7006:0:(osp_sync.c:1604:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 141 committed 00000001:00080000:0.0:1716999799.388641:0:7006:0:(tgt_lastrcvd.c:969:tgt_cb_last_committed()) lustre-MDT0000: transno 4294986646 is committed 00000100:00100000:2.0:1716999799.388874:0:3218:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801327e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3218:1800404483036928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1716999799.388939:0:3218:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1716999799.389306:0:3220:0:(ptlrpcd.c:417:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1716999799.389316:0:3220:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff8801327e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3220:1800404483036992:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1716999799.389704:0:15837:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036928 00000100:00100000:1.0:1716999799.389710:0:15837:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036928 00000100:00100000:1.0:1716999799.389753:0:15837:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10213 00000100:00100000:1.0:1716999799.389758:0:15837:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880131ca9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3218:x1800404483036928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1716999799.389779:0:15837:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:840 count 1 00010000:00010000:1.0:1716999799.389795:0:15837:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8b2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999799.389810:0:15837:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800920fba80/0x6d188eabd8d6f958 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0b5 expref: 6 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999799.389819:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999799.389821:0:15837:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1716999799.389823:0:15837:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a695dd40/0x6d188eabd8dc8b2f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15837 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999799.389844:0:15837:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800920fba80/0x6d188eabd8d6f958 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0b5 expref: 6 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1716999799.389853:0:15837:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800920fba80/0x6d188eabd8d6f958 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x348:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->12287) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0b5 expref: 6 pid: 11262 timeout: 418 lvb_type: 0 00000100:00100000:1.0:1716999799.389862:0:15837:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff88008eb2d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:15837:1800404483037056:192.168.203.3@tcp:104: 00000100:00100000:1.0:1716999799.389912:0:15837:0:(client.c:2542:ptlrpc_set_wait()) set ffff880099a71780 going to sleep for 11 seconds 00000100:00080000:2.0:1716999799.390024:0:6819:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 older than 1716999769 00000100:00100000:3.0:1716999799.390086:0:3220:0:(events.c:359:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1716999799.390131:0:17365:0:(service.c:2096:ptlrpc_server_handle_req_in()) unwrap req x1800404483036992 00000100:00100000:2.0:1716999799.390135:0:17365:0:(service.c:2161:ptlrpc_server_handle_req_in()) got req x1800404483036992 00000100:00100000:2.0:1716999799.390151:0:17365:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10214 00000100:00100000:2.0:1716999799.390155:0:17365:0:(service.c:2335:ptlrpc_server_handle_request()) Handling RPC req@ffff880092e7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3220:x1800404483036992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1716999799.390164:0:17365:0:(ofd_dev.c:1777:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:841 count 1 00010000:00010000:2.0:1716999799.390173:0:17365:0:(ldlm_lock.c:797:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091833180/0x6d188eabd8dc8b36 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999799.390182:0:17365:0:(ldlm_lock.c:707:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012facd680/0x6d188eabd8d6fa0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0ed expref: 6 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999799.390187:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999799.390189:0:17365:0:(ldlm_extent.c:339:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1716999799.390191:0:17365:0:(ldlm_resource.c:1668:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091833180/0x6d188eabd8dc8b36 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 17365 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999799.390205:0:17365:0:(ldlm_lockd.c:1016:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012facd680/0x6d188eabd8d6fa0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0ed expref: 6 pid: 11262 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1716999799.390212:0:17365:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012facd680/0x6d188eabd8d6fa0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x349:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.203.3@tcp remote: 0xa74134e555f4b0ed expref: 6 pid: 11262 timeout: 418 lvb_type: 0 00000100:00100000:2.0:1716999799.390219:0:17365:0:(client.c:1776:ptlrpc_send_new_req()) Sending RPC req@ffff880131ca8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:17365:1800404483037120:192.168.203.3@tcp:104: 00000100:00100000:2.0:1716999799.390240:0:17365:0:(client.c:2542:ptlrpc_set_wait()) set ffff880131f953c0 going to sleep for 11 seconds Debug log: 66049 lines, 66049 kept, 0 dropped, 0 bad.